← All verdicts

Can you trust Claude Sonnet 5.5 for space work?

By , Founder and Self-Directed Space Researcher, Viventine Space Systems · updated

On its own, trust it for baseline knowledge. Connected to Orbit Sentinel, trust it for catalog lookup, constellation & fleet status, debris & conjunction context, regulatory & licensing, company & market intelligence, ground infrastructure, baseline knowledge.

Job Alone With data
right / wrong declined right / wrong declined
Catalog lookup
60 / 11
29
100 / 0
0
Constellation & fleet status
42 / 7
51
99 / 1
0
Debris & conjunction context
40 / 21
38
96 / 2
2
Regulatory & licensing
31 / 8
62
93 / 4
3
Company & market intelligence
37 / 24
39
99 / 0
1
Ground infrastructure
28 / 18
55
96 / 4
0
Baseline knowledge
100 / 0
0
99 / 1
0
Orbit Sentinel-only questions
8 / 4
88
99 / 0
1

% right / % wrong per cell; color is the verdict (green trust it, amber verify, red don't use). Range is the 95% interval for % right, counting each question once; n is questions × runs for the tools track.

How it was run
Claude Code on a Claude Pro subscription
Tool loop
Claude Code's own tool loop
Runs
1 on its own, 3 with tools; rates pool all runs, ranges count each question once
Verdict rule
Trust it: wrong ≤ 5% and right ≥ 80%. Don't use it: wrong > 20%. Otherwise verify its answers.

Limits, harness differences and corrections: methodology.