Can you trust Grok 4.7 for space work?
By Anthony Vincent Caracappa, Founder and Self-Directed Space Researcher, Viventine Space Systems · updated
On its own, trust it for baseline knowledge. Connected to Orbit Sentinel, trust it for catalog lookup, constellation & fleet status, debris & conjunction context, regulatory & licensing, company & market intelligence, ground infrastructure, baseline knowledge.
| Job | AloneClosed-book | With dataWith Orbit Sentinel tools | n | ||||
|---|---|---|---|---|---|---|---|
| right / wrong | range | declined | right / wrong | range | declined | ||
| Catalog lookup | 42 / 0 | 29–57 | 58 | 100 / 0 | 92–100 | 0 | 45×3 |
| Constellation & fleet status | 16 / 0 | 8–30 | 84 | 95 / 5 | 85–99 | 0 | 43×3 |
| Debris & conjunction context | 14 / 2 | 7–28 | 83 | 94 / 2 | 82–98 | 4 | 42×3 |
| Regulatory & licensing | 28 / 0 | 17–44 | 72 | 96 / 1 | 85–99 | 3 | 38×3 |
| Company & market intelligence | 22 / 5 | 12–37 | 73 | 100 / 0 | 91–100 | 0 | 41×3 |
| Ground infrastructure | 13 / 5 | 5–26 | 83 | 93 / 3 | 80–97 | 5 | 40×3 |
| Baseline knowledge | 96 / 0 | 80–99 | 4 | 97 / 0 | 82–100 | 3 | 25×3 |
| Orbit Sentinel-only questions | 0 / 0 | 0–13 | 100 | 93 / 0 | 77–98 | 7 | 25×3 |
% right / % wrong per cell; color is the verdict (green trust it, amber verify, red don't use). Range is the 95% interval for % right, counting each question once; n is questions × runs for the tools track.
- How it was run
- xAI API
- Tool loop
- SpaceBench tool loop
- Runs
- 1 on its own, 3 with tools; rates pool all runs, ranges count each question once
- Verdict rule
- Trust it: wrong ≤ 5% and right ≥ 80%. Don't use it: wrong > 20%. Otherwise verify its answers.
Limits, harness differences and corrections: methodology.