Which AI can you trust for debris & conjunction context?
By Anthony Vincent Caracappa, Founder and Self-Directed Space Researcher, Viventine Space Systems · updated
Breakup events, debris and rocket-body populations, collision-risk thresholds and standards.
On their own, no AI earns "Trust it" here. With Orbit Sentinel tools: Claude Fable 5.1, Claude Opus 5.5, Claude Sonnet 5.5, Grok 4.7, Claude Haiku 5.5.
| AI | AloneClosed-book | With dataWith Orbit Sentinel tools | n | ||||
|---|---|---|---|---|---|---|---|
| right / wrong | range | declined | right / wrong | range | declined | ||
| Claude Fable 5.1 Anthropic | 45 / 14 | 31–60 | 40 | 99 / 0 | 90–100 | 1 | 42×3 |
| Claude Opus 5.5 Anthropic | 40 / 24 | 27–56 | 36 | 99 / 1 | 90–100 | 0 | 42×3 |
| Claude Sonnet 5.5 Anthropic | 40 / 21 | 27–56 | 38 | 96 / 2 | 85–99 | 2 | 42×3 |
| Grok 4.7 xAI | 14 / 2 | 7–28 | 83 | 94 / 2 | 82–98 | 4 | 42×3 |
| Claude Haiku 5.5 Anthropic | 19 / 10 | 10–33 | 71 | 93 / 0 | 81–98 | 7 | 42×3 |
| gpt-oss 20B OpenAI | 5 / 69 | 1–16 | 26 | 58 / 13 | 43–72 | 29 | 42×3 |
| Gemma 4 12B Google | 13 / 36 | 6–27 | 51 | 61 / 21 | 46–75 | 17 | 42×3 |
| DeepSeek-R1 14B DeepSeek | 5 / 67 | 1–16 | 29 | — | 42×1 | ||
% right / % wrong per cell; color is the verdict (green trust it, amber verify, red don't use). Range is the 95% interval for % right, counting each question once; n is questions × runs for the tools track.
Sample questions
- How many debris objects from the 2007 Chinese anti-satellite test on Fengyun-1C have been cataloged in total (on orbit and reentered), as of October 2026?
- Of all cataloged debris from the 2007 Fengyun-1C anti-satellite test, what percentage is still on orbit (not reentered) as of October 2026?
- How many cataloged objects (including debris) resulted from Cosmos 2251, the satellite destroyed in the 2009 Iridium collision, as of October 2026?
- How many cataloged objects (including debris) are associated with Iridium 33, destroyed in the 2009 collision, as of October 2026?
- How many debris objects were cataloged from Russia's November 2021 anti-satellite test that destroyed Cosmos 1408, as of October 2026?
- What percentage of the cataloged debris from the 2021 Cosmos 1408 anti-satellite test has already reentered, as of October 2026?