Which AI can you trust for catalog lookup?
By Anthony Vincent Caracappa, Founder and Self-Directed Space Researcher, Viventine Space Systems · updated
Look up a specific object: NORAD and COSPAR IDs, owners, launch and decay dates, orbit class.
On their own, no AI earns "Trust it" here. With Orbit Sentinel tools: Claude Fable 5.1, Claude Haiku 5.5, Claude Opus 5.5, Claude Sonnet 5.5, Grok 4.7, Gemma 4 12B, gpt-oss 20B.
| AI | AloneClosed-book | With dataWith Orbit Sentinel tools | n | ||||
|---|---|---|---|---|---|---|---|
| right / wrong | range | declined | right / wrong | range | declined | ||
| Claude Fable 5.1 Anthropic | 64 / 7 | 50–77 | 29 | 100 / 0 | 92–100 | 0 | 45×3 |
| Claude Haiku 5.5 Anthropic | 27 / 24 | 16–41 | 49 | 100 / 0 | 92–100 | 0 | 45×3 |
| Claude Opus 5.5 Anthropic | 76 / 9 | 61–86 | 16 | 100 / 0 | 92–100 | 0 | 45×3 |
| Claude Sonnet 5.5 Anthropic | 60 / 11 | 45–73 | 29 | 100 / 0 | 92–100 | 0 | 45×3 |
| Grok 4.7 xAI | 42 / 0 | 29–57 | 58 | 100 / 0 | 92–100 | 0 | 45×3 |
| Gemma 4 12B Google | 9 / 60 | 3–22 | 31 | 99 / 1 | 90–100 | 0 | 45×3 |
| gpt-oss 20B OpenAI | 7 / 67 | 2–18 | 27 | 92 / 1 | 80–97 | 7 | 45×3 |
| DeepSeek-R1 14B DeepSeek | 7 / 60 | 2–18 | 33 | — | 45×1 | ||
% right / % wrong per cell; color is the verdict (green trust it, amber verify, red don't use). Range is the 95% interval for % right, counting each question once; n is questions × runs for the tools track.
Sample questions
- How many payloads were launched into orbit during calendar year 2025?
- How many cataloged objects of all types reentered the atmosphere during calendar year 2025?
- How many payloads (all operators) are cataloged as still in orbit, i.e. not reentered, as of October 2026?
- NORAD catalog number 1 belongs to an object from the Sputnik 1 launch. Is it a payload, a rocket body, or debris?
- What is the NORAD catalog number of the Hubble Space Telescope?
- What is the COSPAR international designator of the object with NORAD catalog number 48274? Answer in the form YYYY-NNNA.