Which AI can you trust for regulatory & licensing?
By Anthony Vincent Caracappa, Founder and Self-Directed Space Researcher, Viventine Space Systems · updated
FCC, ITU and FAA filings, milestones, surety bonds, licensing rules and deadlines.
On their own, no AI earns "Trust it" here. With Orbit Sentinel tools: Claude Fable 5.1, Claude Opus 5.5, Grok 4.7, Claude Sonnet 5.5, Claude Haiku 5.5.
| AI | AloneClosed-book | With dataWith Orbit Sentinel tools | n | ||||
|---|---|---|---|---|---|---|---|
| right / wrong | range | declined | right / wrong | range | declined | ||
| Claude Fable 5.1 Anthropic | 38 / 5 | 25–54 | 56 | 98 / 2 | 88–100 | 0 | 38×3 |
| Claude Opus 5.5 Anthropic | 33 / 5 | 21–49 | 62 | 97 / 3 | 87–100 | 0 | 38×3 |
| Grok 4.7 xAI | 28 / 0 | 17–44 | 72 | 96 / 1 | 85–99 | 3 | 38×3 |
| Claude Sonnet 5.5 Anthropic | 31 / 8 | 19–46 | 62 | 93 / 4 | 80–98 | 3 | 38×3 |
| Claude Haiku 5.5 Anthropic | 23 / 8 | 13–38 | 69 | 82 / 3 | 67–91 | 16 | 38×3 |
| Gemma 4 12B Google | 14 / 47 | 6–29 | 39 | 68 / 18 | 53–81 | 14 | 38×3 |
| gpt-oss 20B OpenAI | 10 / 56 | 4–24 | 33 | 48 / 18 | 33–64 | 33 | 38×3 |
| DeepSeek-R1 14B DeepSeek | 8 / 51 | 3–20 | 41 | — | 39×1 | ||
% right / % wrong per cell; color is the verdict (green trust it, amber verify, red don't use). Range is the 95% interval for % right, counting each question once; n is questions × runs for the tools track.
Sample questions
- How many FCC special temporary authority (STA) requests for satellite or earth-station operations were filed in calendar year 2025?
- Under its original FCC authorization, by what date must Amazon's Project Kuiper have half of its authorized satellites deployed? Answer as YYYY-MM-DD.
- How many foreign-licensed NGSO satellite systems hold US market access on the FCC Approved Space Station List?
- Which national administration licenses the OneWeb constellation, per the FCC's Approved Space Station List?
- Which operator holds the most NGSO space-station authorizations on the FCC's Approved Space Station List?
- What third-party liability insurance amount, in US dollars, does the FAA require for flight operations under SpaceX's Starship vehicle operator license VOL 23-129?