← All verdicts

Can you trust DeepSeek-R1 14B for space work?

By , Founder and Self-Directed Space Researcher, Viventine Space Systems · updated

On its own, it earns "Trust it" on none of the jobs.

Offered the Orbit Sentinel tools, it never called them, so it is reported without tools only.

Job Alone With data
right / wrong declined right / wrong declined
Catalog lookup
7 / 60
33
—
Constellation & fleet status
19 / 49
33
—
Debris & conjunction context
5 / 67
29
—
Regulatory & licensing
8 / 51
41
—
Company & market intelligence
5 / 46
49
—
Ground infrastructure
13 / 43
45
—
Baseline knowledge
68 / 32
0
—
Orbit Sentinel-only questions
8 / 16
76
—

% right / % wrong per cell; color is the verdict (green trust it, amber verify, red don't use). Range is the 95% interval for % right, counting each question once; n is questions × runs for the tools track.

How it was run
Open weights, run locally (Ollama on one RTX 4090)
Runs
1 on its own; rates pool all runs, ranges count each question once
Verdict rule
Trust it: wrong ≤ 5% and right ≥ 80%. Don't use it: wrong > 20%. Otherwise verify its answers.

Limits, harness differences and corrections: methodology.