Kaelum Bench v0.2 · Public Calibration

NVIDIA Nemotron 3 Ultra

Accounting Capstone · Run evidence

Provisional · Hybrid

Provisional calibration result — not a verified v1 result.

Configuration-specific evidence for a single published run. It is not a statistical ranking and is not an overall score.

Run identity

Model and configuration

Model display name
NVIDIA Nemotron 3 Ultra
Requested model ID
nvidia/nemotron-3-ultra-550b-a55b
Provider
Together AI
Reasoning configuration
high
Suite
Accounting Capstone
Validity
Provisional

Published score

Scoring evidence

Score
406.6 / 1000
Percentage
40.7%
Scoring method
Hybrid
Comparison protocol
Configuration-specific
Tool access
None
Published total cost (model + judge)
$3.47

Usage

Tokens and execution

Input tokens (tested model)
88,073
Output tokens (tested model)
58,827
Total tokens (tested model)
146,900
Attempted tasks
100 / 100
Valid responses
95 / 100
Invalid JSON
5
Schema failures
0
Provider failures
0
Missing responses
0

Release provenance

Versioned run evidence

Benchmark ID
FMB-CAP-ACC-03
Benchmark version
0.3.0-dev
Scorer ID
fmb-live-scorer-v1
Started at
Completed at
Run ID
ee26ebcc-f39b-57b7-af87-50a010acde3e
Signed release ID
9d07d6d8-80f4-4bca-9adf-1f436336d09d