Kaelum Bench v0.2 · Public Calibration
NVIDIA Nemotron 3 Ultra
Accounting Knowledge · Run evidence
Provisional calibration result — not a verified v1 result.
Configuration-specific evidence for a single published run. It is not a statistical ranking and is not an overall score.
Run identity
Model and configuration
- Model display name
- NVIDIA Nemotron 3 Ultra
- Requested model ID
- nvidia/nemotron-3-ultra-550b-a55b
- Provider
- Together AI
- Reasoning configuration
- high
- Suite
- Accounting Knowledge
- Validity
- Provisional
Published score
Scoring evidence
- Score
- 510.5 / 600
- Percentage
- 85.1%
- Scoring method
- Hybrid
- Comparison protocol
- Configuration-specific
- Tool access
- None
- Published total cost (model + judge)
- $0.9641
Usage
Tokens and execution
- Input tokens (tested model)
- 39,261
- Output tokens (tested model)
- 14,084
- Total tokens (tested model)
- 53,345
- Attempted tasks
- 60 / 60
- Valid responses
- 60 / 60
- Invalid JSON
- 0
- Schema failures
- 0
- Provider failures
- 0
- Missing responses
- 0
Release provenance
Versioned run evidence
- Benchmark ID
- FMB-KNOW-ACC-01
- Benchmark version
- 0.1.0-dev
- Scorer ID
- fmb-live-scorer-v1
- Started at
- Completed at
- Run ID
- 2ea95c9d-cd5f-5bb3-a842-850923900097
- Signed release ID
- 0bae13a5-a0c9-44fb-b6df-6bc83a6847d5