Kaelum Bench v0.2 · Public Calibration

kimi-k2.6

Capital Budgeting · Run evidence

Provisional · Deterministic

Run identity

Model and configuration

Model display name
kimi-k2.6
Exact model ID
moonshotai/kimi-k2.6
Provider
ModelRun
Exact provider route
openrouter/modelrun/fp4
Runtime ID
openrouter-tool-free-non-streaming-v7
Runtime version
v7
Reasoning profile
reasoning-max-supported
Reasoning configuration
max
Tool access
None
Suite
Capital Budgeting
Validity
Provisional
Material configuration parameters
allow_fallbacks
false
data_collection
deny
max_attempts_per_task
1
max_concurrency
1
max_generation_metadata_lookups
1
max_output_tokens
34000
max_raw_response_bytes
16777216
max_request_bytes
1048576
metadata_timeout_seconds
60
request_timeout_seconds
300
require_parameters
true
temperature
0
zdr
true

Published score

Scoring evidence

Score
390.0 / 600
Percentage
65.0%
Scoring method
Deterministic
Comparison protocol
Configuration-specific
Tested-model cost
$1.70
Judge cost
Not applicable
Total cost
$1.70

Usage

Tokens and execution

Input tokens (tested model)
59,290
Output tokens (tested model)
490,079
Total tokens (tested model)
549,369
Attempted tasks
60 / 60
Valid responses
42 / 60
Invalid JSON
18
Schema failures
0
Provider failures
0
Missing responses
0

Judge evidence

Independent assessment

Not applicable. This suite uses deterministic scoring and requires no judge.

Release provenance

Versioned run evidence

Benchmark ID
FMB-FIN-CAPBUD-01
Benchmark version
0.2.0-dev
Scorer ID
fmb-live-scorer-v1
Configuration key
config-465730f79203994758b03613fcce4049700b294cb827d2b69491c57ecff00df5
Campaign ID
c0c2eaa9-e697-42d2-bb49-3cf275ac446f
Comparison group ID
capital-budgeting-0.2.0-dev-configuration-specific-v1
Started at
Completed at
Run ID
1a1c8784-162f-5c09-b0cd-a91b2a6fdb71
Signed release ID
1ba8e99e-b1c5-4b45-8396-064ab0d81100
Release ID
fb62e46c-cbaa-45a4-9450-3c210d28db54
Manifest SHA-256
77ded8f43fd7d41378b8692278f2f1d60b9701c6b3d2ec19ca09884325a2d4b0
Source aggregate
fmb-live-runs-fin-capbud.json
Source aggregate SHA-256
cffeab752a9bc05c732b7b380732ba8616da25cc558c7521ec1369858d3da82d
Source aggregate bytes
8,007

Authenticated publication

Signed release evidence

The sanitized single-run JSON is a derived projection and is not separately signed. The Ed25519 signature authenticates the exact public manifest bytes, including the release inventory. The manifest in turn binds this run's source aggregate by its SHA-256 digest and byte size.

Verify this evidence
  1. Verify the detached Ed25519 signature over the domain-prefixed exact manifest bytes using the published public key.
  2. Confirm that the sidecar payload SHA-256 equals the manifest SHA-256 shown above.
  3. Hash the source aggregate and compare its SHA-256 and byte size with the signed manifest entry.
  4. Resolve this run ID through the public run index and match its campaign ID inside that aggregate.
node -e 'const fs=require("node:fs"),c=require("node:crypto"),m=fs.readFileSync("public-manifest.json"),s=JSON.parse(fs.readFileSync("public-manifest-signature.json","utf8")),k=fs.readFileSync("kaelum-bench-public-release-20260718-v1.pem");console.log(c.verify(null,Buffer.concat([Buffer.from("kaelum-bench-fmb-public-release-v1\0"),m]),k,Buffer.from(s.signature_base64,"base64")))'