Kaelum Bench v0.2 · Public Calibration

gpt-5.6-terra

HGB Reporting · Run evidence

Provisional · Deterministic

Run identity

Model and configuration

Model display name
gpt-5.6-terra
Exact model ID
openai/gpt-5.6-terra
Provider
Azure
Exact provider route
openrouter/azure
Runtime ID
openrouter-tool-free-non-streaming-v8
Runtime version
v8
Reasoning profile
reasoning-max-supported
Reasoning configuration
reasoning-max-supported
Tool access
None
Suite
HGB Reporting
Validity
Provisional
Material configuration parameters
allow_fallbacks
false
data_collection
deny
max_attempts_per_task
1
max_concurrency
1
max_generation_metadata_lookups
1
max_output_tokens
34000
max_raw_response_bytes
16777216
max_request_bytes
1048576
metadata_timeout_seconds
60
request_timeout_seconds
300
require_parameters
true
temperature
0
zdr
true

Published score

Scoring evidence

Score
541.4 / 600
Percentage
90.2%
Scoring method
Deterministic
Comparison protocol
Configuration-specific
Tested-model cost
$0.2722
Judge cost
Not applicable
Total cost
$0.2722

Usage

Tokens and execution

Input tokens (tested model)
62,330
Output tokens (tested model)
7,757
Total tokens (tested model)
70,087
Attempted tasks
60 / 60
Valid responses
60 / 60
Invalid JSON
0
Schema failures
0
Provider failures
0
Missing responses
0

Judge evidence

Independent assessment

Not applicable. This suite uses deterministic scoring and requires no judge.

Release provenance

Versioned run evidence

Benchmark ID
FMB-KNOW-ACC-HGB-02
Benchmark version
0.2.0-dev
Scorer ID
fmb-live-scorer-v1
Configuration key
config-54a2e93b7cf6e70137f22d9bc1b8c2c39daeab2620882c5a7031379e0bd72c74
Campaign ID
29c50c3d-c8b8-468c-8934-3a206d2821cc
Comparison group ID
hgb-reporting-0.2.0-dev-configuration-specific-v1
Started at
Completed at
Run ID
947992ce-3600-5e5a-8922-6add618ab79e
Signed release ID
82d3a8e7-8cba-42c0-a30c-8cf7e38256aa
Release ID
270cba25-4425-4bfb-8093-444375154f97
Manifest SHA-256
9ab99f80b28a563261bee157633d3e7777d6a8c9249ac423c81e7f51fa27e6b2
Source aggregate
fmb-live-runs-hgb.json
Source aggregate SHA-256
c7cbac7915c3f7d427966f215ed7aa056a96111b87a8eb4eea5a440d0e6de448
Source aggregate bytes
11,470

Authenticated publication

Signed release evidence

The sanitized single-run JSON is a derived projection and is not separately signed. The Ed25519 signature authenticates the exact public manifest bytes, including the release inventory. The manifest in turn binds this run's source aggregate by its SHA-256 digest and byte size.

Verify this evidence
  1. Verify the detached Ed25519 signature over the domain-prefixed exact manifest bytes using the published public key.
  2. Confirm that the sidecar payload SHA-256 equals the manifest SHA-256 shown above.
  3. Hash the source aggregate and compare its SHA-256 and byte size with the signed manifest entry.
  4. Resolve this run ID through the public run index and match its campaign ID inside that aggregate.
node -e 'const fs=require("node:fs"),c=require("node:crypto"),m=fs.readFileSync("public-manifest.json"),s=JSON.parse(fs.readFileSync("public-manifest-signature.json","utf8")),k=fs.readFileSync("kaelum-bench-public-release-20260718-v1.pem");console.log(c.verify(null,Buffer.concat([Buffer.from("kaelum-bench-fmb-public-release-v1\0"),m]),k,Buffer.from(s.signature_base64,"base64")))'