Skip to main content

5.4 Benchmark Governance

Benchmark tasks are stored in benchmarks/v{N}.json. Version signaled via axon.info.description (e.g. "cswon-bench:v1"). Updates require ≥3 validator sign-offs via GitHub PR.

Lifecycle Rules

TriggerActionRationale
>70% miners >0.90 for 3 temposDeprecate taskOverfitted
>70% miners <0.10 for 3 temposQuarantine taskLikely broken
Quarantined unresolved 5 temposRemove from poolPrevents dead weight

Task Status

{
"task_id": "t-0042",
"status": "active",
"quarantine_since_tempo": null,
"deprecation_reason": null
}

Valid values: "active" | "quarantined" | "deprecated". Validators skip tasks with status is not "active".


← Previous5.3 Weight Submission
→ Next5.5 Execution Support Pool
IndexDocumentation Index