5.4 Benchmark Governance
Benchmark tasks are stored in benchmarks/v{N}.json. Version signaled via axon.info.description (e.g. "cswon-bench:v1"). Updates require ≥3 validator sign-offs via GitHub PR.
Lifecycle Rules
| Trigger | Action | Rationale |
|---|---|---|
| >70% miners >0.90 for 3 tempos | Deprecate task | Overfitted |
| >70% miners <0.10 for 3 tempos | Quarantine task | Likely broken |
| Quarantined unresolved 5 tempos | Remove from pool | Prevents dead weight |
Task Status
{
"task_id": "t-0042",
"status": "active",
"quarantine_since_tempo": null,
"deprecation_reason": null
}
Valid values: "active" | "quarantined" | "deprecated". Validators skip tasks with status is not "active".
Navigation
| ← Previous | 5.3 Weight Submission |
| → Next | 5.5 Execution Support Pool |
| Index | Documentation Index |