Docs
Contribute
Anyone can contribute task specifications to InfraBench: instruction text, environment definition, and a verifier. You do not need the closed Syscraft runtime to author a useful task package.
Authoritative layout notes also live in the repository CONTRIBUTING.md.
What you can contribute
- New tasks under
tasks/that match the package layout - Improvements to existing public task docs and verifiers
- Clarifications to AGENTS.md / CONTRIBUTING for other authors
What you cannot run yet in public: the full evaluation harness that scores agents on bare metal. Focus on spec quality — clear instructions, honest verifiers, reproducible environments.
Start here
- Read the Introduction for scoring philosophy and layers.
- Clone XuanmiaoG/InfraBench.
- Open
tasks/hello-world— smallest Docker example. - Study a paper task at the layer you care about under
tasks/. - Follow Submit a task for layout,
task.toml, and the PR checklist.
Coding agents
If you are an agent authoring a task, also read AGENTS.md in the repository.
Questions
Open an issue on XuanmiaoG/InfraBench, or contact the authors listed in the HotInfra '26 paper.
Source: CONTRIBUTING.md · Docs home · Contribute. How to contribute task packages while the evaluation runtime stays closed.