Skip to main content

Contributing to BrittleBench

Current Status: Protocol Phase — Not Accepting External Contributions​

BrittleBench is currently in the pre-lock protocol review phase (Phase R9). The research protocol (PROTOCOL.md) is not yet locked, and no confirmatory execution-phase code or data exists.

We are not accepting external contributions at this time. This is deliberate: a solo-researcher pre-registration study requires that the methodology be developed independently before external input could introduce bias. Opening contributions before the protocol is locked would compromise the study's credibility.

When Contributions Will Be Welcome​

Once Phase E (execution) begins — that is, once PROTOCOL.md Section 9.1 reads LOCKED — contributions will be welcome in the following areas:

  • Corpus gaps: If you know of public detection rule repositories not represented in the corpus, open an issue.
  • Evaluator bugs: If you find a bug in the evaluation tooling that causes false positives or false negatives in the robustness scoring, open an issue with a minimal reproduction.
  • Tooling improvements: Performance, portability, or usability improvements to the scoring toolkit via pull request.
  • Dataset feedback: After the public dataset release, feedback on labeling errors or missing metadata via issue.

Contributions related to methodology or hypothesis framing will not be accepted after the protocol is locked — those decisions are pre-registered and cannot change without a logged CHANGELOG.md entry and justification.

Code of Conduct​

All contributors and community members are expected to follow our Code of Conduct.

Contact​

For questions about the project before contributions open, contact the author via GitHub (@anpa1200) or at 1200km@gmail.com.