Skip to content

Leaderboard submission: XYZ SCIENCE - #196

Open
Imalwayshere wants to merge 2 commits into
liamdugan:mainfrom
Imalwayshere:submission/xyz-science
Open

Imalwayshere wants to merge 2 commits into
liamdugan:mainfrom
Imalwayshere:submission/xyz-science

Conversation

@Imalwayshere

Copy link
Copy Markdown

Submission

Adds the XYZ SCIENCE detector to the RAID leaderboard.

  • Website: https://www.xyzscience.com/
  • Prediction rows: 672,000
  • Prediction SHA-256: b6aa13d119a6dd1e2cff2333a52bc30acc750b8d2ba67f5af568a21c067e51ae
  • Files: metadata.json and predictions.json only

The prediction artifact was frozen before official evaluation and independently validated for exact schema, row count, ID order, ID uniqueness, finite scores, and [0,1] bounds. Hidden test labels were not accessed during model selection or validation.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

XYZ SCIENCE

Release date: 2026-08-31

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.85 and a TPR of 99.64% at FPR=5% and 98.86% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.94 and a TPR of 99.87% at FPR=5% and 99.52% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant