Skip to content

Add synthetic regression cases with validation commands (closes #3) - #31

Open
Misterio070 wants to merge 2 commits into
zxyasfas:mainfrom
Misterio070:fix/regression-manifest
Open

Misterio070 wants to merge 2 commits into
zxyasfas:mainfrom
Misterio070:fix/regression-manifest

Conversation

@Misterio070

Copy link
Copy Markdown

Summary

Expand docs/regression_manifest.sample.json with 3 new synthetic cases that document expected outputs and validation commands.

Changes

  • Added minimal_paper_case (min_score 50, with validation_command)
  • Added strict_sections_case (strict_required_sections=True, with validation_command)
  • Added no_engine_case (engine=none, with expected_output)

Each case includes a validation_command showing exactly how to run and verify the expected output.

Closes #3

- Translate Chinese headers to English for broader accessibility
- Add explanatory subheader guiding users to penalties and diagnostics
- Clarify section titles: 'What Failed', 'What to Fix Next', 'Feature Details'
- Scoring semantics unchanged

Closes zxyasfas#5

Signed-off-by: alextaghiashvili <alextaghiashvili@gmail.com>
…ommands (closes zxyasfas#3)

Signed-off-by: alextaghiashvili <alextaghiashvili@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Good first PR: add examples to the regression manifest

1 participant