Skip to content

Release 0.6 - #296

Open
rlskoeser wants to merge 108 commits into
mainfrom
release/0.6
Open

rlskoeser wants to merge 108 commits into
mainfrom
release/0.6

Conversation

@rlskoeser

@rlskoeser rlskoeser commented Sep 18, 2026

Copy link
Copy Markdown
Collaborator

Summary

Release 0.6 includes improvements to corpus preparation, page alignment, OCR/image handling, metadata refinement, and poetry-detection evaluation.

Included

  • Page-level F1-score evaluation updates
  • HathiTrust page/image alignment and image dataset preparation
  • Dataset preparation and metadata refinement utilities
  • OCR preservation and source-specific processing improvements
  • Updated tests, notebooks, scripts, and release documentation
  • Version bump to 0.6.0

Release checklist notes

  • Test suite: 358 passed
  • Coverage: 94% overall; 100% for tests, meeting the configured 75% project threshold
  • No Django migrations or deploy notes: this is not a Django app
  • No npm frontend
  • passim remains a direct Git dependency and should be reviewed before release

Please review the draft changelog and dependency note before merging.

🤖 generated by Delta:GPT-Luna-5.6

created with preliminary version of release-prep skill based on software release checklist


TODOs

  • clean up review notebooks - reorganize/rename, remove user-specific paths

rlskoeser and others added 30 commits May 12, 2026 12:16
* Added F1 score, updated edge cases.
Assisted-by: Zed:claude-sonnet-4-6
Assisted-by: Zed:claude-sonnet-4-6
Assisted-by: ClaudeCode:claude-sonnet-4-6
Assisted-by: Zed:claude-sonnet-4-6
Assisted-by: Zed:claude-sonnet-4-6
per review from ClaudeCode:claude-sonnet-4-6
Assisted-by: ClaudeCode:claude-opus-4.7
Assisted-by: ClaudeCode:claude-opus-4.7
Assisted-by: ClaudeCode:claude-opus-4.7
Assisted-by: ClaudeCode:claude-opus-4.7
rlskoeser and others added 27 commits September 9, 2026 14:27
Assisted-by: OpenCode:BigPickle (glm-5.1)
Assisted-by: OpenCode:BigPickle (glm-5.1)
Assisted-by: OpenCode:BigPickle (glm-5.1)
Assisted-by: OpenCode:claude-opus-4.8
Use new ocr & preserve old when the text differs
- handle mismatch in page id leading zeros by always joining on numeric
- don't report average text match if none was calculated
- don't trust high match scores; always check next best score
Match pages on numeric page id; don't trust high match scores
- keep original values when refined data does not have the record
- handle nulls when counting changes
- guard against ambiguous author lookup
- document that json is known to match csv data

Assisted-by: OpenCode:BigPickle (glm-5.1)
Assisted-by: OpenCode:BigPickle (glm-5.1)
Assisted-by: Delta:GPT-Luna-5.6
@codecov

codecov Bot commented Sep 18, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 99.61612% with 2 lines in your changes missing coverage. Please review.
✅ Project coverage is 85.55%. Comparing base (27f5f45) to head (ae67ae3).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #296      +/-   ##
==========================================
+ Coverage   82.18%   85.55%   +3.36%     
==========================================
  Files          23       25       +2     
  Lines        2156     2672     +516     
==========================================
+ Hits         1772     2286     +514     
- Misses        384      386       +2     
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants