Skip to content

feat(tn): split interior apostrophe so possessives normalize (+2) - #72

Merged
Alex-Wengg merged 1 commit into
mainfrom
feat/en-tn-apostrophe-split
Jul 9, 2026
Merged

Alex-Wengg merged 1 commit into
mainfrom
feat/en-tn-apostrophe-split

Conversation

@Alex-Wengg

Copy link
Copy Markdown
Member

Adds the apostrophe to the interior-split set so possessives normalize: 80's -> "eighty's" (the number normalizes, the 's stays attached).

Contractions are unaffected: the glued reconstruction still matches them as whole tokens with no tagger, so don't / they're / I've / I'm stay literal.

en TN punctuation 41->42; punctuation_match_input 5->6. No regressions across any class or language; tests/fmt/clippy green.

🤖 Generated with Claude Code

Add the apostrophe to the interior-split set: "80's" -> "eighty's" (the
number normalizes, the possessive stays attached). Contractions are
unaffected because the glued reconstruction still matches them as whole
tokens with no tagger, so "don't"/"they're"/"I've" stay literal.

en TN punctuation 41->42; punctuation_match_input 5->6. No regressions.
@Alex-Wengg
Alex-Wengg merged commit b8fc7b7 into main Jul 9, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant