feat(abbr)!: V2 single-pass abbreviation engine + tech-debt paydown (major, breaking) - #78

Merged

yisding merged 71 commits into

mainfrom

feat/v2-abbreviation-engine

Jun 18, 2026

Commits on Jun 14, 2026

docs: RFC for a single-pass period-classifier abbreviation engine
claude
committed
bc073f0
test(v2): add Phase-0 acceptance harness for the abbreviation engine

yisding
and
claude
committed
9e33936
feat(abbr): add V2 PeriodClassifier for English (en/en_legal opt-in)

yisding
and
claude
committed
8c536bf
feat(abbr): enable V2 PeriodClassifier for spanish

yisding
and
claude
committed
68fe7af
feat(abbr): enable V2 PeriodClassifier for danish

yisding
and
claude
committed
acd71ce
feat(abbr): enable V2 PeriodClassifier for greek

yisding
and
claude
committed
04b7ab4
feat(abbr): enable V2 PeriodClassifier for dutch

yisding
and
claude
committed
89db41c
feat(abbr): enable V2 PeriodClassifier for italian

yisding
and
claude
committed
24766ee
feat(abbr): enable V2 PeriodClassifier for french

yisding
and
claude
committed
e3f4a67
feat(abbr): enable V2 PeriodClassifier for polish

yisding
and
claude
committed
568eb2b
feat(abbr): enable V2 PeriodClassifier for hindi

yisding
and
claude
committed
cb85c27
feat(marathi): route abbreviation protection through V2 PeriodClassifier

yisding
and
claude
committed
0d6e41a
feat(abbr): enable V2 PeriodClassifier for tagalog

yisding
and
claude
committed
a611e1f
feat(abbr): enable V2 PeriodClassifier for armenian

yisding
and
claude
committed
4d909bb
feat(abbr): enable V2 PeriodClassifier for amharic

yisding
and
claude
committed
da8f0c4
feat(abbr): enable V2 PeriodClassifier for burmese

yisding
and
claude
committed
5292cf4
feat(abbr): enable V2 PeriodClassifier for urdu

yisding
and
claude
committed
caa1ac0
feat(abbr): enable V2 PeriodClassifier for en_es_zh

yisding
and
claude
committed
c06eb52
feat(abbr): enable V2 PeriodClassifier for deutsch

yisding
and
claude
committed
7fa4a5f
feat(abbr): enable V2 PeriodClassifier for russian

yisding
and
claude
committed
2df83b7
feat(abbr): enable V2 PeriodClassifier for slovak

yisding
and
claude
committed
4df2fc7
feat(abbr): enable V2 PeriodClassifier for bulgarian

yisding
and
claude
committed
2d210b4
feat(abbr): enable V2 PeriodClassifier for arabic and persian

yisding
and
claude
committed
07aa34b
feat(abbr): enable V2 PeriodClassifier for chinese

yisding
and
claude
committed
3d0180b
feat(abbr): enable V2 PeriodClassifier for japanese

yisding
and
claude
committed
c64d7ca
feat(abbr): enable V2 PeriodClassifier for kazakh

yisding
and
claude
committed
4383e77
docs: V2 abbreviation engine implementation report

yisding
and
claude
committed
c8dcb10
refactor(abbr): retire dead legacy abbreviation engine; classifier is sole path

yisding
and
claude
committed
6412023
perf(abbr): cache PeriodClassifier per (policy, split_mode); single-pass classify+suffix

yisding
and
claude
committed
993ff6f
fix(abbr): join titled-name prefixes and spelled-out a.m./p.m. timezone units

yisding
and
claude
committed
13a5661
docs(v2): finishing-pass report — legacy retired, perf reclaimed, 3 targets fixed

yisding
and
claude
committed
8b7daed
docs(v2): append independently-audited verification (perf +2.5%, net LOC +989)

yisding
and
claude
committed
352f37c
test(v2): add 26-language segment() baseline snapshot + diff helper

yisding
and
claude
committed
42e175c
fix(abbr): strip trailing dot from ar/pl/sk single-token abbreviations

yisding
and
claude
committed
fd37a27
refactor(kk): strip trailing dot from Kazakh abbreviations; retire whole-text pass

yisding
and
claude
committed
de7677f
test(abbr): guard against single-token abbreviations stored with a trailing dot

yisding
and
claude
committed
00df7a7
refactor(abbr): drop dead _classify_number wrapper from PeriodClassifier

yisding
and
claude
committed
c0249cb
docs(abbr): V2 abbreviation data + dead-code cleanup report

yisding
and
claude
committed
1861e13
test(abbr): regression-test the dot-normalization behavior changes

yisding
and
claude
committed
1cef46d
refactor(abbr): add shared _cjk_regular_only_policy factory; dedupe zh/ja policies

yisding
and
claude
committed
9873669
refactor(abbr): co-locate language-specific AbbrPolicies into their lang modules

yisding
and
claude
committed
3c577c4
docs: prioritized v2 refactor roadmap (post-abbreviation-engine)

yisding
and
claude
committed
82a3cc5
test(v2): wire the 26-language segment snapshot into CI

yisding
and
claude
committed
baa65a0
refactor(lang): promote shared whole-span abbr policy to lang/common

yisding
and
claude
committed
de63148
test(corpus-en): guard empty-param xfail skip with skipif on xfail_cases()

yisding
and
claude
committed
608b47d
feat(api): export public exceptions and registry funcs at top level

yisding
and
claude
committed
71bfded
test(xfail): index the six standing xfails with stable BACKLOG reasons

yisding
and
claude
committed
7e299cc
test(v2): retire the frozen-against-deleted-code v2 oracle

yisding
and
claude
committed
3c5979f
refactor(processor): fold the static self.lang.* rule hooks into LanguageProfile

yisding
and
claude
committed
a8ae56c
test(abbr): behavioral data-lint (quarantined) + canonical abbreviation lists

yisding
and
claude
committed
fb32833
refactor(abbr): own the downstream post-period pipeline in AbbrPolicy.post_stages

yisding
and
claude
committed
89399fe
test: add dedicated processor / period_classifier unit suites (T4)

yisding
and
claude
committed
652ec5c
fix(abbr): recognise non-ASCII multi-period abbreviations (S6)

yisding
and
claude
committed
4067267
feat(api)!: make spans canonical and unify the lookahead result shape (S7+S8)

yisding
and
claude
committed
d93816d

Commits on Jun 15, 2026

refactor: extract boundary_resplit module out of processor.py (S3)

yisding
and
claude
committed
052b7fb
refactor: extract shared normalization helper into _normalize (S9)

yisding
and
claude
committed
208b98a
docs: clarify spaCy entry point contract status (S-decide)

yisding
and
claude
committed
609574f
refactor(kk): express Kazakh WIDE-follower stems as a policy field (S10)

yisding
and
claude
committed
9a490e5
test(properties): add core segment() property tests (no-crash/idempotence/monotonicity) — quarantined (T3)

yisding
and
claude
committed
91dcf13
test(lang): standardize per-language SBD tests on the assert_segments helper

yisding
and
claude
committed
df8a905
docs: V2 tech-debt paydown release-readiness report

yisding
and
claude
committed
04ed7f3
bench(codspeed): track the v2-relevant paths (abbreviation-dense + segment_spans)

yisding
and
claude
committed
d2c204f
docs: drop the stale next-release version hint from CLAUDE.md

yisding
and
claude
committed
2024134

Commits on Jun 17, 2026

fixes
yisding
committed
e4d77ff
fix(abbr): decide en_legal starter-aware boundaries per occurrence

yisding
and
claude
committed
0ba4cf0
refactor(abbr): unify abbreviation-span math and make Kazakh multi-period regex sentinel-aware

yisding
and
claude
committed
c1d90c7
Merge remote-tracking branch 'origin/main' into feat/v2-abbreviation-engine
yisding
committed
d074e76
remove analysis folder
yisding
committed
21d4d41
chore: relocate tests to functional homes; drop v2/analysis references

yisding
and
claude
committed
13cb75f

Commits on Jun 18, 2026

test: reorganize suite into role-based dirs and prune redundant cases

yisding
and
claude
committed
f4e8e7e
Merge pull request #79 from yisding/test/suite-reorg-and-prune
yisding
authored
ca0bded