Add Arabic language pack (ara) — proclitic tokenization + orthographic normalization - #21

Merged

bsesic merged 8 commits into

feature/arabic-language-pack

Jul 1, 2026

Commits on Jun 24, 2026

docs(spec): Arabic language pack (ara) v0.1.0 design
bsesic
committed
1b65f11
docs(plan): Arabic language pack (ara) implementation plan
bsesic
committed
82c9ce3

Commits on Jun 25, 2026

feat(model): add DIACRITICS_STRIPPED and ORTHOGRAPHIC_VARIANT reasons
bsesic
committed
831bef9
feat(lang/arabic): tashkil strip and orthographic skeleton folding
bsesic
committed
0f912de
feat(lang/arabic): conservative proclitic splitting
bsesic
committed
31d3f65
feat(lang/arabic): tiered scoring predicates
bsesic
committed
d85e62e
feat(lang/arabic): ArabicLanguagePack and registration
bsesic
committed
2411ec3
test(lang/arabic): cover لل short-guard and كال proclitic+article; comment length guards
bsesic
committed
761e079