Skip to content

Add data for Tagalog - #35

Open
ikalchev wants to merge 5 commits into
snowballstem:mainfrom
ikalchev:tagalog-stemmer
Open

Add data for Tagalog#35
ikalchev wants to merge 5 commits into
snowballstem:mainfrom
ikalchev:tagalog-stemmer

Conversation

@ikalchev

@ikalchev ikalchev commented Apr 7, 2026

Copy link
Copy Markdown

This adds data for a tagalog stemmer (See snowballstem/snowball#273). I will submit a PR for the Tagalog stemmer shortly.

Comment thread tagalog/COPYING Outdated
Comment thread tagalog/voc.txt Outdated
@ikalchev

Copy link
Copy Markdown
Author

Thanks for the review, I guess I missed the case folding from the instructions.

@ojwb

ojwb commented May 26, 2026

Copy link
Copy Markdown
Member

I've pushed a commit to address a couple of things:

  • there were 57 duplicate words in voc.txt
  • we've found sorting voc.txt in ascending byte order is best as it gives a sort order which doesn't depend on locale settings, which makes it easier to do ad-hoc scripting, etc

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants