craigtrim / gutenfetchen Star 0 Code Issues Pull requests CLI for downloading Project Gutenberg e-texts - orderly, efficient, and vaguely Teutonic text-processing ebook-downloader project-gutenberg gutendexapi gutendex gutendex-api corpus-building Updated Feb 12, 2026 Python
Crownelius / arxiv-corpus-builder Star 0 Code Issues Pull requests Free pipeline: arxiv OAI-PMH harvest + PDF download + pymupdf4llm convert + push to HuggingFace Hub. Fresh post-2024 corpora in common-pile schema. dataset arxiv oai-pmh huggingface pdf-to-markdown pymupdf4llm corpus-building Updated Apr 28, 2026 Python
kenjihilasak / Align-and-Shine Star 0 Code Issues Pull requests Official repository for the paper *Align and Shine: Building high-quality sentence-aligned corpora for multilingual text simplification*. python nlp research transformers sentence-alignment multilingual-nlp corpus-building Updated Apr 20, 2026 Python
scdenney / corpus-building Star 0 Code Issues Pull requests Turn a folder of PDFs into an analysis-ready text corpus. Wizard + skills + scripts for Claude Code and Codex. text-mining ocr hpc text-analysis digital-humanities leiden-university vision-language-model claude-code corpus-building Updated Apr 26, 2026 JavaScript