Project Setup & Initial Roadmap

[tim-dickey]

Summary

Initial scaffold committed (core duplicate finder, CLI, tests, placeholder docs).

Next Actions

• Replace placeholder design docs with actual content
• Add performance profiling (baseline run on sample corpus)
• Implement multiprocessing for large directory scans
• Add ignore pattern support (e.g., licenses, generated files)
• Add JSON schema documentation for output
• Create benchmark dataset (varied near-duplicate levels)

Acceptance Criteria

• Design docs populated
• CLI documented with examples in README
• Profiling report included in docs
• Parallel scan option behind --workers flag

Notes

Feel free to edit / reprioritize. Open follow-up issues per item.

[tim-dickey]

Completed items:

• Parallel scan option implemented (--workers)
• Benchmark harness added (benchmarks/run_benchmarks.py + docs)
• Design, roadmap, and best practices docs populated
• README updated with parallel + benchmark usage

Remaining from issue:

• Profiling report (can derive from benchmarks; consider adding persistent report artifact)
• Ignore pattern support
• JSON schema documentation (currently implicit; can formalize)
• Multiprocessing for pairwise comparison (future phase)

Let me know if you want separate issues split out.