Ground up rewrite of datasmith. - #12

Merged

atharvas merged 99 commits into

mainfrom

Apr 8, 2026

Commits on Mar 9, 2026

save
atharvas
committed
59ce0dc
Remove old core/ infrastructure module
atharvas
committed
59463a8
Remove old execution/ module
atharvas
committed
52abb16
Replace scrape/ with github/ module
atharvas
committed
cb7a0a3
Rewrite agents/ module
atharvas
committed
ca32c0d
Rewrite docker/ module
atharvas
committed
bfa1f8b
Add utils/ package
atharvas
committed
7bf2a86
Add publish/ module
atharvas
committed
1cd6d0c
Add runners/ module
atharvas
committed
dcf2f44
Add update/ module and preflight
atharvas
committed
0c83ac2
Add integration tests and test infrastructure
atharvas
committed
fa4c6f8
Add Supabase migration and migration script
atharvas
committed
724251a
Update package config, README, and .gitignore
atharvas
committed
ec2d780
Update scratch configs and notebooks
atharvas
committed
b99936f
Update documentation
atharvas
committed
a07e106
Update formulacode_verified verification results
atharvas
committed
35f4a5f
Update formulacode_verified_new verification results
atharvas
committed
2be282d
Update dataset task lists and verification tooling
atharvas
committed
4dd5d4c
Fix lint issues in github/ module
atharvas
committed
82bc24e
Add GitHub integration, filters, update pipeline improvements, dataset tasks, and scripts
atharvas
committed
5fe83f3

Commits on Mar 21, 2026

Commits on Mar 22, 2026

Update CLAUDE.md with ds-update CLI and revised pipeline stages
atharvas
committed
5822139
Add terminal-bench evaluation variable defaults to run-tests.sh
atharvas
committed
e04ce2e
Refactor sandbox container execution with host-side timeouts
atharvas
committed
77ab7c5
Add resolve_packages as pipeline stage 4
atharvas
committed
d3c1967
Update design docs to reference resolution module and packages table
atharvas
committed
b4ae593
Add gte/lte/neq filter support to fetch_all
atharvas
committed
c1232bd
Extract run_agent_subprocess with process-group cleanup
atharvas
committed
a23c64c
Add pull=never to verifier container runs
atharvas
committed
893b233
Add GraphQL paginate_merged_prs to GitHubClient
atharvas
committed
6871473
Add cancellation handling to BaseRunner
atharvas
committed
57f4611
Switch scrape_commits to GraphQL with idempotency and text sanitization
atharvas
committed
2a60f38
Add build/push and prerequisite image handling to synthesize runner
atharvas
committed
39e6b84
Use fetch_all in records_from_supabase
atharvas
committed
c05a651
Add tasks_per_repo flag and use fetch_all in pipeline
atharvas
committed
28574d4
Handle KeyboardInterrupt in container timeout cleanup
atharvas
committed
102db06
Add resolution module for dependency resolution
atharvas
committed
7365c20
Add resolve_packages runner
atharvas
committed
4aed495
Archive old source modules
atharvas
committed
a2d9c7d
Add scratch scripts for prefill and smoke testing
atharvas
committed
7020766
Add packages table migration and query snippets
atharvas
committed
7df5a6e
Add package.json for node dependencies
atharvas
committed
29ade8f
Accept JSON array format for env_payload in docker_build_env.sh
atharvas
committed
0f4e09d
Fill all missing shell scripts from templates in Docker build context
atharvas
committed
7ec5b6d

Commits on Mar 23, 2026

Commits on Mar 29, 2026

Commits on Apr 4, 2026

Add error_logs table migration for synthesis attempt tracking
atharvas
committed
d64e4e2
Add stage 6 failure analysis doc
atharvas
committed
d3add39
Document Supabase tables, migrations, and connection details
atharvas
committed
2acfeab
Update AGENTS.md for current project structure
atharvas
committed
e6f133b
Add NoneAgent, set model defaults for claude/codex/gemini agents
atharvas
committed
5448e42
Synthesizer: add similar-context reuse with temporal ordering
atharvas
committed
16f67d1
Sandbox verify: expand resource tracking and failure reporting
atharvas
committed
e66b77d
Normalize owner/repo to lowercase in repo image names
atharvas
committed
a584a8e
Pipeline: add none agent, random sampling for tasks-per-repo cap
atharvas
committed
3cc6900
Tests: expand synthesizer and agent test coverage
atharvas
committed
089e78a
Add resource_metrics columns to docker_contexts and error_logs
atharvas
committed
6ab1856
Propagate resource_metrics from sandbox verify through synthesizer
atharvas
committed
46cd0e1
Tests: cover resource_metrics extraction and propagation
atharvas
committed
111f348

Commits on Apr 8, 2026

Remove unused supabase snippet
atharvas
committed
022da67
Rename docker_contexts table to candidate_containers
atharvas
committed
6979d4d
Rename pr_contexts table to candidate_prs
atharvas
committed
fa75e30
Fix stale stage numbers and extract flag in tests
atharvas
committed
6fb7ead
Merge origin/main into rewrite (resolving all conflicts in favor of rewrite)
atharvas
committed
9cd5e72
Allow unsafe YAML tags in pre-commit check
atharvas
committed
484ca9a
Add website snippet tests
atharvas
committed
31b673a
Add GitHub Pages deploy workflow
atharvas
committed
8785147
Update .gitignore for site, scratch, and temp files
atharvas
committed
6b62db5
Fix mypy errors: exclude docker templates, fix Supabase typing, add missing stubs
atharvas
committed
35367b6
Fix deptry: remove unused deps, add json5/tomli, configure exclusions
atharvas
committed
5327e0a