Hi CueCrux team,
We've been working through the ScoreCrux benchmarks and have completed both practice-info-101 and practice-safety-101 runs (bare + Engram memory arms). We'd like to participate in the Delta benchmark next.
What we've tried
GET /api/fixtures/delta → 404
GET /api/fixtures → only lists practice-info-101
- Searched CueCrux org repos (ScoreCrux, Crux, EmbedderCrux, ResearchCrux, TestCrux) — no corpus data found
- AuditCrux repo (referenced in how-to-run docs) returns 404
What we're trying to do
Run the Delta benchmark (3,346 documents, 2M tokens, 25 architectural decisions + 5 needle facts) with two arms:
- Bare baseline (C0) — no memory system
- Engram arm — local MCP memory server, ingest corpus via
memory_store_batch, answer via memory_recall
Questions
- How do we get access to the Delta fixture and corpus?
- Is there an alpha/beta access program, or a fixture ID we should use?
- Is AuditCrux the right harness for the C0/F1 arms, and if so, is it available?
Submitter: Peter Simmons
Practice runs completed: practice-info-101 and practice-safety-101 (both bare + Engram arms)
Thanks
Hi CueCrux team,
We've been working through the ScoreCrux benchmarks and have completed both
practice-info-101andpractice-safety-101runs (bare + Engram memory arms). We'd like to participate in the Delta benchmark next.What we've tried
GET /api/fixtures/delta→ 404GET /api/fixtures→ only listspractice-info-101What we're trying to do
Run the Delta benchmark (3,346 documents, 2M tokens, 25 architectural decisions + 5 needle facts) with two arms:
memory_store_batch, answer viamemory_recallQuestions
Submitter: Peter Simmons
Practice runs completed:
practice-info-101andpractice-safety-101(both bare + Engram arms)Thanks