feat: standalone precompute engine replacing Arroyo streaming pipeline#228

Merged

milindsrivastava1997 merged 12 commits intomainfrom

pr/A-precompute-engine-core

Mar 31, 2026

Commits on Mar 28, 2026

Add standalone precompute engine to replace Arroyo streaming pipeline

zzylol
and
claude
committed
Restore standalone precompute engine binary with fixed imports

zzylol
and
claude
committed
Wire up DatasketchesKLL in accumulator factory and add E2E test

zzylol
and
claude
committed
Add raw-only mode to PrecomputeEngine that skips aggregation

zzylol
and
claude
committed
Add debug-level tracing spans for e2e latency measurement in precompute engine

zzylol
and
claude
committed
fix: add precompute_engine and test_e2e_precompute bin stubs to Dockerfile dependency cache layer

zzylol
and
claude
committed
fix: resolve build errors in precompute engine (E0432, E0609, E0061) and apply fmt

zzylol
and
claude
committed
fix: use CountMinSketch.update() instead of direct matrix access

zzylol
and
claude
committed
fix: resolve clippy and unused-import warnings in precompute engine

zzylol
and
claude
committed
fix: replace useless vec! macros with arrays in test_e2e_precompute

zzylol
and
claude
committed

Commits on Mar 30, 2026

Add precompute engine design doc
zzylol
committed

Commits on Mar 31, 2026

docs: add ArroyoSketch comparison to precompute engine design doc

zzylol
and
claude
committed