Skip to content

bench: windowed aggregation benchmarks + scalability tests (1–16 workers) #231

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
milindsrivastava1997 merged 30 commits into from
Apr 6, 2026
+368 −25
Merged

bench: windowed aggregation benchmarks + scalability tests (1–16 workers) #231

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
30151a8
Add standalone precompute engine to replace Arroyo streaming pipeline
zzylol Feb 21, 2026
19c0f84
Wire up DatasketchesKLL in accumulator factory and add E2E test
zzylol Feb 23, 2026
c822c8b
Add 1000-sample batch latency test to E2E precompute test
zzylol Feb 23, 2026
eedc6ce
Add 10M-sample throughput test to E2E precompute test
zzylol Feb 23, 2026
b749ac3
update
zzylol Feb 24, 2026
685655e
Fix sliding window aggregation: feed samples into all overlapping win…
zzylol Feb 24, 2026
8df4927
fix: remove duplicate [[bin]] entries in Cargo.toml from rebase merge
zzylol Mar 31, 2026
3ea0d58
style: apply cargo fmt
zzylol Mar 31, 2026
bf4c213
fix: use std::io::Error::other per clippy lint
zzylol Mar 31, 2026
b7e1b02
fix: remove unnecessary cast per clippy lint
zzylol Mar 31, 2026
7c76d04
Add standalone precompute engine to replace Arroyo streaming pipeline
zzylol Feb 21, 2026
e66e6e9
Wire up DatasketchesKLL in accumulator factory and add E2E test
zzylol Feb 23, 2026
ba79200
Add late data handling for closed windows and precompute engine desig…
zzylol Feb 26, 2026
fc34f14
Minor wording fix in precompute engine design doc
zzylol Feb 26, 2026
10e4161
Clarify single-machine multi-threaded architecture in design doc
zzylol Feb 26, 2026
24ec6ce
Add multi-connector ingest support (Prometheus + VictoriaMetrics)
zzylol Feb 26, 2026
e903783
Run cargo fmt
zzylol Feb 26, 2026
e5b6abc
Add pane-based incremental sliding window computation
zzylol Feb 26, 2026
4ced5ca
Add standalone precompute engine to replace Arroyo streaming pipeline
zzylol Feb 21, 2026
dd1c613
Wire up DatasketchesKLL in accumulator factory and add E2E test
zzylol Feb 23, 2026
be7f231
Add late data handling for closed windows and precompute engine desig…
zzylol Feb 26, 2026
41bd844
Add multi-connector ingest support (Prometheus + VictoriaMetrics)
zzylol Feb 26, 2026
a9aacb0
Add windowed aggregation benchmarks and fix build issues
zzylol Feb 26, 2026
6797dde
Add scalability benchmark varying worker count (1-16)
zzylol Feb 26, 2026
3b3a379
Make throughput test multi-threaded for data generation and sending
zzylol Feb 27, 2026
1648f1e
Increase throughput test drain timeout from 60s to 120s
zzylol Feb 27, 2026
b994e1f
Resolve merge conflicts with main (pane-based sliding windows)
Apr 6, 2026
d0895ce
fix: align test_e2e_precompute with current API signatures
Apr 6, 2026
a84ccd7
fix: add missing value_column arg to AggregationConfig::new
Apr 6, 2026
72ad226
fix: resolve clippy lints in test_e2e_precompute
Apr 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading