Reduce Rollout Manager Load with Distributed Session Merging - #66

Merged

nightlessbaron merged 16 commits into

prodfrom

better-oai-ep-tracer

Aug 21, 2026

Commits on Aug 21, 2026

fixes

odp
authored and
nightlessbaron
committed
c202574
add jitter

odp
authored and
nightlessbaron
committed
89d12d8
add _compact_session_record, save on bytes

odp
authored and
nightlessbaron
committed
73b66fa
concurrency

odp
authored and
nightlessbaron
committed
3008470
add session server actor and distribute

odp
authored and
nightlessbaron
committed
7376d5a
to_thread

odp
authored and
nightlessbaron
committed
a36ce41
add a threadpool

odp
authored and
nightlessbaron
committed
6d4f08a
more to_threads

odp
authored and
nightlessbaron
committed
25fa7db
skip decoding Sample.response if possible

odp
authored and
nightlessbaron
committed
092cc8c
fix session server port conflict

odp
authored and
nightlessbaron
committed
040f183
lower stats logging

odp
authored and
nightlessbaron
committed
42c00f7
use gzip compression for /sessions/sessonid endpoint

odp
authored and
nightlessbaron
committed
a7f853f
Revert "use gzip compression for /sessions/sessonid endpoint"

odp
authored and
nightlessbaron
committed
e107ac6
session-server-side merge - first shot

odp
authored and
nightlessbaron
committed
b38ac1e
return sample instead of samples

odp
authored and
nightlessbaron
committed
5753757
introduce _keep_records_until_first_non_completed in the session server to match previous implementation

odp
authored and
nightlessbaron
committed
924470a