Send routed_experts_start_len per turn; merge per-turn deltas positionally - #82

Draft

nightlessbaron wants to merge 36 commits into

prodfrom

feat/routed-experts-delta

Commits on Jul 1, 2026

Add infra-failure/truncation filters; allow zero loss_mask for masked samples

nightlessbaron
and
claude
committed
b98a2bf
Sample tito_session_mismatch instead of computing it on every record fetch

nightlessbaron
and
claude
committed
b0b6638

Commits on Jul 2, 2026

Parse HTTP responses with orjson, stdlib fallback

nightlessbaron
and
claude
committed
db5d476
Log session-server stats heartbeat at debug level

nightlessbaron
and
claude
committed
4d8c7fc
Merge remote-tracking branch 'origin/prod' into feat/validator-allow-removed-zero-mask
nightlessbaron
committed
137eea1
fixes
odp
committed
0bd6425
Merge branch 'pr-66-tracer' into feat/validator-allow-removed-zero-mask
nightlessbaron
committed
3e0be30
add jitter
odp
committed
b7d3698
add _compact_session_record, save on bytes
odp
committed
2943912
24h session-client timeouts; lifecycle/heartbeat logs at INFO
nightlessbaron
committed
082d11a
Merge commit 'refs/pull/66/head' of https://github.com/LLM360/miles into feat/validator-allow-removed-zero-mask
nightlessbaron
committed
247566c

Commits on Jul 3, 2026

concurrency
odp
committed
d71934c
Merge commit 'refs/pull/66/head' of https://github.com/LLM360/miles into feat/validator-allow-removed-zero-mask
nightlessbaron
committed
49a1ed6
add session server actor and distribute
odp
committed
e3112f1
Merge commit 'refs/pull/66/head' of https://github.com/LLM360/miles into feat/validator-allow-removed-zero-mask
nightlessbaron
committed
8796366
Raise connect/write/pool timeouts to 600s; lift collect concurrency cap to 8192
nightlessbaron
committed
4bf33bf
to_thread
odp
committed
17a4d6b
add a threadpool
odp
committed
a86619e
Shallow-copy samples in merge; parse session responses with orjson
nightlessbaron
committed
546ee1d
more to_threads
odp
committed
008cf75
Merge commit 'refs/pull/66/head' of https://github.com/LLM360/miles into feat/validator-allow-removed-zero-mask
nightlessbaron
committed
fb4335d
Shallow-copy input sample per record; only mutable fields get fresh copies
nightlessbaron
committed
5364026
Skip SSL context for plain-http session clients; parse responses off the event loop
nightlessbaron
committed
d4645b2
prefix_cache_info shallow copy
nightlessbaron
committed
c007b6f
skip decoding Sample.response if possible
odp
committed
417e420
Merge latest from miles PR #66
nightlessbaron
committed
25a8010
Tail-cancel on total remaining groups (unsubmitted + in flight), not just in-flight
nightlessbaron
committed
7f01a81
drop comment
nightlessbaron
committed
3ba65ff

Commits on Jul 8, 2026

fix session server port conflict

odp
authored and
nightlessbaron
committed
df8a83f
lower stats logging

odp
authored and
nightlessbaron
committed
ba0e8d8

Commits on Jul 9, 2026

use gzip compression for /sessions/sessonid endpoint

odp
authored and
nightlessbaron
committed
ab0d565
Revert "use gzip compression for /sessions/sessonid endpoint"

odp
authored and
nightlessbaron
committed
de5ad80
session-server-side merge - first shot

odp
authored and
nightlessbaron
committed
a176bed
return sample instead of samples

odp
authored and
nightlessbaron
committed
260f9c5

Commits on Jul 16, 2026

introduce _keep_records_until_first_non_completed in the session server to match previous implementation

odp
authored and
nightlessbaron
committed
74c518c

Commits on Jul 26, 2026

Send routed_experts_start_len per turn; merge per-turn deltas positionally
nightlessbaron
committed
14a7daf