Skip to content

Batching enhancements multiplexed server - #2170

Closed
lbluque wants to merge 26 commits into
mainfrom
batching-enhancements-multiplex
Closed

lbluque wants to merge 26 commits into
mainfrom
batching-enhancements-multiplex

Conversation

@lbluque

@lbluque lbluque commented Aug 19, 2026

Copy link
Copy Markdown
Contributor

No description provided.

lbluque and others added 26 commits January 26, 2026 19:14
- Replace _batch_serve.py with batch_server.py (matches main's rename)
- Move AutobatchConfig, AutobatchResult, and probe_optimal_batch_size
  into batch_server.py
- Add _PredictWorker and MLIPWorkerPredictUnit to predict.py
  (appended after main's BatchServerPredictUnit)
- Restore ProcessPoolExecutor and RayActorPoolExecutor backends
  in _batch.py alongside main's new features (uuid deployment names,
  autoscaling_config, update_checkpoint, delete, shutdown_ray)
- Adapt tests to main's fixture pattern (ray_session, ray_controlled)
  while preserving branch's backend and autobatch tests
# Conflicts:
#	src/fairchem/core/calculate/__init__.py
#	src/fairchem/core/calculate/_batch.py
#	src/fairchem/core/calculate/_batch_server.py
#	src/fairchem/core/components/batch_server.py
#	src/fairchem/core/units/mlip_unit/batch_server.py
#	tests/core/units/mlip_unit/test_inference_serve.py
#	tests/core/units/mlip_unit/test_predict.py
@meta-cla meta-cla Bot added the cla signed label Aug 19, 2026
@lbluque lbluque closed this Aug 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant