Skip to content

feat(ray-jobs): support runtime environment extensions - #69

Merged
jiangxt2 merged 1 commit into
masterfrom
feat/ray-job-runtime-env-extensions
Aug 20, 2026
Merged

feat(ray-jobs): support runtime environment extensions#69
jiangxt2 merged 1 commit into
masterfrom
feat/ray-job-runtime-env-extensions

Conversation

@jiangxt2

Copy link
Copy Markdown
Owner

Description

This PR adds two explicit, workload-neutral runtime-environment extension inputs to the public Alpha submit_ray_job() helper and the shared build_runtime_env() builder. These inputs are trusted deployment configuration and must not come from broker task payloads. They allow callers to append execution-driver modules after the Tributo Core package and supply an explicit pip package list without scanning the submitting host or discovering provider installations.

The default runtime environment remains unchanged. extra_py_modules preserves caller order after the Core package, while runtime_pip_packages creates Ray's pip field only when non-empty and fails fast when an algorithm artifact owns dependency distribution. Submission identity, reserved identity environment variables, request-digest metadata, ambiguous reconciliation, resource arguments, RayJobSubmission, and BROKER_API_VERSION remain unchanged.

The Broker boundary ADR documents that this is a generic Ray Jobs deployment mechanism rather than a Broker API capability. No Redis or provider dependency, protocol, consume loop, or operation mapping is added to Core.

Related issues

None.

Additional information

  • uv run --locked --no-sync python scripts/pr-precheck.py passed after rebasing onto master@bc40056, including format, lint, mypy, dependency and API checks, Python 3.12/3.13 CI parity, changed tests, DCO validation, and documentation gates.
  • The changed tests cover default compatibility, extension ordering, explicit pip forwarding, algorithm-artifact ownership conflicts, host-environment isolation, log redaction, Ray submission identity, request-digest metadata, and resource forwarding.
  • Docker-based Provider integration tests are outside this Core-only PR because broker transport and Provider healthy paths remain owned by the Provider repository.
  • This PR does not change package dependencies or the package version.

Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>
@jiangxt2
jiangxt2 marked this pull request as ready for review August 20, 2026 08:47
@jiangxt2
jiangxt2 merged commit 31d790d into master Aug 20, 2026
14 checks passed
@jiangxt2
jiangxt2 deleted the feat/ray-job-runtime-env-extensions branch August 20, 2026 08:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant