The common fields in AIM(Cluster)ServiceTemplate should be extended to support all high-level environment variables of AIMs that affect profile selection:
Existing:
- AIM_METRIC - spec.metric
- AIM_PRECISION - spec.precision
- AIM_GPU_COUNT - spec.gpuSelector.count
- AIM_GPU_MODEL - spec.gpuSelector.model
New:
- AIM_ENGINE -
spec.engine: *string
- AIM_PROFILE_ID -
spec.profileId: *string
- AIM_ALLOW_GENERAL_PROFILE_FALLBACK -
spec.allowGeneralProfileFallback: *boolean
If the fields are unset, they are not added to the AIM container.
The common fields in
AIM(Cluster)ServiceTemplateshould be extended to support all high-level environment variables of AIMs that affect profile selection:Existing:
New:
spec.engine: *stringspec.profileId: *stringspec.allowGeneralProfileFallback: *booleanIf the fields are unset, they are not added to the AIM container.