SparkApplication CRD improvements #659
Description
Rework the SparkApplication CRD to enable making use of features we currently can't.
Examples:
- Spark application monitoring
- Run apps with "mode: client". In this mode, the driver runs on the same Pod as Job but it requires a headless service where the executors can connect back to the driver. Currently we cannot create this service because we don't know the name of the driver pod since this one is created by spark-submit and we have little control over it.
Metadata
Metadata
Assignees
Labels
No labels