ExtractionJob records in terminal states (DONE or FAILED) are currently retained indefinitely. Over time, especially in high-volume deployments, this can result in unbounded database table growth and unnecessary storage consumption.
Introduce a configurable retention policy for completed extraction jobs. Jobs that have remained in a terminal state beyond the configured retention period should be automatically deleted or archived.
The retention period and cleanup mechanism should be configurable to support different deployment and operational requirements.
ExtractionJobrecords in terminal states (DONEorFAILED) are currently retained indefinitely. Over time, especially in high-volume deployments, this can result in unbounded database table growth and unnecessary storage consumption.Introduce a configurable retention policy for completed extraction jobs. Jobs that have remained in a terminal state beyond the configured retention period should be automatically deleted or archived.
The retention period and cleanup mechanism should be configurable to support different deployment and operational requirements.