Add note about configuring executor for HPC (e.g. SLURM) #119
Description
Description:
When running the pipeline on an HPC cluster with a job scheduler, users need to explicitly set the executor in their configuration. For example, for SLURM:
process.executor = ‘slurm’
Currently, this requirement is not clearly documented.
Suggestion:
Add a note in the documentation (e.g. in the Running the pipeline section) stating that users should include the appropriate executor setting in their profile configuration when running on a scheduler-based system.
For example:
If running on an HPC cluster (e.g. SLURM), make sure to set the executor in your profile:
process.executor = ‘slurm’
This will help avoid confusion for users attempting to run the pipeline outside of local execution environments.