Skip to content

Add slurm/pbs job submission capability to lake-landice remapping#179

Open
mathomp4 wants to merge 5 commits intofeature/sdrabenh/gcm_v12from
feature/v12-slurm-lakelandice
Open

Add slurm/pbs job submission capability to lake-landice remapping#179
mathomp4 wants to merge 5 commits intofeature/sdrabenh/gcm_v12from
feature/v12-slurm-lakelandice

Conversation

@mathomp4
Copy link
Member

@mathomp4 mathomp4 commented Feb 23, 2026

This brings lake-landice remapping in line with upper_air and catch remapping, allowing it to run in batch queues on both NAS and NCCS.

The weird thing is, @sshakoor1 did this at some point but it got lost? Not sure. But this is Claude trying to bring it back

  • Add job configuration with NPE=1 (serial execution with MPI for MAPL)
  • Set walltime based on tile resolution: 30min for <=C360, 1hr for higher res
  • Create job script template with SLURM/PBS directives matching remap_upper.py
  • Add interactive vs batch mode detection (PBS_JOBID/SLURM_JOB_ID)
  • Refactor command execution to use esma_mpirun wrapper
  • Submit jobs via qsub (NAS) or sbatch (NCCS) when not in interactive session
  • Remove obsolete run_and_log method
  • Maintain backward compatibility: interactive mode behaves as before

This needs to be fully tested and looked over. Probably by me and @weiyuan-jiang and @biljanaorescanin

I'm keeping draft until tested.


ETA: Both @biljanaorescanin and @weiyuan-jiang have tested and we've updated the baselines.

Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

0 diff The changes in this pull request have verified to be zero-diff with the target branch.