Repository navigation
Update geopandas and cluster environment variables for RHEL9 on kestrel - #259
Conversation
cavraam
left a comment
There was a problem hiding this comment.
The PR looks great, thank you for the prompt response here @patrickbrown4!
Approved, provided that pending runs complete; very minor comments/questions attached.
I wonder if the runs will reveal additional minor edits related to reporting (I don't think we have hpc-related scripts for reporting though...)
| import copy_rev_folders | ||
| from pathlib import Path | ||
| from collections import OrderedDict | ||
| sys.path.append(str(Path(__file__).parent.parent)) |
There was a problem hiding this comment.
curious why we might need this...
There was a problem hiding this comment.
Until we address #4 we have to add the parent of the reeds module folder to the path so it can be imported locally. We didn't use the reeds module in this script before, but now we need it for reeds.slurm.check_slurm() below.
There was a problem hiding this comment.
Great to have this defined in only one spot and call if needed
Summary
Kestrel has updated from Red Hat Enterprise Linux 8 (RHEL8) to RHEL9; details are available at https://natlabrockies.github.io/HPC/RHEL9_upgrade/. This PR makes a few necessary changes for the new OS.
Necessary steps for internal lab users on kestrel
kl3.hpc.nlr.govnode instead ofkestrel.hpc.nlr.gov,kl1.hpc.nlr.gov, orkl2.hpc.nlr.gov(docs)reedsconda environment:conda env remove --name reeds(say yes to all prompts)environment.ymlfile from this branch:conda env create -f environment.ymlIncompatibilities
Existing Julia instances with the old
Manifest.tomlstill work, but new instantiations will fail. TheProject.tomlwill be updated as part of #257. Until then, hold onto yourManifest.tomls.Technical details
Implementation notes
NREL_CLUSTERenvironment variable has been changed toNLR_CLUSTER. We used it in many places, so I moved all that functionality toreeds.slurm.get_cluster()to make it easier to update in the future.REEDS_USE_SLURMenvironment variable as it doesn't seem necessaryRelevant sources or documentation
https://natlabrockies.github.io/HPC/RHEL9_upgrade/
Validation, testing, and comparison report(s)
Here's a comparison for the USA_defaults case; changes are within the noise: results-v20261017_mainK0_USA_defaults,v20261020_rhel9K6_USA_defaults.pptx
Checklist for author
Details to double-check
General information to guide review
Did you use LLM tools (chatbot or copilot) in the preparation of this PR? If so, describe how
No