Task Details
We need to collect and ingest all E3SM v3 data from Chrysalis using the v3 data docs table here and V3 Simulation Planning Confluence Doc here.
These cases date back to 2024, which means we should start the ingestion in the 2024-01 onward.
Steps to Complete
In #281
Additional Notes
We can try to re-use the nersc_archive_ingestor.py script and wrap it with additional logic if possible. Otherwise a new script can be written and helper functions can be extracted for nersc_archive_ingestor.py.
Task Details
We need to collect and ingest all E3SM v3 data from Chrysalis using the v3 data docs table here and V3 Simulation Planning Confluence Doc here.
These cases date back to 2024, which means we should start the ingestion in the 2024-01 onward.
Steps to Complete
In #281
Additional Notes
We can try to re-use the
nersc_archive_ingestor.pyscript and wrap it with additional logic if possible. Otherwise a new script can be written and helper functions can be extracted fornersc_archive_ingestor.py.