Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
73 commits
Select commit Hold shift + click to select a range
58f23c6
add variable checking utilities
daliwang Sep 5, 2025
99df35b
add prediction analysis code
daliwang Sep 16, 2025
eb7ccc7
add pft-mask option
daliwang Oct 2, 2025
1d9d9d1
modified the model config file based on better understanding of numbe…
daliwang Oct 7, 2025
2172dad
Merge branch 'LandSim_dynamic_configuration_pft_mask' into main
daliwang Oct 7, 2025
bf8af55
Merge pull request #5 from daliwang/main
daliwang Oct 7, 2025
540c96d
Merge pull request #8 from daliwang/LandSim_dynamic_configuration_pft…
daliwang Oct 7, 2025
255fc4a
Add AMD GPU setup and environment scripts (see daliwang/LandSim#4)
Oct 9, 2025
37f9b00
Add PyTorch profiling workflow for NVIDIA/AMD GPUs (see daliwang/Land…
Oct 9, 2025
841dfd0
Add random shuffling options to training script and improve time seri…
daliwang Oct 10, 2025
de20e33
Merge pull request #11 from daliwang/dev_random_shuffling_timeserise_…
daliwang Oct 10, 2025
e1b6b50
Drop data samples at longitude 0 degree
Oct 10, 2025
5bfb24a
Update data loader & training config; drop samples at longitude 0°
Oct 10, 2025
7ada6f8
turn on mask-absent-pfts and improve CNP_pipeline_runbook.md
daliwang Oct 11, 2025
99b758a
improve analysis scripts
daliwang Oct 11, 2025
0e76d9b
Enhance README and runbook documentation; improve validation scripts …
daliwang Oct 11, 2025
d754aeb
Merge pull request #12 from gdw00/main
daliwang Oct 11, 2025
5da2f28
turn on mask-absent-pfts and improve CNP_pipeline_runbook.md
daliwang Oct 11, 2025
207c72a
improve analysis scripts
daliwang Oct 11, 2025
8cef42b
Enhance README and runbook documentation; improve validation scripts …
daliwang Oct 11, 2025
cecc616
Merge branch 'improve_analysis' of github.com:daliwang/LandSim into i…
daliwang Oct 11, 2025
2dda824
Add CNP_IO configuration file and update training config parser to su…
daliwang Oct 11, 2025
a615ac7
Merge pull request #16 from daliwang/improve_analysis
daliwang Oct 11, 2025
e84c5a7
Merge pull request #9 from guzhuowei0407/main
daliwang Oct 11, 2025
04c5471
Add CI when pull request
Oct 6, 2025
83ec697
Merge pull request #14 from QingleiCao/qinglei/ci
daliwang Oct 13, 2025
8b10e84
remove old CNP_IO lists
daliwang Oct 13, 2025
cae5024
read model config for inference
daliwang Oct 13, 2025
09e5194
Merge pull request #18 from daliwang/improve_analysis
daliwang Oct 13, 2025
9ca2b07
remove unused test scripts
daliwang Oct 13, 2025
1c8da06
add multi datasets and fix the bugs in quality report generation
daliwang Oct 15, 2025
378170f
fix analysis scritps
daliwang Oct 15, 2025
62da6c1
fix run_inference with model config option
daliwang Oct 16, 2025
9852522
Update variable list for training model
daliwang Oct 18, 2025
ee75e82
Merge pull request #20 from daliwang/multicase_validation
daliwang Oct 18, 2025
bcc382a
ignore local config file
Oct 19, 2025
b3ecf08
For step 7 and 9: add --stats-only to get summary statistics
Oct 20, 2025
24c605d
Restore CNP_IO_updated9_dev.txt
Oct 20, 2025
c099493
Update training config, pipeline runbook, and comparison scripts
Oct 23, 2025
20e512c
Move fallback path to CNP_IO txt and clean up hardcoded paths
Oct 24, 2025
eca0b46
Merge pull request #23 from gdw00/main
daliwang Oct 27, 2025
d1f5422
Add training_data_generation scripts and validation scripts
Oct 17, 2025
a3fd3d4
Consolidated updates: unified dataset generation and initial conditio…
Oct 27, 2025
b0b9adf
Merge pull request #27 from guzhuowei0407/main
daliwang Oct 29, 2025
872c4f5
Update forcing data generation and config for 20-year dataset
Oct 31, 2025
41e7484
Merge pull request #28 from guzhuowei0407/main
daliwang Nov 1, 2025
6272d47
update: revised pipeline doc and added TVA sample workflow
Nov 3, 2025
f6d3f12
Merge pull request #29 from gdw00/main
daliwang Nov 3, 2025
29bbdfb
fix inference bug
Nov 4, 2025
b667fca
update: revised pipeline doc, added CNP_IO_updated9_dev_gao.txt and r…
Nov 5, 2025
5063d80
add personal CNP_IO_updated9_dev list
daliwang Nov 6, 2025
fc74b6f
Merge pull request #34 from daliwang/multicase_validation
daliwang Nov 6, 2025
5b9249f
Merge pull request #33 from gdw00/main
daliwang Nov 6, 2025
5b2e4f7
Merge branch 'daliwang:main' into main
guzhuowei0407 Nov 6, 2025
84c21cb
Merge pull request #38 from guzhuowei0407/main
daliwang Nov 6, 2025
ea6ee75
fix pft param normalization
Nov 13, 2025
202ba53
Fix can't load file prefix issue
Nov 14, 2025
8c6e5e3
Merge pull request #41 from guzhuowei0407/main
daliwang Nov 16, 2025
c0f66e9
data analysis function imporvement
daliwang Nov 17, 2025
dd15451
update ai_prediction_to_restart
daliwang Nov 19, 2025
63d1fc4
customize path
daliwang Nov 21, 2025
04834cb
fix the location bug in site inference
daliwang Nov 22, 2025
76ee6a0
Merge pull request #43 from daliwang/site_validation
daliwang Nov 23, 2025
9ff07f4
Merge pull request #40 from xh-ding/main
daliwang Nov 23, 2025
70f6571
Add multi-gridcell support in run_workflow.py and update runbook with…
Nov 26, 2025
ef9f86d
Add restart point extraction tool and update runbook
Dec 11, 2025
1f1c015
update extract_elm_restart_point.py
Dec 16, 2025
f048481
Add single-point restart extraction doc and nc comparison script
Jan 6, 2026
793b4a6
Fix dimension mismatch bug in extract_elm_restart_point
Jan 13, 2026
3ad7374
Add IJCAI-style NEE time series plotting script
Jan 15, 2026
29f36cc
verify CNP predictions, fix ai_predictions_to_netcdf workflow, and hi…
Jan 23, 2026
aa5fe7a
Fix: apply PFT mask during all-gridcell inference
Jan 28, 2026
2d266ea
Focus dataset on tropical regions for CNP training
Feb 3, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
73 changes: 73 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,73 @@
name: CI

on:
pull_request:

permissions:
contents: read

concurrency:
group: ci-${{ github.ref }}
cancel-in-progress: true

jobs:
build-and-test:
runs-on: ubuntu-latest
timeout-minutes: 30
env:
OMP_NUM_THREADS: 1
steps:
- name: Checkout
uses: actions/checkout@v4

- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: '3.11'
cache: 'pip'

- name: Install system deps
run: |
sudo apt-get update
sudo apt-get install -y git

- name: Set up venv
run: |
python -m venv .venv
source .venv/bin/activate
python -m pip install -U pip
python -m pip install -r requirements.txt || true
# Ensure CPU-only PyTorch is available in CI
pip install --extra-index-url https://download.pytorch.org/whl/cpu torch torchvision torchaudio || true

- name: Quick smoke test (example dataset)
run: |
source .venv/bin/activate
python train_model.py

- name: Prepare dataset (download if missing)
env:
DATA_DIR: ${{ github.workspace }}/dataset/trendy1
run: |
chmod +x scripts/prepare_data.sh
bash scripts/prepare_data.sh "$DATA_DIR"

- name: CNP training smoke test (dataset, 1 file, 1 epoch)
env:
DATA_DIR: ${{ github.workspace }}/dataset/trendy1
run: |
source .venv/bin/activate
python train_cnp_model.py \
--epoch 1 \
--variable-list ./CNP_IO_updated9_dev.txt \
--mask-absent-pfts \
--model-config ./CNP_model_config_v01.txt \
--use-trendy1 \
--data-paths "$DATA_DIR" \
--file-pattern 'enhanced_1_training_data_batch_*.pkl' \
--max-files 1

- name: CNP training config validation (no data)
run: |
source .venv/bin/activate
python train_cnp_model.py --config-only --use-trendy1 --epoch 1 --batch-size 8
6 changes: 6 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
# Ignore result and cache folders
cnp_results/
__pycache__/
*.pyc
logs/
CNP_IO_updated9_dev.txt
183 changes: 0 additions & 183 deletions CNP_IO_list1.txt

This file was deleted.

Loading