Repository navigation

Inference: config validation and failure handling - #876

Merged

timlichtenberg merged 81 commits into

mainfrom

ks/inference

Sep 30, 2026

Commits on Sep 14, 2026
- ignore output logs and inference tomls used for testing
  stuitje
  committed
  5ffa2b4
- validate proteus config in inference runs
  stuitje
  committed
  ccb4d33
- small refactor for config check
  stuitje
  committed
  b819b0f
- add number of functions for robust error handling in proteus workers
  stuitje
  committed
  05b929f
- add functions to summarise failures in proteus workers and check if all evaluations failed
  stuitje
  committed
  bbe04a2
- abort on failure and summarise failures
  stuitje
  committed
  b709ba7
- split worker into wrapper and _worker_loop, detect dead workers for failure handling
  stuitje
  committed
  f230c85
- modify to select workers by key instead of position
  stuitje
  committed
  204b095
- update docs with new failure functionality
  stuitje
  committed
  55fcc83
- add function to refuse configuration at error level (not info)
  stuitje
  committed
  4e27e7b
- soften the failure code 11 logs (max runtime reached)
  stuitje
  committed
  c457cd4
- add abort_on_failure
  stuitje
  committed
  d6718b6
- add inference tests for config validation and failure handling
  stuitje
  committed
  3718409
- update docs with softened handling of excluded outcomes (eg status 11)
  stuitje
  committed
  51d0ccc
- fix worker console-log error when plotting
  stuitje
  committed
  90bdbbb
Commits on Sep 15, 2026
- small tweaks to failures text in docs
  stuitje
  committed
  8b7c653
Commits on Sep 16, 2026
- update logs w.r.t failures
  stuitje
  committed
  c236b78
- fix abort_on_failure for runs that exit cleanly but write a failure status
  stuitje
  committed
  32fd89a
- only flag unscored exactly at -20
  stuitje
  committed
  32c5391
- update tests with failure handling updates
  stuitje
  committed
  bbfc849
- fix logging when spawn method is used (MacOS)
  stuitje
  committed
  64428b2
- update tests with logger fix
  stuitje
  committed
  628c04b
- Merge branch 'main' into ks/inference
  stuitje
  authored
  697b981
Commits on Sep 17, 2026
- reduce spam in output log
  stuitje
  committed
  7f7a994
- update test with less verbose logging
  stuitje
  committed
  5756b93
- fix ruff format
  stuitje
  committed
  acf4910
Commits on Sep 18, 2026
Commits on Sep 19, 2026
- fix 'Empty except' with log
  
  stuitje
  and
  github-code-quality[bot]
  authored
  cab38e9
- Merge branch 'main' into ks/inference
  stuitje
  authored
  46ec67b
Commits on Sep 20, 2026
- register spectral_cache in atmosclim doc_groups and update docs
  stuitje
  committed
  18cb794
- add failures.py to docs in project structure overview
  stuitje
  committed
  84a2770
- update docs line
  stuitje
  committed
  13fda76
- restore to matern 1/2 and update comments
  stuitje
  committed
  7932d9d
- fix bug where spectral cache is on but unused
  stuitje
  committed
  18b6749
Commits on Sep 21, 2026
- Merge branch 'main' into ks/inference
  stuitje
  authored
  2bb0f2a
Commits on Sep 24, 2026
- Merge branch 'main' into ks/inference
  stuitje
  authored
  0e32299
Commits on Sep 25, 2026
- Merge branch 'main' into ks/inference
  stuitje
  authored
  eaa0a6c
Commits on Sep 28, 2026
- Merge branch 'main' into ks/inference
  stuitje
  authored
  434f863
- Keep per-run config entries out of inference failure reports by using a copy
  stuitje
  committed
  125bdc7
- Test failure recording through the real run_proteus
  stuitje
  committed
  ffff6ab
- stop optimising on abort_on_failure set to true and with a failure
  stuitje
  committed
  5b9dda7
- assert that optimisation stops under failure with abort_on_failure
  stuitje
  committed
  dc0b16b
- reject log-scaled params with bounds that include 0 or below
  stuitje
  committed
  ae2df06
- test that log-scaled bounds with 0 or below are rejected but linear ones are not
  stuitje
  committed
  821c44e
- add status 29 (evaporated) to an always_excluded category: should never be fit against but it is not a crash
  stuitje
  committed
  d57e93f
- assert status 29 is always excluded
  stuitje
  committed
  f76c877
- status 29 is always excluded
  stuitje
  committed
  ebbe8f8
- mention status 29 is always excluded
  stuitje
  committed
  08a7de3
- add lock so that concurrent failures do not lose rows in failures.csv
  stuitje
  committed
  71f0d12
- test new lock for failures.csv
  stuitje
  committed
  8395ad4
- refactor: shorten comments, module docstrings and doctrings to improve readability, and improve code efficiency
  stuitje
  committed
  57d0245
- shorten comments to max 3 lines
  stuitje
  committed
  52250b3
- Swap BaseException with Exception
  stuitje
  committed
  3ad70ef
- ruff fix
  stuitje
  committed
  f3ddaf3
- allow for rayleigh scattering and aerosols in spectral cache
  stuitje
  committed
  426fc21
- update tests for spectral cache with rayleigh and aerosol settings
  stuitje
  committed
  5652ac2
- Stop initial sampling at the first failed sample
  stuitje
  committed
  99cdfe3
- update docs with new failures behaviour
  stuitje
  committed
  a1c2b50
- update example toml with abort on failure info
  stuitje
  committed
  9e70b0a
- add explanatory comment on exception
  stuitje
  committed
  a6f9b5d
- invalid UTF-8 catch added
  stuitje
  committed
  9ad2918
- shorten comment
  stuitje
  committed
  27c5d9b
- make spectral cache explicit in inference run so that a reference config copied from all_options doesnt silently turn it off
  stuitje
  committed
  e9c41df
- cache only the spectral file at first build of each run
  stuitje
  committed
  a7322ee
Commits on Sep 29, 2026
- Merge branch 'main' into ks/inference
  stuitje
  authored
  7a0a1df
- Merge branch 'main' into ks/inference
  stuitje
  authored
  58865b3
- Merge branch 'main' into ks/inference
  stuitje
  authored
  dffd84b
- update agni.py and test spectral cache order to match new main
  stuitje
  committed
  c9d245e
- refuse cache when using mie aerosols
  stuitje
  committed
  fb4e32c

Commits

Commits on Sep 14, 2026

Commits on Sep 15, 2026

Commits on Sep 16, 2026

Commits on Sep 17, 2026

Commits on Sep 18, 2026

Commits on Sep 19, 2026

Commits on Sep 20, 2026

Commits on Sep 21, 2026

Commits on Sep 24, 2026

Commits on Sep 25, 2026

Commits on Sep 28, 2026

Commits on Sep 29, 2026