Skip to content

Add support for OutputVars with no time dimension#320

Merged
ph-kev merged 4 commits into
mainfrom
kp/no-time
Jun 8, 2026
Merged

Add support for OutputVars with no time dimension#320
ph-kev merged 4 commits into
mainfrom
kp/no-time

Conversation

@ph-kev

@ph-kev ph-kev commented Jun 2, 2026

Copy link
Copy Markdown
Member

For ObservationRecipe and EnsembleBuilder, there was an implicit assumption that calibration would always involve time series data. However, this may not always be the case. For example, instead of using the entire time series data, you may be interested in certain features of the time series data (e.g. where the minimum or maximum are or the amplitude if it is periodic data). This PR allows for OutputVars with no time dimension to be used with the GEnsembleBuilder and ObservationRecipe with ScalarCovariance.

In the future, we may want to support OutputVars with no time dimension for the SVDplusDCovariance estimator, but this can be done in another PR.

closes #267

TODO

  • Reduce code duplication for covariance and observation in ObservationRecipe for ScalarCovariance

@codecov

codecov Bot commented Jun 3, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 59.35%. Comparing base (324a5f6) to head (7f8d8bb).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #320      +/-   ##
==========================================
+ Coverage   58.91%   59.35%   +0.43%     
==========================================
  Files          17       17              
  Lines        1407     1422      +15     
==========================================
+ Hits          829      844      +15     
  Misses        578      578              

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@ph-kev ph-kev requested a review from nefrathenrici June 4, 2026 18:33

@nefrathenrici nefrathenrici left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks correct, I just had a comment on the code duplication.

Comment thread ext/observation_recipe.jl
Comment thread ext/observation_recipe.jl Outdated
Comment thread ext/observation_recipe.jl
This was missed in this PR
#318.
@ph-kev ph-kev force-pushed the kp/no-time branch 2 times, most recently from 9925c59 to cbe56a1 Compare June 8, 2026 16:59
ph-kev added 2 commits June 8, 2026 10:00
This commit also refactors the checks for the time dimension into a
helper function.
It was implied that OutputVar passed to the `GEnsembleBuilder` has a
time dimension.
@ph-kev ph-kev marked this pull request as ready for review June 8, 2026 17:01
@ph-kev ph-kev requested a review from nefrathenrici June 8, 2026 17:01

@nefrathenrici nefrathenrici left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks great. To make the Derecho pipeline work, could you update line 5 of .buildkite/derecho_pipeline.yml? It needs a GPU:

  pbs_l_select: "1:ncpus=1:ngpus=1"

The Derecho pipeline could not run, because we ran out of CPU hours.
@ph-kev ph-kev merged commit ca6550f into main Jun 8, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add support for OutputVars with no time dimension in extension

2 participants