Skip to content

Conversation

@piotrlaczkowski
Copy link
Collaborator

@piotrlaczkowski piotrlaczkowski commented Apr 1, 2025

This pull request includes several changes to the Makefile, new example scripts, and updates to the kdp library, primarily focused on enhancing time series feature processing and improving documentation generation.

Makefile Updates:

  • Introduced a new generate_all_diagrams target to generate and organize all diagrams in one step, and deprecated the old generate_doc_content target. Updated other targets to use generate_all_diagrams instead. [1] [2] [3]

New Example Scripts:

  • Added a comprehensive time series features example script examples/time_series_features_example.py demonstrating the use of new time series feature layers like WaveletTransformLayer and TSFreshFeatureLayer.

Documentation and Code Quality:

  • Added # ruff: noqa: E402 to the top of example scripts to ignore import order warnings. [1] [2]
  • Updated ideas.md with advanced suggestions for enhancing time series preprocessing capabilities.

kdp Library Enhancements:

  • Added TimeSeriesFeature to the kdp library's __init__.py to include it in the public API. [1] [2]
  • Registered several custom layers with TensorFlow's Keras serialization framework and added from_config methods for better serialization and deserialization. [1] [2] [3] [4] [5]
  • Updated the kdp.layers.time_series module to include new layers like LagFeatureLayer, RollingStatsLayer, and WaveletTransformLayer.

@piotrlaczkowski piotrlaczkowski added the enhancement New feature or request label Apr 1, 2025
@github-actions
Copy link

github-actions bot commented Apr 1, 2025

PR Preview Action v1.6.1

🚀 View preview at
https://piotrlaczkowski.github.io/keras-data-processor/pr-preview/pr-29/

Built to branch gh-pages at 2025-04-11 11:30 UTC.
Preview will be ready when the GitHub Pages deployment is complete.

@github-actions
Copy link

github-actions bot commented Apr 1, 2025

Coverage

Coverage Report
FileStmtsMissCoverMissing
kdp
   auto_config.py18130 23%
   dynamic_pipeline.py2481 63%
   features.py213126 92%
   layers_factory.py8940 96%
   model_advisor.py37011951 62%
   moe.py129213 81%
   pipeline.py50142 67%
   processor.py66111258 77%
   stats.py2776319 75%
kdp/inference
   base.py30123 54%
kdp/layers
   cast_to_float.py140100% 
   date_encoding_layer.py42260 36%
   date_parsing_layer.py38270 29%
   distribution_aware_encoder_layer.py243223 89%
   distribution_transform_layer.py195539 71%
   gated_linear_unit_layer.py130100% 
   gated_residual_network_layer.py220100% 
   global_numerical_embedding_layer.py2711 93%
   multi_resolution_tabular_attention_layer.py270100% 
   numerical_embedding_layer.py5521 96%
   season_layer.py25130 44%
   tabular_attention_layer.py270100% 
   text_preprocessing_layer.py2040 80%
   transformer_block_layer.py170100% 
   variable_selection_layer.py260100% 
kdp/layers/time_series
   auto_lag_selection_layer.py1595619 57%
   calendar_feature_layer.py1113818 58%
   differencing_layer.py78811 82%
   fft_feature_layer.py11875 91%
   lag_feature_layer.py4132 88%
   missing_value_handler_layer.py1941713 86%
   moving_average_layer.py96199 76%
   rolling_stats_layer.py1295613 51%
   seasonal_decomposition_layer.py10824 96%
   tsfresh_feature_layer.py1986518 63%
   wavelet_transform_layer.py11035 95%
kdp/time_series
   inference.py1412621 74%
TOTAL413582675% 

Tests Skipped Failures Errors Time
382 14 💤 0 ❌ 0 🔥 3m 25s ⏱️

@piotrlaczkowski piotrlaczkowski requested a review from Copilot April 11, 2025 09:37
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot reviewed 73 out of 74 changed files in this pull request and generated 2 comments.

Files not reviewed (1)
  • Makefile: Language not supported

@piotrlaczkowski piotrlaczkowski merged commit ff38437 into main May 28, 2025
3 checks passed
@piotrlaczkowski piotrlaczkowski deleted the feat/feat_adding_timeseries_feature branch May 28, 2025 11:02
github-actions bot pushed a commit that referenced this pull request May 28, 2025
## 1.11.0 (2025-05-28)

* feat(KDP): adding new layers / features to timeseries ([519bb06](519bb06))
* feat(KDP): adding timeseries features ([7e819dc](7e819dc))
* feat(KDP): adding timeseries features functionality and layers (#29) ([ff38437](ff38437)), closes [#29](#29)
* feat(KDP): adding timeseries inference formatter ([c83cd48](c83cd48))
* fix(KDP): fix pre-commit ([e1f77f4](e1f77f4))
* fix(KDP): fixing docs plugin ([21dba63](21dba63))
* fix(KDP): fixing symbolic tensors shape calculations ([d810e62](d810e62))
* fix(KDP): getting rid of hardcoded test requirements ([849a982](849a982))
* fix(KDP): removing print and replacing by logger ([2333152](2333152))
* docs(KDP): correctly referencing timeseries features ([13e4511](13e4511))
* docs(KDP): extending docs and tests for timeseries features ([37f4f24](37f4f24))
* test(KDP): adding more timeseries feature tests ([8c317bf](8c317bf))
* ops(KDP): cleaning workflows ([37da166](37da166))
* ops(KDP): fix docs release errors ([b8972c4](b8972c4))
* ops(KDP): fixing release ([37474e7](37474e7))
* ops(KDP): improve release workflow ([2504321](2504321))
* ops(KDP): updating after release notes ([cc41dad](cc41dad))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants