Update OLIDS Release Notes

OLIDS/Release-notes/1_OLIDS_Share/v1.5.0.md

@@ -0,0 +1,25 @@
+> [!NOTE]
+> The below is a summary of the changes since the previous release [v1.4.0](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/releases/tag/releases%2Fv1.4.0).
+## Summary
+This release includes an update to the `duckdb__format_date_to_string` function, enhancing its ability to handle postcode version date strings in the `'AUG2026'` format. This improvement increases compatibility with datasets that use this specific date representation, ensuring smoother data processing and formatting.
+
+### Improvements
+- Updated `duckdb__format_date_to_string` to support postcode version date string format (e.g., `'AUG2026'`). [PR: #18](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/18)
+  > 🎯 ***Impact:*** Enables correct formatting and parsing of postcode version dates, improving data compatibility and reducing potential errors when handling date strings in this format.
+
+### Inputs
+
+This changelog was automatically produced from:
+
+- 1 Pull Requests
+- 0 Issues
+- 0 WorkItems
+- 2 Commits
+
+## Full Details
+
+Pull Requests included in this release:
+- [PR #18](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/18): Updated duckdb__format_date_to_string to handle postcode version date…
+  - No linked issues.
+
+[View the diff between v1.4.0 and v1.5.0](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/compare/releases%2Fv1.4.0...releases%2Fv1.5.0)

OLIDS/Release-notes/1_OLIDS_Share/v1.6.0.md

@@ -0,0 +1,25 @@
+> [!NOTE]
+> The below is a summary of the changes since the previous release [v1.5.0](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/releases/tag/releases%2Fv1.5.0).
+## Summary
+This release introduces a macro to standardize the handling of regular expression syntax differences between DuckDB and Snowflake. This enhancement simplifies cross-platform SQL development and improves code portability, making it easier to write queries that work seamlessly across both database systems.
+
+### New Features
+- Add macro to handle different syntax for regex like and match between DuckDB and Snowflake. *[PR: [#19](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/19)]*
+  > ✨ ***Feature:*** Enables consistent usage of regex-based conditions in SQL queries across DuckDB and Snowflake, reducing the need for manual syntax adjustments and improving developer productivity.
+
+### Inputs
+
+This changelog was automatically produced from:
+
+- 1 Pull Requests
+- 0 Issues
+- 0 WorkItems
+- 5 Commits
+
+## Full Details
+
+Pull Requests included in this release:
+- [PR #19](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/19): Add macro to handle different syntax for regex like and match between…
+  - No linked issues.
+
+[View the diff between v1.5.0 and v1.6.0](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/compare/releases%2Fv1.5.0...releases%2Fv1.6.0)

OLIDS/Release-notes/1_OLIDS_Share/v1.7.0.md

@@ -0,0 +1,53 @@
+> [!NOTE]
+> The below is a summary of the changes since the previous release [v1.6.0](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/releases/tag/releases%2Fv1.6.0).
+## Summary
+
+This release introduces major improvements to the OLIDS_Share dbt package, focusing on automation, validation, and testing. Key highlights include automated generation of `sources.yml` files for Snowflake schemas, comprehensive NHS number validation macros with adapter-specific implementations, and a robust macro test suite with CI integration. Together, these changes enhance reliability, data quality, and developer productivity for users of the package.
+
+### New Features
+- Automated generation of `sources.yml` files for OLIDS_PID and OLIDS_PSEUDO schemas in Snowflake, using a new dbt macro and PowerShell workflow integrated into the dbt execution process.  
+  *[PR: [#20](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/20)]*  
+  > ✨ ***Feature:*** This streamlines the onboarding of new views and tables, reducing manual effort and ensuring source definitions are always up to date.
+
+- Added NHS number validation macros, including checks for population, valid format, valid checksum, and pre-1994 format, with full support for both DuckDB and Snowflake adapters.  
+  *[PR: [#22](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/22)]*  
+  > ✨ ***Feature:*** These macros enable robust, adapter-specific NHS number validation, improving data integrity and compliance for downstream models.
+
+### Improvements
+- Introduced a dedicated macro test suite and integration test project, along with a GitHub Actions workflow to automatically run dbt unit tests on DuckDB.  
+  *[PR: [#21](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/21)]*  
+  > 🎯 ***Impact:*** Significantly increases test coverage and CI reliability, ensuring core macros are validated in isolation and do not interfere with package consumers.
+
+- Added new utility macros: `append_schema_suffix` for dynamic schema naming and `remove_whitespace` for string cleaning, with updates to `format_postcode` for improved postcode formatting.  
+  *[PR: [#21](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/21)]*  
+  > 🎯 ***Impact:*** Enhances flexibility in schema routing and improves string handling, supporting more consistent data transformations.
+
+### Refactoring
+- Reorganized macros into sub-folders based on functionality for better maintainability and clarity.  
+  *[PR: [#21](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/21)]*  
+  > ♻️ ***Refactor:*** Improves code structure, making it easier for developers to locate and manage macros as the package grows.
+
+- Moved integration tests to an isolated dbt sub-project to avoid dependency bloat and ensure test isolation.  
+  *[PR: [#21](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/21)]*  
+  > ♻️ ***Refactor:*** Keeps the main package lean and prevents test dependencies from affecting consumers.
+
+### Inputs
+
+This changelog was automatically produced from:
+
+- 3 Pull Requests
+- 0 Issues
+- 0 WorkItems
+- 32 Commits
+
+## Full Details
+
+Pull Requests included in this release:
+- [PR #20](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/20): generate source yml file 
+  - No linked issues.
+- [PR #21](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/21): Add macro test suite to repository
+  - No linked issues.
+- [PR #22](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/pull/22): Add nhs number validation macros
+  - No linked issues.
+
+[View the diff between v1.6.0 and v1.7.0](https://github.com/NHSISL/LondonDataServices.OLIDS_Share/compare/releases%2Fv1.6.0...releases%2Fv1.7.0)

OLIDS/Release-notes/2_EMIS_OLIDS/v2.4.0.md

@@ -0,0 +1,38 @@
+> [!NOTE]
+> The below is a summary of the changes since the previous release [v2.3.0](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/releases/tag/releases%2Fv2.3.0).
+## Summary
+
+This release introduces a new derived appointment status column to the `PC_EMIS_Appointment` model, enhancing future compatibility and clarity in downstream data usage. Logic for identifying referral requests has been streamlined in medication models, reducing ambiguity and improving data consistency. Additionally, the OLIDS_Share dependency has been updated to revision v1.5.0, ensuring alignment with the latest platform features and fixes.
+
+### New Features
+- Add derived column for appointment status and update tests [PR: [#117](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/117)]
+  > ✨ ***Feature:*** Introduces a new `APPOINTMENT_STATUS_DERIVED` column in the appointments model, preparing for future schema changes and improving clarity in appointment status handling.
+
+### Improvements
+- Update OLIDS_Share to revision v1.5.0 [PR: [#119](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/119)]
+  > 🎯 ***Impact:*** Ensures the project uses the latest OLIDS_Share features and bug fixes, supporting ongoing compatibility and stability.
+
+### Bug Fixes
+- Remove remaining references to Observation_type=referral [PR: [#118](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/118)]
+  > 🐞 ***Fix:*** Updates referral request logic in medication models to rely solely on `EMIS_CODE_CATEGORY_DESCRIPTION = 'Referral'`, eliminating ambiguous use of `OBSERVATION_TYPE` and improving data accuracy.
+
+### Inputs
+
+This changelog was automatically produced from:
+
+- 3 Pull Requests
+- 0 Issues
+- 0 WorkItems
+- 8 Commits
+
+## Full Details
+
+Pull Requests included in this release:
+- [PR #117](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/117): Add derived column for appointment status and update tests
+  - No linked issues.
+- [PR #118](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/118): Remove remaining references to Observation_type=referral
+  - No linked issues.
+- [PR #119](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/119): Update OLIDS_Share to revision v1.5.0
+  - No linked issues.
+
+[View the diff between v2.3.0 and v2.4.0](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/compare/releases%2Fv2.3.0...releases%2Fv2.4.0)

OLIDS/Release-notes/2_EMIS_OLIDS/v2.5.0.md

@@ -0,0 +1,38 @@
+> [!NOTE]
+> The below is a summary of the changes since the previous release [v2.4.0](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/releases/tag/releases%2Fv2.4.0).
+## Summary
+
+This release introduces versioning to the `PC_EMIS_Episode_Of_Care` transformed model, enabling support for historic registrations and improved data lineage. The update also enhances documentation, adds new fields to the patient history model, and refines unit test coverage to ensure ongoing model reliability. Several internal improvements and bug fixes further strengthen data quality and maintainability.
+
+### New Features
+- Added version 2 of the `PC_EMIS_Episode_Of_Care` transform to support historic registrations by consuming data from the `ADMIN_PATIENT_HISTORY` table. Introduced model versioning semantics and updated documentation to reflect changes. *[PR: [#116](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/116)]*
+  > ✨ ***Feature:*** Users can now access historic registration data, improving the completeness and traceability of episode-of-care records.
+
+### Improvements
+- Enhanced the `PC_EMIS_Episode_Of_Care` model documentation with explicit version tracking and column history. Updated unit tests to ensure they target the correct model version for reliable validation as the model evolves. Added the `PATIENT_TYPE_DESCRIPTION` field to the sequenced admin patient history model and SQL transformation. *[PR: [#116](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/116)]*
+  > 🎯 ***Impact:*** Improves transparency, test coverage, and data clarity for end users and maintainers.
+
+### Bug Fixes
+- Corrected macro enclosure invocation for `generate_sha256` and resolved issues in model scenarios identified by tests. *[PR: [#116](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/116)]*
+  > 🐞 ***Fix:*** Ensures accurate hash generation and robust model behavior, reducing the risk of data inconsistencies.
+
+### Refactoring
+- Refactored the `PC_EMIS_Episode_Of_Care` transform by separating state change detection into its own CTE and improving SQL logic clarity. Removed the unversioned model to streamline codebase consistency. *[PR: [#116](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/116)]*  
+  > ♻️ ***Refactor:*** Enhances maintainability and readability, making future updates and debugging more efficient.
+
+### Inputs
+
+This changelog was automatically produced from:
+
+- 1 Pull Requests
+- 0 Issues
+- 0 WorkItems
+- 6 Commits
+
+## Full Details
+
+Pull Requests included in this release:
+- [PR #116](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/116): add PC_EMIS_Episode_Of_Care (version 2) - historic registrations
+  - No linked issues.
+
+[View the diff between v2.4.0 and v2.5.0](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/compare/releases%2Fv2.4.0...releases%2Fv2.5.0)

OLIDS/Release-notes/2_EMIS_OLIDS/v2.5.1.md

@@ -0,0 +1,25 @@
+> [!NOTE]
+> The below is a summary of the changes since the previous release [v2.5.0](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/releases/tag/releases%2Fv2.5.0).
+## Summary
+This release updates the OLIDS_Share package to version 1.6.0. By referencing the latest package revision, the platform benefits from recent enhancements and bug fixes included upstream, ensuring improved stability and compatibility.
+
+### Improvements
+- Update OLIDS_Share revision to v1.6.0 in `EMIS_OLIDS/packages.yml` to use the latest package version. *[PR: [#121](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/121)]*
+  > 🎯 ***Impact:*** Ensures the platform leverages the latest features and fixes from the OLIDS_Share package, improving reliability and maintainability.
+
+### Inputs
+
+This changelog was automatically produced from:
+
+- 1 Pull Requests
+- 0 Issues
+- 0 WorkItems
+- 2 Commits
+
+## Full Details
+
+Pull Requests included in this release:
+- [PR #121](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/121): Update OLIDS_Share revision to v1.6.0
+  - No linked issues.
+
+[View the diff between v2.5.0 and v2.5.1](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/compare/releases%2Fv2.5.0...releases%2Fv2.5.1)

OLIDS/Release-notes/2_EMIS_OLIDS/v2.5.2.md

@@ -0,0 +1,31 @@
+> [!NOTE]
+> The below is a summary of the changes since the previous release [v2.5.1](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/releases/tag/releases%2Fv2.5.1).
+## Summary
+
+This release focuses on improving data quality and platform stability for episode-of-care processing. It addresses a critical issue with duplicate and invalid episode records, enhancing the deduplication logic and adding comprehensive unit tests to ensure robust handling of complex data scenarios. Additionally, the OLIDS_Share revision has been updated to v1.7.0, ensuring compatibility with the latest platform standards.
+
+### Improvements
+- Add tests and fix for duplicate episode of care IDs [PR: [#122](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/122)]
+  > 🎯 ***Impact:*** Improves the episode-of-care rule engine by ensuring closed episodes with differing start/end/type are handled correctly and that duplicate or overlapping episodes are deduplicated. This update enforces unique, valid episodes and adds targeted unit tests, resulting in higher data quality and more reliable downstream analytics.
+
+- Update OLIDS_Share revision to v1.7.0 [PR: [#123](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/123)]
+  > 🎯 ***Impact:*** Updates the platform dependency to the latest OLIDS_Share revision, ensuring continued compatibility and access to recent enhancements and fixes.
+
+### Inputs
+
+This changelog was automatically produced from:
+
+- 2 Pull Requests
+- 0 Issues
+- 0 WorkItems
+- 7 Commits
+
+## Full Details
+
+Pull Requests included in this release:
+- [PR #122](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/122): Add tests and fix for duplicate episode of care IDs
+  - No linked issues.
+- [PR #123](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/pull/123): Update OLIDS_Share revision to v1.7.0
+  - No linked issues.
+
+[View the diff between v2.5.1 and v2.5.2](https://github.com/NHSISL/LondonDataservices.Transform.EMIS_OLIDS/compare/releases%2Fv2.5.1...releases%2Fv2.5.2)