Skip to content

chore: Sync upstream changes from datahub-project/datahub#369

Merged
sgomezvillamor merged 25 commits into
masterfrom
sync-upstream-2026-02-27
Feb 27, 2026
Merged

chore: Sync upstream changes from datahub-project/datahub#369
sgomezvillamor merged 25 commits into
masterfrom
sync-upstream-2026-02-27

Conversation

@sgomezvillamor
Copy link
Copy Markdown
Collaborator

@sgomezvillamor sgomezvillamor commented Feb 27, 2026

Summary

Syncing 24 new commits from upstream datahub-project/datahub:master into the Acryl fork.

Changes Included

Key upstream changes:

  • BigQuery: Added convert_column_urns_to_lowercase flag
  • Vertex AI: Major code quality improvements and refactoring
  • Snowflake: Handle 2026_01 BCR property format change in DDL lineage
  • Oracle: Improved geospatial and XMLTYPE column recognition
  • Sigma: Added workbook filtering capabilities
  • Elasticsearch/OpenSearch: Index builder retry logic and fixes
  • CI/metrics: Workflow metrics collection scripts
  • Various dependency updates and bug fixes

Conflict Resolution

  • .github/workflows/docker-unified.yml: Preserved Acryl-specific workflow trigger configuration (manual dispatch only) to prevent OSS quickstart instability as per existing warnings in the file

Testing

  • All merge conflicts resolved
  • Code formatting applied (GitHub Actions YAML)
  • Local testing recommended before merge

🤖 Generated with Claude Code

devashish2203 and others added 25 commits February 26, 2026 13:08
@devashish2203
fix(ci): Update paths to coverage reports (datahub-project#16359)
6253c40
@sgomezvillamor
docs(snowflake): improve docs about requirements on ACCOUNT_USAGE (da…
10d09c0 
…tahub-project#16347)
@sgomezvillamor
test(ingestion): fix (or mitigate) flakiness of sql parser aggregator…
e4df389 
… perf tests (datahub-project#16360)
@shirshanka
docs: update README to reflect latest developments (datahub-project#1…
45e9575 
…6364)
@acrylJonny
refactor(ingest/vertexai): Major code quality improvements and commen…
80d41c2 
…t cleanup (datahub-project#16176)

Comprehensive refactoring of the Vertex AI connector to improve code quality, maintainability, and consistency with DataHub best practices. This PR addresses multiple code quality issues including DRY violations, magic strings, redundant comments, type safety, and test maintainability.
@kyungsoo-datahub
fix(test): drop 100-query config from CI perf benchmark (datahub-proj…
3437059 
…ect#16354)
@annadoesdesign
fix(views): align entity types across View builder tabs and pass sear…
a7ac28a 
…ch facets to filters (datahub-project#16352)

Co-authored-by: Anna Everhart <anna.everhart@datahub.com>
@max-datahub
fix(snowflake): handle Snowflake 2026_01 BCR property format change i…
5fd49f6 
…n DDL lineage (datahub-project#16363)
@acrylJonny
chore(ingestion/vertex-ai): updating capabilities of vertexai (datahu…
3aa04f5 
…b-project#16367)
@dependabot
build(deps): bump swiper from 11.1.4 to 12.1.2 in /docs-website (data…
147f5c1 
…hub-project#16289)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore(deps): bump basic-ftp from 5.0.5 to 5.2.0 in /docs-website (dat…
163a781 
…ahub-project#16353)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
build(deps): bump aquasecurity/trivy-action from 0.33.1 to 0.34.0 in …
d2aa917 
…/.github/workflows (datahub-project#16260)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore(deps): bump webpack from 5.94.0 to 5.105.0 in /docs-website (da…
5751f33 
…tahub-project#16122)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@jjoyce0510
chore(): Update Docs for Ask DataHub, Slack, & More AI-397 (datahub-p…
24448b0 
…roject#16369)

Co-authored-by: John Joyce <john@ip-192-168-1-108.us-west-2.compute.internal>
@acrylJonny
fix(ingestion/oracle): fix geospatial type recognition for SDO_GEOMET…
9d946a7 
…RY columns (datahub-project#16361)
@david-leifker
chore(): bump aircompressor (datahub-project#16370)
b4068fb
@acrylJonny
feat(ingestion/oracle): recognize XMLTYPE and geospatial columns inst…
154b1bc 
…ead of falling back to NullType (datahub-project#16366)
@david-leifker
feat(metadata-io): reindex retry, createIndex retry, and ES7 test fix…
06b4e06 
…es (datahub-project#16355)
@devashish2203
ci(metrics): Add scripts to collect workflow metrics (datahub-project…
c7a4fdc 
…#16371)
@devashish2203
ci(metrics): Fix Post workflow actions - Correct artifact path (datah…
8ffc46a 
…ub-project#16377)
@alisa-aylward-toast
feat(ingestion/Sigma): Allowing workbook filtering in addition to wor…
e068f4e 
…kspace filtering (datahub-project#16303)
@acrylJonny
fix(ingestion/oracle): replace freezegun with time_machine in integra…
f7eec06 
…tion tests (datahub-project#16362)
@devashish2203
ci(metrics): Add workflow dispatch action for testing (datahub-projec…
5a56f7c 
…t#16379)
@sgomezvillamor
feat(bigquery): adds convert_column_urns_to_lowercase flag (datahub-p…
f1fc6da 
…roject#13232)
@sgomezvillamor @claude
Merge upstream master to sync fork
5b6bfec 
Syncing 24 new commits from datahub-project/datahub:master into acryldata fork.

Conflict resolution:
- .github/workflows/docker-unified.yml: Preserved Acryl-specific workflow trigger
  configuration (workflow_dispatch only) to prevent OSS quickstart instability

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@codecov
Copy link
Copy Markdown

codecov Bot commented Feb 27, 2026 •
edited
Loading

Codecov Report

❌ Patch coverage is 85.42906% with 343 lines in your changes missing coverage. Please review.
✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
...estion/source/vertexai/vertexai_model_extractor.py 71.03% 73 Missing ⚠️
.../src/datahub/ingestion/source/vertexai/vertexai.py 79.31% 36 Missing ⚠️
...ion/source/vertexai/vertexai_training_extractor.py 83.25% 36 Missing ⚠️
...ion/source/vertexai/vertexai_pipeline_extractor.py 86.85% 33 Missing ⚠️
...atahub/ingestion/source/vertexai/vertexai_utils.py 65.00% 28 Missing ⚠️
...ion/source/vertexai/vertexai_ml_metadata_helper.py 82.69% 27 Missing ⚠️
...ahub/ingestion/source/vertexai/vertexai_builder.py 89.84% 26 Missing ⚠️
...rch/elasticsearch/indexbuilder/ESIndexBuilder.java 78.72% 10 Missing and 10 partials ⚠️
...lasticsearch/client/shim/SearchClientShimUtil.java 20.00% 13 Missing and 3 partials ⚠️
...n/source/vertexai/vertexai_experiment_extractor.py 91.37% 15 Missing ⚠️
... and 9 more

📢 Thoughts on this report? Let us know!

@sgomezvillamor sgomezvillamor merged commit e88afde into master Feb 27, 2026
64 of 65 checks passed
@codecov
Copy link
Copy Markdown

codecov Bot commented Feb 27, 2026 •
edited
Loading

Bundle Report

Changes will increase total bundle size by 493 bytes (0.0%) ⬆️. This is within the configured threshold ✅

Detailed changes
Bundle name Size Change
datahub-react-web-esm 29.59MB 493 bytes (0.0%) ⬆️

Affected Assets, Files, and Routes:

view changes for bundle: datahub-react-web-esm

Assets Changed:

Asset Name Size Change Total Size Change (%)
assets/index-*.js 493 bytes 19.41MB 0.0%

Files in assets/index-*.js:

  • ./src/app/entityV2/view/builder/constants.ts → Total Size: 2.16kB

  • ./src/app/homeV3/modules/assetCollection/AssetFilters.tsx → Total Size: 405 bytes

  • ./src/app/entityV2/view/builder/viewBuilderProperties.ts → Total Size: 4.17kB

  • ./src/app/entityV2/view/builder/SelectFilterValuesTab.tsx → Total Size: 5.15kB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@treff7es treff7es treff7es approved these changes

Assignees

No one assigned

Labels

devops docs ingestion product

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.