Skip to content

docs: document CONNECTOR_DISCOVERY_ENABLED for Fusion-only / air-gapped deployments #150

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
antoniocali wants to merge 2 commits into
base: staging
Choose a base branch
from
Open

docs: document CONNECTOR_DISCOVERY_ENABLED for Fusion-only / air-gapped deployments #150

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
53dbafe
Merge pull request #149 from datazip-inc/staging
vikaxsh May 20, 2026
ddeb67c
docs: document CONNECTOR_DISCOVERY_ENABLED for Fusion-only deployments
antoniocali May 22, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions helm/olake/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -321,6 +321,21 @@ When set, **all** container images are automatically prefixed with this registry
> - Pass registry credentials as environment variables under `olakeUI.env` (e.g., `AWS_ACCESS_KEY_ID`, `AWS_SECRET_ACCESS_KEY` for ECR), or
> - Attach the required read-only registry permissions to the IAM role referenced by `global.jobServiceAccount`.

### Disabling Connector Discovery (Fusion-only / Air-gapped)

By default the `olake-ui` server queries the upstream container registry on every `/versions`, `/spec`, and `/test-connection` call to enumerate available CDC connector image tags. In Fusion-only deployments (Iceberg maintenance against an existing catalog, no CDC connectors used) this generates avoidable outbound traffic, log noise, and — when the registry rate-limits or 504s — user-facing slowness in the UI.

Set `CONNECTOR_DISCOVERY_ENABLED: "false"` to skip those registry queries entirely. When discovery is disabled, `DEFAULT_CONNECTOR_VERSION` must be set; it's returned as the single available version for any connector type.

```yaml
olakeUI:
env:
CONNECTOR_DISCOVERY_ENABLED: "false"
DEFAULT_CONNECTOR_VERSION: "v0.3.18"
```

This is also useful in air-gapped clusters where the chart's private-registry mirror does not expose a Docker Registry HTTP API v2 (or where the listing API is intentionally locked down).

## Monitoring and Troubleshooting

### View Logs
Expand Down
8 changes: 8 additions & 0 deletions helm/olake/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -157,6 +157,14 @@ olakeUI:
# env:
# CUSTOM_VAR: "value"
# FEATURE_FLAG: "true"
#
# Fusion-only / air-gapped deployments: disable upstream container registry
# queries used to enumerate CDC connector versions. With discovery off, the
# /versions and /spec endpoints return DEFAULT_CONNECTOR_VERSION directly
# without contacting Docker Hub / ECR / GCR.
# env:
# CONNECTOR_DISCOVERY_ENABLED: "false"
# DEFAULT_CONNECTOR_VERSION: "v0.3.18"
env: {}

# -- Ingress configuration for external access
Expand Down
Loading