Skip to content

fix(filebeat): drop the pipeline and its vrl checkout - #168

Merged
catinspace-au merged 1 commit into
mainfrom
fix/licence-purge-filebeat
Nov 15, 2026
Merged

catinspace-au merged 1 commit into
mainfrom
fix/licence-purge-filebeat

Conversation

@catinspace-au

Copy link
Copy Markdown
Contributor

The bundled filebeat pipeline translated Elastic integration ingest pipelines. No deployment loads it. dfe-transform-elastic is the supported Elastic-compatible path.

  • Delete pipelines/filebeat/ and its references in the docs and the unit tests.
  • Delete the filebeat e2e test, its case reader and the dfe-transform-vrl sibling checkout in CI.
  • Add e2e::app_kafka. It runs the shipped binary over a shared broker with a transform file written for this repo and five synthetic syslog-style lines.
  • Keep the gitleaks path allowlist for the deleted file, because gitleaks scans history and the file is still in it.

The allowlist entry goes when the history is rewritten.

The bundled filebeat pipeline translated Elastic integration ingest pipelines. No deployment loads it. Remove pipelines/filebeat/, the filebeat e2e test and its case reader, and the dfe-transform-vrl sibling checkout in CI.

e2e::app_kafka still tests the app binary over Kafka. It uses a transform file written for this repo and synthetic syslog-style lines.
@catinspace-au
catinspace-au merged commit 689d977 into main Nov 15, 2026
23 checks passed
@catinspace-au
catinspace-au deleted the fix/licence-purge-filebeat branch November 15, 2026 22:10
catinspace-au added a commit that referenced this pull request Nov 15, 2026
This reverts #168. DFE 2.1 deployments feed filebeat data through this pipeline until they move to dfe-transform-elastic. The e2e test and the dfe-transform-vrl checkout it reads cases.yaml from come back with it.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant