Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 3 additions & 5 deletions pipelines/filebeat/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,13 +8,11 @@ License: BUSL-1.1
Copyright: (c) 2026 HYPERI PTY LIMITED
-->

# Bundled pipeline: filebeat-compat (INTERIM)
# Bundled pipeline: filebeat-compat (LEGACY)

A pre-canned transform file that keeps DFE 2.1 filebeat feeds working on dfe-transform-vector: the same VRL dfe-transform-vrl runs, wrapped in a Vector `remap` and carrying the enrichment table it needs. Point `transforms.dir` at this directory, mount the table, and the pipeline runs -- there is nothing to author. The modules, the routing rules, the departures from DFE 2.1 and the known limitations are documented once, in dfe-transform-vrl `pipelines/filebeat/README.md`, and apply here unchanged.
A pre-canned transform file that keeps DFE/XDR 2.0 and 2.1 filebeat feeds working on dfe-transform-vector: the same VRL dfe-transform-vrl runs, wrapped in a Vector `remap` and carrying the enrichment table it needs. Point `transforms.dir` at this directory, mount the table, and the pipeline runs -- there is nothing to author. The modules, the routing rules, the departures from DFE 2.1 and the known limitations are documented once, in dfe-transform-vrl `pipelines/filebeat/README.md`, and apply here unchanged.

> **INTERIM.** Elastic compatibility is being replaced by
> `dfe-transform-elastic` (Rust-native). New integrations
> should NOT build on this pipeline.
> **LEGACY.** Backwards compatibility for DFE/XDR 2.0 and 2.1 filebeat feeds, frozen at the Cisco IOS, Meraki and Umbrella modules. It takes no new modules and fetches nothing from Elastic at build, test or run time. New feeds use `dfe-transform-elastic`, and 2.0 and 2.1 feeds should plan to move there.

## Using it

Expand Down
9 changes: 4 additions & 5 deletions pipelines/filebeat/filebeat.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ transforms:
- dfe_source
source: |
##############################################################################
# dfe-transform-vrl bundled pipeline: filebeat-compat -- INTERIM
# dfe-transform-vrl bundled pipeline: filebeat-compat -- LEGACY
#
# Single-file port of the DFE 2.1 Vector filebeat transform templates
# (dfe-vector-templates src/core_templates 14x family):
Expand All @@ -56,10 +56,9 @@ transforms:
# umbrella templates differed only in the hardcoded .log.file.path seed;
# they collapse to one body driven by the detected log type.
#
# INTERIM: this pipeline keeps DFE 2.1 filebeat feeds working on
# dfe-transform-vrl. Elastic compatibility is being replaced by
# dfe-transform-elastic (Rust-native), and new integrations should NOT
# build on this file.
# LEGACY: backwards compatibility for DFE/XDR 2.0 and 2.1 filebeat feeds
# on dfe-transform-vrl, frozen at these three modules. New feeds use
# dfe-transform-elastic.
#
# Deliberate departures from the 2.1 templates:
# - geoip enrichment is NOT ported: dfe-loader owns geoip enrichment in
Expand Down
Loading