Skip to content

feat: expand built-in log format library #58

Description

@mpryor

Summary

Expand the built-in log format library from 19 formats to cover more common log sources.

Problem

nless currently auto-detects 19 log formats. lnav ships with 70+. More built-in formats means more "it just works" moments where users pipe in logs and get instant columnar parsing.

Candidate formats to add

  • Databases: MySQL slow query, PostgreSQL, Redis, MongoDB
  • Web servers: Caddy, HAProxy, AWS ALB/ELB
  • Cloud: AWS CloudTrail, GCP audit logs
  • Containers: Docker daemon logs, containerd
  • CI/CD: GitHub Actions, Jenkins
  • Languages: Java (log4j2 patterns), Rust tracing, Go structured logging (zerolog, zap)
  • System: journald, macOS unified logging, Windows Event Log (exported)
  • Network: Bro/Zeek TSV

Technical Considerations

  • Each format is a named regex with capture groups in logformats.py
  • Priority scoring ensures the most specific format wins
  • Community contributions welcome — format definitions are self-contained
  • Consider supporting a user-contributed format registry

Related

  • Existing formats defined in nless/logformats.py
  • P key for manual log format selection

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions