Skip to content

Add SAF detection coverage registry - #227

Merged
fkautz merged 1 commit into
secure-agentic-framework:mainfrom
fkautz:codex/detection-coverage-registry
Sep 2, 2026
Merged

fkautz merged 1 commit into
secure-agentic-framework:mainfrom
fkautz:codex/detection-coverage-registry

Conversation

@fkautz

@fkautz fkautz commented Sep 2, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add a canonical detection mapping registry for all 80 active Framework Model v2 techniques
  • classify native analytics by normalized observation modality and conservatively mark all current mappings as partial
  • generate a human-readable coverage matrix that keeps semantic mapping, validation maturity, and external ownership separate
  • add an external provider contract and record the existing Agent Threat Rules mapping as pending reconciliation rather than verified coverage
  • validate active/deprecated lifecycle, rule and fixture links, provider metadata, external mapping status, and generated output in CI
  • replace the stale hand-maintained mitigation table with a generated 51-document catalog, removing broken nonexistent entries including SAF-M-44

Current findings

  • 80/80 active techniques have a native fixture-tested analytic
  • 0 native mappings are represented as production-effective or complete; all 80 are classified as partial
  • static analysis is the only normalized modality with zero native mappings
  • 0 external rules are counted as validated until current rule IDs and current SAF targets are reconciled

Validation

  • python3 -m unittest discover -s scripts -p "test_*.py"
  • python3 scripts/validate-technique-research.py --all
  • python3 scripts/validate-framework-model.py
  • python3 scripts/generate-technique-catalog.py --check
  • python3 scripts/validate-detection-registry.py
  • python3 scripts/generate-detection-coverage.py --check
  • python3 scripts/generate-mitigation-catalog.py --check

Closes #207.
Addresses #221, #188, #189, and #222.

Signed-off-by: Frederick F. Kautz IV <fkautz@alumni.cmu.edu>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add detections/ registry for stable cross-project rule-ID linkage

1 participant