v0.5: DIKW-T framework, wisdom synthesis, FTS5 search

[bejranonda]

Summary

• v0.4: adopt DIKW-T framework across platform (inbox/notes/knowledge/wisdom stages, classifier, /api/projects/{slug}/dikw)
• v0.5: wisdom synthesis stub, stage promotion endpoints, persistent FTS5 search per project
• Wire reference/ blueprints (Honcho, Obsidian, Hermes Agent) into project narrative

Test plan

• ./.venv/bin/pytest backend/tests -q
• ./scripts/server.sh start and verify frontend at :8787/
• Hit /api/projects/{slug}/dikw and stage promotion endpoints

🤖 Generated with Claude Code

Summary by CodeRabbit

• New Features

  • Added DIKW-T pipeline with four vault stages: Data (inbox), Information (notes), Knowledge, and Wisdom, with automatic file classification and stage tracking.
  • Promote files between stages with optional metadata.
  • Wisdom synthesis generates summaries from project Git history.
  • Persistent full-text search index for faster, reliable queries.
  • DIKW dashboard displays stage breakdowns and project timeline.

• Documentation

  • DIKW-T framework documentation and architecture updates.
  • Comprehensive quickstart guides for all user roles.

• Tests

  • Added frontend and end-to-end pipeline tests.

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: f1dbe35b-4ffb-4d98-9d69-0ccc6316e62c

📥 Commits

Reviewing files that changed from the base of the PR and between 0350b83 and 72e09c2.

📒 Files selected for processing (29)

• .gitignore
• CLAUDE.md
• README.md
• backend/app/dikw.py
• backend/app/main.py
• backend/app/projects.py
• backend/app/routes/dikw_routes.py
• backend/app/routes/notes_routes.py
• backend/app/routes/stages_routes.py
• backend/app/search.py
• backend/app/watcher.py
• backend/app/wisdom.py
• backend/tests/test_frontend.py
• backend/tests/test_smoke.py
• business/project-overview.md
• docs/approach.md
• docs/architecture.md
• docs/dikw-t.md
• docs/guidelines.md
• docs/hermes-contract.md
• docs/knowledge.md
• docs/known-issues.md
• docs/quickstart-admin.md
• docs/quickstart-manager.md
• docs/quickstart-user.md
• frontend/app.js
• frontend/index.html
• frontend/styles.css
• reference/obsidian-sync-comparison.md

---

📝 Walkthrough

Walkthrough

This PR implements a complete DIKW-T (Data-Information-Knowledge-Wisdom-Time) framework for organizing vault files into four stages, adds persistent SQLite FTS5 search, implements Git-history-based wisdom synthesis, and exposes stage analysis, promotion, and synthesis via new API endpoints and frontend dashboard UI.

Changes

DIKW-T Framework & Implementation

Layer / File(s)	Summary
Conceptual Framework & Business Alignment docs/dikw-t.md, docs/architecture.md, business/project-overview.md	Defines DIKW-T pyramid (Data→Information→Knowledge→Wisdom+Time), maps stages to vault folders (inbox/, notes/, knowledge/, wisdom/), documents API contract for /api/projects/{slug}/dikw, and aligns business objectives to stage-based organization.
DIKW Classifier Implementation backend/app/dikw.py	Implements classify(rel_path, body) for stage classification based on folder location and content structure (frontmatter/wikilinks/hashtags), and summarise(vault_dir) for per-vault stage counts and Git-derived commit statistics.
Project Directory & Vault Structure backend/app/projects.py, .gitignore	Adds wisdom_dir property, ensures wisdom/ folder created on project init, updates default Git README to DIKW-T description, and ignores .ckp/ cache.
SQLite FTS5 Search Persistence backend/app/search.py	Replaces in-memory index with per-vault SQLite FTS5 stored at .ckp/search.db, WAL mode for concurrent reads, per-vault locking for writes, and BM25 scoring with title weighting.
Git-History-Based Wisdom Synthesis backend/app/wisdom.py	Implements synthesise_project() to generate deterministic wisdom notes by analyzing knowledge/ file Git history, extracting commit chains (hash/timestamp/author), and writing evolution reports to wisdom/.
DIKW & Stage Transition API Routes backend/app/routes/dikw_routes.py, backend/app/routes/stages_routes.py, backend/app/main.py	Adds /api/projects/{slug}/dikw for stage breakdown, /api/projects/{slug}/promote for inbox→notes promotion with YAML frontmatter, /api/projects/{slug}/wisdom/synthesise for wisdom generation.
Notes Route & Filesystem Watcher Integration backend/app/routes/notes_routes.py, backend/app/watcher.py	Integrates DIKW classification into /api/projects/{slug}/tree (adds stage field per file) and watcher event handler (computes stage and emits with versioning/events).
Frontend DIKW Dashboard & Promotion UI frontend/app.js, frontend/index.html, frontend/styles.css	Adds DIKW view with stage cards (counts/percentages) and time-axis summary, file tree stage pills, promote-note button for inbox→notes with tag input, and wisdom-synthesis button.
Backend & Frontend Tests backend/tests/test_frontend.py, backend/tests/test_smoke.py	Adds frontend smoke tests for asset serving/syntax validation and end-to-end DIKW tests: summary API, tree stages, inbox promotion, wisdom synthesis.
Documentation, Guidelines & Project Overview README.md, CLAUDE.md, docs/approach.md, docs/guidelines.md, docs/hermes-contract.md, docs/knowledge.md, docs/quickstart-*.md, docs/known-issues.md, reference/obsidian-sync-comparison.md (deleted)	Comprehensive updates: framework specification, implementation details, stage-promotion role, DIKW mental model in development workflow, change-management rules requiring stage declaration, and updated quickstarts for users/managers/admins.

Estimated code review effort

🎯 4 (Complex) | ⏱️ ~45 minutes

---

A rabbit hops through the vault with glee,
Data, Info, Knowledge, Wisdom—four stages flow free!
Git remembers each change with time's watchful eye, 🕐
While SQLite indexes whisper search replies. 🔍
The wisdom emerges from history's tale, ✨
A DIKW-T framework that shall not fail! 🐇

✨ Finishing Touches

📝 Generate docstrings

• Create stacked PR
• Commit on current branch

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch DIKW-T-Framework

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}