Skip to content

Add real-time NewsLens search and ingestion platform - #46

Merged
triasha72 merged 1 commit into
mainfrom
feat/realtime-search-platform
Aug 23, 2026
Merged

triasha72 merged 1 commit into
mainfrom
feat/realtime-search-platform

Conversation

@triasha72

Copy link
Copy Markdown
Owner

What changed

  • adds a Go ingestion API and two-member Kafka consumer group with keyed ordering, retry, dead-letter handling, and PostgreSQL idempotency
  • adds FastAPI query understanding and transparent freshness-aware ranking
  • adds Docker Compose, Prometheus, health checks, recovery/load/DLQ/ordering probes, and machine-readable local evidence
  • extends the Docker Desktop Kubernetes evidence with HPA, ingress, disruption, and NetworkPolicy results
  • rewrites the README, architecture, operations, API, deployment, decision, and roadmap documentation around what was built, why, how, and where the evidence stops

Verification

  • full Python test suite passed
  • Ruff passed
  • Go tests and vet passed
  • Docker Compose configuration passed
  • 500/500 events accepted in the saved local run; 44 ms publish p99 and 79 ms sampled produced-to-indexed p95
  • duplicate replay, stale-update ordering, dead-letter, targeted consumer recovery, and backlog recovery probes passed

Evidence boundary

The runtime measurements come from a single Docker Desktop host with one Kafka broker and one PostgreSQL instance. They are local implementation evidence, not a production capacity or multi-zone availability claim.

@triasha72
triasha72 force-pushed the feat/realtime-search-platform branch from 0e6aa92 to 36ece7f Compare August 23, 2026 20:46
@triasha72
triasha72 merged commit 0c34282 into main Aug 23, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant