Author: Constantine (Kostyantyn) Gurnov Org: Hyperscale.AI Version: 0.1 May 2, 2026
A minimal stateful queue primitive for reliable AI systems.
This project demonstrates how AI-enabled workflows can separate probabilistic processing from deterministic state control using PostgreSQL, explicit state transitions, and append-only event history.
The queue does not eliminate uncertainty; it decomposes uncertainty into observable work units.
Implemented:
- Dockerized PostgreSQL
- Queue item schema
- Queue event schema
- Initial sample queue item
- Traceable / auditable persistence layer
Next:
- Notebook-based transition logic
- Basic metrics
- Minimal FastAPI wrapper
The queue provides a deterministic control surface around work items moving through AI-assisted workflows.
It supports:
- traceability
- auditability
- observability
- recoverability
- idempotent processing patterns
The LLM or AI agent may propose actions, but the system owns state.
ai-control-queue/
README.md
docker-compose.yml
requirements.txt
sql/
001_schema.sql
notebooks/
analysis.ipynb
docs/
Whitepaper-Stateful-Queues-for-Reliable-AI-Systems.md
src/
app.py
Dockerfile
data/
cd ai-control-queuepython3 -m venv .venv
source .venv/bin/activatepip install -r requirements.txtdocker compose up -ddocker psdocker exec -it ai-control-queue-postgres psql -U ai_queue_user -d ai_queueInside psql:
\dtExpected tables:
queue_items
queue_events
Exit:
\qdocker exec -it ai-control-queue-postgres psql -U ai_queue_user -d ai_queueINSERT INTO queue_items (source, raw_data, state)
VALUES (
'email',
'{"from": "recruiter@example.com", "subject": "AI Architect Role"}',
'INBOUND'
)
RETURNING *;SELECT id, source, state, created_at
FROM queue_items;Stop containers while preserving data:
docker compose downStop containers and delete PostgreSQL volume:
docker compose down -vRemove Python virtual environment:
rm -rf .venvThis setup uses a Docker named volume:
postgres_data:/var/lib/postgresql/dataOn macOS, Docker stores this volume inside Docker Desktop's Linux VM. It is persistent across normal restarts but not directly visible in Finder.
Future extension:
- host bind mounts
- PostgreSQL dumps
- Borg backups
- restore drills
- replica setup
This project currently does not include:
- DAG engine
- workflow orchestration
- authentication
- production deployment
- UI
- backup / restore policy