Skip to content

Latest commit

Β 

History

History
30 lines (23 loc) Β· 1.73 KB

File metadata and controls

30 lines (23 loc) Β· 1.73 KB

Distributed Task Queue & Concurrency Monitor

An asynchronous, thread-safe distributed task runner engineered to ingest, allocate, and execute workloads across an isolated background worker thread pool, paired with a real-time tracking dashboard.


πŸš€ Key Features

  • Thread-Safe Concurrency Control: Implements a synchronized FIFO queue architecture in Python to guarantee safe task distribution across multiple background worker threads without race conditions or memory leaks.
  • Fault-Tolerant State Machine: Outfitted with an automated error-interception and contextual retry loop that handles processing drops gracefully, ensuring zero core system crashes even during simulated runtime failures.
  • Real-Time Visual Monitoring: Driven by an optimized HTTP short-polling data lifecycle built into a decoupled React frontend to reflect instantaneous status transitions (Pending β†’ Running β†’ Completed/Retrying).
  • Clean System Sandboxing: Deployed utilizing isolated virtual execution environments (venv) to securely bypass external system package constraints while maintaining a strict boundary between API layers.

πŸ—οΈ System Architecture

    [ React Dashboard (Port 5173) ]
                 β”‚
                 β”‚ (HTTP Short-Polling / JSON)
                 β–Ό
     [ Flask API Gateway (Port 5000) ]
                 β”‚
                 β–Ό  (Thread-Safe Push)
       [ Synchronized FIFO Queue ]
                 β”‚
                 β”œβ”€β”€β”€β”€β”€β”€β”€β–Ά [ Worker Thread 1 ] ──▢ Task Processing Loop
                 β”œβ”€β”€β”€β”€β”€β”€β”€β–Ά [ Worker Thread 2 ] ──▢ Fault/Retry Interception
                 └───────▢ [ Worker Thread 3 ] ──▢ State Updates