Skip to content

Pranjli-S/distributed-task-queue

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

2 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Distributed Task Queue & Concurrency Monitor

An asynchronous, thread-safe distributed task runner engineered to ingest, allocate, and execute workloads across an isolated background worker thread pool, paired with a real-time tracking dashboard.


πŸš€ Key Features

  • Thread-Safe Concurrency Control: Implements a synchronized FIFO queue architecture in Python to guarantee safe task distribution across multiple background worker threads without race conditions or memory leaks.
  • Fault-Tolerant State Machine: Outfitted with an automated error-interception and contextual retry loop that handles processing drops gracefully, ensuring zero core system crashes even during simulated runtime failures.
  • Real-Time Visual Monitoring: Driven by an optimized HTTP short-polling data lifecycle built into a decoupled React frontend to reflect instantaneous status transitions (Pending β†’ Running β†’ Completed/Retrying).
  • Clean System Sandboxing: Deployed utilizing isolated virtual execution environments (venv) to securely bypass external system package constraints while maintaining a strict boundary between API layers.

πŸ—οΈ System Architecture

    [ React Dashboard (Port 5173) ]
                 β”‚
                 β”‚ (HTTP Short-Polling / JSON)
                 β–Ό
     [ Flask API Gateway (Port 5000) ]
                 β”‚
                 β–Ό  (Thread-Safe Push)
       [ Synchronized FIFO Queue ]
                 β”‚
                 β”œβ”€β”€β”€β”€β”€β”€β”€β–Ά [ Worker Thread 1 ] ──▢ Task Processing Loop
                 β”œβ”€β”€β”€β”€β”€β”€β”€β–Ά [ Worker Thread 2 ] ──▢ Fault/Retry Interception
                 └───────▢ [ Worker Thread 3 ] ──▢ State Updates

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages