🚀 DevOps Job Automation Platform

An end-to-end AI-powered job automation system built using FastAPI, Playwright, Docker, and modern DevOps practices.

This platform helps you:

• Discover jobs automatically
• Filter relevant roles
• (Extendable) Generate tailored resumes
• Apply with semi-automation
• Showcase DevOps + Automation skills

---

📌 Table of Contents

• Architecture
• Tech Stack
• Project Structure
• Prerequisites
• Local Setup
• Run with Docker
• API Usage
• Troubleshooting
• CI/CD Pipeline (GitHub Actions)
• Future Enhancements

---

🧱 Architecture

Frontend (Next.js)
        ↓
FastAPI Backend
        ↓
Job Scraper (BeautifulSoup / Playwright)
        ↓
PostgreSQL (future)
        ↓
Redis + Celery (async tasks)

---

🛠️ Tech Stack

Backend

• FastAPI
• Python 3.10
• Celery + Redis

Automation

• BeautifulSoup (current)
• Playwright (recommended upgrade)

Frontend

• Next.js (basic starter)

DevOps

• Docker & Docker Compose
• GitHub Actions (CI/CD)

---

📁 Project Structure

devops-job-automation-platform/
│
├── backend/
│   ├── app/
│   │   ├── main.py
│   │   ├── services/
│   │   │   └── scraper.py
│   │   └── workers/
│   │       └── celery_worker.py
│   └── Dockerfile
│
├── frontend/
│   ├── index.js
│   └── Dockerfile
│
├── docker-compose.yml
└── README.md

---

⚙️ Prerequisites

Make sure you have:

• Docker installed → https://docs.docker.com/get-docker/
• Docker Compose installed
• Git installed

Optional:

• Node.js (for frontend development)
• Python 3.10+

---

🚀 Local Setup (Without Docker)

1. Clone Repo

git clone https://github.com/yourname/devops-job-automation-platform.git
cd devops-job-automation-platform

---

2. Backend Setup

cd backend
pip install fastapi uvicorn requests beautifulsoup4 celery redis

Run backend:

uvicorn app.main:app --reload

---

3. Frontend Setup

cd frontend
npm install
npm run dev

---

🐳 Run with Docker (Recommended)

Start All Services

docker-compose up --build

---

Services

Service	URL
Backend	http://localhost:8000
Frontend	http://localhost:3000

---

🔌 API Usage

Get Jobs

GET /jobs

Example:

curl http://localhost:8000/jobs

Response:

[
  {
    "title": "DevOps Engineer",
    "company": "XYZ Corp"
  }
]

---

⚠️ Troubleshooting

Issue: Port already in use

lsof -i :8000
kill -9 <PID>

---

Issue: Docker build fails

docker system prune -a

---

Issue: Playwright not installed

playwright install

---

🔄 CI/CD Pipeline (GitHub Actions)

📁 Create Workflow File

Create:

.github/workflows/ci.yml

---

🧾 Add This Configuration

name: CI/CD Pipeline

on:
  push:
    branches:
      - main

jobs:
  build:
    runs-on: ubuntu-latest

    services:
      postgres:
        image: postgres:15
        env:
          POSTGRES_USER: jobuser
          POSTGRES_PASSWORD: jobpass
          POSTGRES_DB: jobdb
        ports:
          - 5432:5432

      redis:
        image: redis:7
        ports:
          - 6379:6379

    steps:
    - name: Checkout code
      uses: actions/checkout@v4

    - name: Set up Python
      uses: actions/setup-python@v5
      with:
        python-version: "3.10"

    - name: Install dependencies
      run: |
        cd backend
        pip install fastapi uvicorn requests beautifulsoup4 celery redis

    - name: Run basic test
      run: |
        cd backend
        python -c "import app.main"

    - name: Build Docker images
      run: docker-compose build

---

🚀 Optional: Push Docker Image (Advanced)

Add Docker Hub secrets in GitHub:

• DOCKER_USERNAME
• DOCKER_PASSWORD

Then extend workflow:

- name: Login to Docker Hub
  run: echo "${{ secrets.DOCKER_PASSWORD }}" | docker login -u "${{ secrets.DOCKER_USERNAME }}" --password-stdin

- name: Build & Push
  run: |
    docker build -t ${{ secrets.DOCKER_USERNAME }}/job-agent ./backend
    docker push ${{ secrets.DOCKER_USERNAME }}/job-agent

---

🔐 Security Notes

• Do NOT commit API keys
• Use .env file
• Add .gitignore

---

📈 Future Enhancements

• PostgreSQL integration
• Resume AI engine (OpenAI)
• Playwright-based auto apply
• LinkedIn session handling
• Kubernetes (Rancher deployment)
• Grafana monitoring

---

🤝 Contribution

Feel free to fork and improve.

---

⭐ Support

If this helps you, give it a ⭐ on GitHub.

---