Quickstart (development):
- Create and activate a Python virtualenv:
python -m venv .venv
source .venv/Scripts/activate # Windows- Install dependencies:
pip install -r requirements.txt
python -m playwright install- Run the API (development):
uvicorn app.main:app --reload --port 8000Notes:
- Playwright scrapers open a real browser window by default (
headless=False) so you can solve CAPTCHAs if encountered. - The repo currently includes a Walmart scraper at
walmart2.py. The API skeleton is minimal and will later call the scrapers.