Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 0 additions & 17 deletions .github/workflows/docker.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,6 @@ on:
branches: [main]
paths:
- 'asap-common/installation/**'
- 'asap-planner/**'
- 'asap-planner-rs/**'
- 'asap-summary-ingest/**'
- 'asap-query-engine/**'
Expand Down Expand Up @@ -70,22 +69,6 @@ jobs:
docker push ghcr.io/projectasap/asap-base:${{ steps.tag.outputs.value }}
docker push ghcr.io/projectasap/asap-base:latest

# --- Planner (Python, depends on base) ---
- name: Build planner image
run: |
docker build \
-t asap-planner:local \
-f asap-planner/Dockerfile \
asap-planner

- name: Push planner image
if: startsWith(github.ref, 'refs/tags/') || github.event_name == 'workflow_dispatch'
run: |
docker tag asap-planner:local ghcr.io/projectasap/asap-planner:${{ steps.tag.outputs.value }}
docker tag asap-planner:local ghcr.io/projectasap/asap-planner:latest
docker push ghcr.io/projectasap/asap-planner:${{ steps.tag.outputs.value }}
docker push ghcr.io/projectasap/asap-planner:latest

# --- Planner RS (Rust) ---
- name: Build and push planner-rs
uses: docker/build-push-action@v6
Expand Down
35 changes: 0 additions & 35 deletions .github/workflows/python.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ on:
paths:
- 'asap-summary-ingest/**'
- 'asap-tools/queriers/prometheus-client/**'
- 'asap-planner/**'
- 'asap-tools/**'
- 'asap-tools/data-sources/prometheus-exporters/**'
- 'asap-tools/execution-utilities/**'
Expand All @@ -17,7 +16,6 @@ on:
paths:
- 'asap-summary-ingest/**'
- 'asap-tools/queriers/prometheus-client/**'
- 'asap-planner/**'
- 'asap-tools/**'
- 'asap-tools/data-sources/prometheus-exporters/**'
- 'asap-tools/execution-utilities/**'
Expand All @@ -35,7 +33,6 @@ jobs:
outputs:
summary_ingest: ${{ steps.filter.outputs.summary_ingest }}
prometheus_client: ${{ steps.filter.outputs.prometheus_client }}
controller: ${{ steps.filter.outputs.controller }}
utilities: ${{ steps.filter.outputs.utilities }}
prometheus_exporters: ${{ steps.filter.outputs.prometheus_exporters }}
execution_utilities: ${{ steps.filter.outputs.execution_utilities }}
Expand All @@ -51,9 +48,6 @@ jobs:
prometheus_client:
- 'asap-tools/queriers/prometheus-client/**'
- 'asap-common/dependencies/py/**'
controller:
- 'asap-planner/**'
- 'asap-common/dependencies/py/**'
utilities:
- 'asap-tools/**'
- 'asap-common/dependencies/py/**'
Expand Down Expand Up @@ -125,35 +119,6 @@ jobs:
working-directory: asap-tools/queriers/prometheus-client
run: mypy .

test-controller:
needs: detect-changes
if: needs.detect-changes.outputs.controller == 'true'
runs-on: ubuntu-latest
strategy:
matrix:
python-version: ["3.8", "3.9", "3.10", "3.11"]
steps:
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v4
with:
python-version: ${{ matrix.python-version }}
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install black==24.8.0 flake8==6.1.0
if [ -f asap-planner/requirements.txt ]; then pip install -r asap-planner/requirements.txt; fi
- name: Check formatting with Black
working-directory: asap-planner
run: black --check --diff .
- name: Lint with flake8
working-directory: asap-planner
run: |
# Stop the build if there are Python syntax errors or undefined names
flake8 . --config=../.flake8 --count --select=E9,F63,F7,F82 --show-source --statistics
# Exit-zero treats all errors as warnings
flake8 . --config=../.flake8 --count --exit-zero --max-complexity=10 --statistics

test-utilities:
needs: detect-changes
if: needs.detect-changes.outputs.utilities == 'true'
Expand Down
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,11 +44,11 @@ ASAPQuery uses **streaming sketches** to:

## Architecture

ASAPQuery has four main components: the **asap-planner** generates sketch configurations from your query workload, **asap-sketch-ingest** deploys streaming pipelines in **Arroyo** that continuously build sketches from live Prometheus metrics, and **asap-query-engine** intercepts PromQL queries and serves them from those pre-computed sketches.
ASAPQuery has four main components: the **asap-planner-rs** generates sketch configurations from your query workload, **asap-sketch-ingest** deploys streaming pipelines in **Arroyo** that continuously build sketches from live Prometheus metrics, and **asap-query-engine** intercepts PromQL queries and serves them from those pre-computed sketches.

### Components

- **[asap-planner](asap-planner/)** - Analyzes a PromQL query workload and auto-generates sketch configurations for asap-sketch-ingest and asap-query-engine
- **[asap-planner-rs](asap-planner-rs/)** - Analyzes a PromQL query workload and auto-generates sketch configurations for asap-sketch-ingest and asap-query-engine
- **[asap-sketch-ingest](asap-sketch-ingest/)** - Deploys Arroyo streaming pipelines that continuously compute and publish sketches from live metrics
- **[arroyo](https://github.com/ProjectASAP/arroyo)** - Fork of the [Arroyo](https://github.com/ArroyoSystems/arroyo) stream processing engine that runs the sketch-building SQL pipelines
- **[asap-query-engine](asap-query-engine/)** - Intercepts incoming PromQL queries and serves them from pre-computed sketches, falling back to Prometheus for unsupported queries
Expand All @@ -57,7 +57,7 @@ ASAPQuery has four main components: the **asap-planner** generates sketch config

```
├── asap-quickstart/ # Self-contained demo (start here!)
├── asap-planner/ # Auto-configuration service
├── asap-planner-rs/ # Auto-configuration service
├── asap-sketch-ingest/ # Arroyo pipeline deployer
└── asap-query-engine/ # Query serving engine
# Note: Arroyo fork lives at https://github.com/ProjectASAP/arroyo
Expand Down
119 changes: 0 additions & 119 deletions asap-planner-rs/tests/comparison/comparator.py

This file was deleted.

146 changes: 0 additions & 146 deletions asap-planner-rs/tests/comparison/master_test_runner.py

This file was deleted.

Loading
Loading