Repository navigation
Feat/observability stack - #151
Merged
Benevanio merged 5 commits intoJun 21, 2026
Merged
Conversation
…h providers - Add trust proxy to Express for correct protocol detection behind nginx - Replace dynamic req.protocol with APP_URL-based callback URL construction - Use dynamic provider param in callback URL to support multiple OAuth providers - Replace openid-client discovery with manual OAuth flow for LinkedIn
…ana e Loki" -m "Implementa observabilidade completa para backend e scraper-go, cobrindo métricas, logs e dashboards. Métricas (Prometheus): - Instrumenta o backend (Express) com prom-client: duração e contagem de requisições HTTP, sessões ativas, buscas de vagas, hit/miss de cache - Instrumenta o scraper-go (client_golang): execuções, duração, vagas encontradas e erros por adapter, além de métricas do pipeline completo - Adiciona exporters para Postgres, Redis/Valkey, host (node-exporter) e containers (cAdvisor) - Expõe /metrics no backend (:3001) e no scraper-go (:8081) Logs (Loki + Promtail): - Substitui ELK (Elasticsearch/Kibana/Filebeat) por Loki/Promtail para reduzir consumo de memória, viabilizando o deploy no VPS (4GB RAM) - Logs estruturados em JSON (Pino/slog) parseados e rotulados por container/service para busca via Grafana Explore - Adiciona middleware de requestId no backend para rastreamento de requisições Dashboards (Grafana): - Provisiona datasources Prometheus e Loki automaticamente - Adiciona 4 dashboards: API Overview, Scraper Health, Infraestrutura e Business Infra: - Adiciona docker-compose.observability.yml como compose separado - Adiciona Alertmanager com rota padrão mínima - Corrige Dockerfile do scraper-go para usar go mod download em vez de vendoring"
…ty-stack # Conflicts: # backend/src/app.ts # backend/src/modules/auth/providers/linkedin.ts # package-lock.json
|
@hltav is attempting to deploy a commit to the Bene Tesla's projects Team on Vercel. A member of the Team first needs to authorize it. |
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
… baseado em APP_URL
This branch was previously deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
O que mudou
Este PR contém duas mudanças relacionadas:
1. Stack de observabilidade (Prometheus, Grafana, Loki)
2. Remoção do vendoring no scraper-go
go mod downloadem vez devendor/scraper-go/vendor/(~147 mil linhas), que não é mais necessário com o novo fluxo de buildA maior parte das 412 arquivos alterados é deleção de arquivos vendorizados de dependências Go (
scraper-go/vendor/) — não é código novo. As mudanças reais de observabilidade estão concentradas em:docker-compose.observability.ymlobservability/**backend/src/metrics/,backend/src/middleware/metrics.ts,backend/src/middleware/requestId.tsbackend/src/app.ts(integração dos middlewares)scraper-go/internal/metrics/scraper-go/internal/pipeline/pipeline.go(instrumentação)scraper-go/cmd/server/server.go(endpoint /metrics)scraper-go/Dockerfile(build sem vendor)Esta branch também inclui um merge de
upstream/developpara resolver divergência de histórico (a branch foi criada antes da integração de OAuth GitHub/Google/LinkedIn ter sido mesclada), o que trouxe commits adicionais que não são de minha autoria.Como testar
docker compose -f docker-compose.infra.yml \ -f docker-compose.yml \ -f docker-compose.observability.yml \ up -dhttp://localhost:3001/metricshttp://localhost:8081/metricshttp://localhost:9091http://localhost:3002(dashboards em "Jobs Scraper Global")