Skip to content

Smoke test failure on production #1007

Description

@github-actions

Daily production smoke test failed.

Run: https://github.com/ksimback/hermes-ecosystem/actions/runs/34596183338


Hermes Atlas smoke test
  base: https://hermesatlas.com
  repos.json entries: 249
  sample size: 25 (plus all entries newer than 14d in repos.json if dated)

1. Critical pages return 2xx
  PASS  / - HTTP 200
  PASS  /ecosystem/ - HTTP 200
  PASS  /guide/ - HTTP 200
  PASS  /lists/ - HTTP 200
  PASS  /skills/ - HTTP 200
  PASS  /use-cases/ - HTTP 200
  PASS  /reports/ - HTTP 200
  PASS  /privacy/ - HTTP 200
  PASS  /sitemap.xml - HTTP 200
  PASS  /rss.xml - HTTP 200
  PASS  /robots.txt - HTTP 200
  (592ms)

2. Public API contracts are semantically healthy
  PASS  Ask the Atlas - HTTP 200, non-empty response
  PASS  use-case bundle injection - matched hermes-in-your-pocket, agent-that-browses-the-web
  PASS  latest release freshness - v0.21.1 (v2026.9.7)
  FAIL  stars freshness - expected fresh complete 249-repo snapshot; got 249 repos, stale=false, complete=false
  PASS  stars history - 7 snapshot days, fresh
  PASS  OG image - HTTP 200, image/png, 28475 bytes
  PASS  OG image (Twitterbot) - HTTP 200, image/png, 28475 bytes
  (13390ms)

3. Generated discovery artifacts are current
  PASS  sitemap freshness - latest lastmod 2026-09-11
  PASS  llms.txt freshness - states 249-project catalog
  (189ms)

4. /ecosystem/ category counts match data/repos.json
  PASS  Core & Official count - 5
  PASS  Workspaces & GUIs count - 24
  PASS  Skills & Skill Registries count - 48
  PASS  Memory & Context count - 37
  PASS  Plugins & Extensions count - 44
  PASS  Multi-Agent & Orchestration count - 12
  PASS  Deployment & Infra count - 12
  PASS  Integrations & Bridges count - 13
  PASS  Developer Tools count - 20
  PASS  Domain Applications count - 11
  PASS  Guides & Docs count - 17
  PASS  Forks & Derivatives count - 6
  (45ms)

5. Project pages return 2xx (sample + recent)
  PASS  project pages - 25/25 returned 2xx
  (604ms)

6. Sitemap covers every /projects/<owner>/<repo> in repos.json
  PASS  sitemap coverage - 249/249 project URLs present
  (134ms)

7. RSS feed is well-formed
  PASS  rss.xml - well-formed, 30 items
  (70ms)

8. Sample of internal links from homepage + /ecosystem/ resolve
  PASS  internal links - 25/25 resolved
  (623ms)


Summary
  35 passed, 1 failed

Failures
  X stars freshness: expected fresh complete 249-repo snapshot; got 249 repos, stale=false, complete=false
     https://hermesatlas.com/api/stars

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions