Skip to content

ci: raise Security Audit job timeout from 5 to 15 minutes - #3616

Merged
PetrefiedThunder merged 2 commits into
mainfrom
gemini/security-audit-timeout
Oct 28, 2026
Merged

PetrefiedThunder merged 2 commits into
mainfrom
gemini/security-audit-timeout

Conversation

@PetrefiedThunder

@PetrefiedThunder PetrefiedThunder commented Oct 26, 2026 •

Copy link
Copy Markdown
Collaborator

Raises the security job (Security Audit ) in .github/workflows/backend-ci.yml from timeout-minutes: 5 to 15.

Evidence

  • test(admin): replace invented facility/TLC values with data-free placeholders #3599: Security Audit admin, job 121116876211 in run 40176059711, was cancelled at the 5-minute limit ("The job has exceeded the maximum execution time of 5m0s"). Every step succeeded and pip-audit printed "No known vulnerabilities found". The cancellation failed Backend CI Status Gate, which then failed PR Gate: Backend.
  • Job timeline (UTC): queued 08:17:56, started 08:56:13, pip-audit done 08:56:52, then "Cleaning up orphan processes" until the timeout at 09:01:58. The real work took about 40 s; the rest was the runner hanging after cleanup.

Choosing the value

Data comes from the Security Audit jobs in the last 40 backend-ci runs (240 jobs, Oct 25 02:30 to Oct 26 00:31 PT):

  • 168 successful jobs: run time p50 0.67 min, p90 0.83, p99 1.02, max 1.32. None took more than 3 minutes.
  • Queue time: p50 7.6 min, p90 21.6, max 35. timeout-minutes only counts time after the job starts, so queue backlog doesn't count toward it and isn't a reason to raise the limit.
  • 15 minutes is about 11x the slowest successful run. That leaves room for a slow runner or cleanup like test(admin): replace invented facility/TLC values with data-free placeholders #3599's, and still stops a truly hung job well before the 40 to 55 minute backend gate wait. A 20 to 30 minute limit wouldn't help normal runs, and it would let a stuck job hold a runner longer.

Note

Low Risk
Workflow-only timeout tweak; no application, security scan logic, or dependency changes.

Overview
Raises the Security Audit matrix job timeout in backend-ci.yml from 5 to 15 minutes and documents why: pip-audit usually finishes in about a minute, but a run in #3599 passed the audit then hung during GitHub Actions post-job cleanup until the old limit cancelled the job and failed the backend status gate.

Fifteen minutes is headroom for slow cleanup or runners without changing what the step actually audits.

Reviewed by Cursor Bugbot for commit a5a6e00. Bugbot is set up for automated code reviews on this repo. Configure here.

@vercel

vercel Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
regengine Ready Ready Preview Oct 28, 2026 11:10am UTC

Request Review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review 🔄 Running since 2026-10-26T07:36:15.734641Z a5a6e00 PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@coderabbitai

coderabbitai Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

Important

Review skipped

Review was skipped as selected files did not have any reviewable changes.

Run configuration
Commits

Reviewing files that changed from the base of the PR and between a5a6e00 and b0369b2.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

No actionable comments were generated in the recent review.

Recent review info
Run configuration
Commits

Reviewing files that changed from the base of the PR and between 33457f6 and a5a6e00.

Files selected for processing: 1
  • .github/workflows/backend-ci.yml

Included review availability: This review used your included allowance. Your plan provides up to 10 included reviews per hour; 4 remain after this review.

Walkthrough

The security job timeout increases from 5 to 15 minutes. A comment attributes the change to pip-audit runtime and runner post-job cleanup delays.

Priority: Normal

Estimated code review effort: 1 (Trivial) | ~3 minutes

Merge Risk: Minimal · previous review a5a6e

The bounded timeout increase addresses cleanup delays without introducing an identified merge-blocking risk.

Architecture risk: Low · up to a5a6e

The changed surface does not map to a changed system, dependency edge, entrypoint, or external dependency.

Changed systems: None identified.

Architecture concerns
No architecture-level concerns identified.

Review details

Before / after behavior

  • observed — Modified behavior in .github/workflows/backend-ci.yml: The security job timeout changes from 5 to 15 minutes; a comment notes pip-audit runtime and runner cleanup delays.
Pre-merge checks: Passed 4 · Failed 1

Failed Failed checks: 1 warning

Check name Status Explanation Resolution
Description check Warning The description explains the change and provides supporting evidence, but it omits the required Type of Change, Test Plan, Checklist, and Related Issues sections from the repository template. Update the description to include all template sections. Mark the applicable change type, document the test plan or select N/A for the configuration-only change, complete the checklist, and state related issues or indicate that none apply.
Passed Passed checks: 4 passed
Check name Status Explanation
Title check Passed The title clearly and concisely describes the main change: increasing the Security Audit job timeout from 5 to 15 minutes.
Docstring Coverage Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Full details: Docstring Coverage

Explanation

No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0 files. (1 skipped: 1 unsupported.)

Finishing Touches
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

@PetrefiedThunder PetrefiedThunder left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Diff is a single change in .github/workflows/backend-ci.yml: Security Audit timeout-minutes 5 -> 15, plus one explanatory comment line. Nothing else touched. Evidence verified: run 40176059711, Security Audit admin ran 08:56:13Z-09:01:58Z (~5m45s), every step including Run pip-audit and Complete job succeeded, yet job conclusion is cancelled, consistent with the 5-min timeout. Sibling audit jobs took 34-42s, so 15 min is generous headroom without masking real hangs for long.

REVIEW: PASS codex a5a6e00

@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

PR Blocker Checklist

Head SHA: b0369b221a071d0748f56c4f468a3dd0b8c0033b

Status: Ready

  • All review threads resolved
  • No reviews requesting changes
  • No blocked review engines

@github-actions github-actions Bot added ci agent:infra Issues found by Bot-Infra agent labels Oct 26, 2026

@PetrefiedThunder PetrefiedThunder left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Full review @ b0369b2

Authorship: branch gemini/security-audit-timeout; commits by Christopher Sellers; no Codex / VS Code Codex trail. Reviewable by codex.

Scope: .github/workflows/backend-ci.yml only (origin/main...HEAD: +2/-1). Raises security (Security Audit ${{ matrix.service }}) timeout-minutes from 5 → 15 with a comment citing #3599 / run 40176059711.

Remerge-diff

HEAD is behind current origin/main (cbe7bcb6a). Fresh git merge --no-commit --no-ff origin/main merged cleanly; backend-ci.yml stayed at the tip's 15-minute value with no conflict. Unrelated main files updated as expected.

Blocking findings

None.

Evidence check (real data)

Job 121116876211 (Security Audit admin on run 40176059711): started_at 2026-10-25T08:56:13Z, completed_at 2026-10-25T09:01:58Z (~345s), conclusion: cancelled. Every step including Run pip-audit and Complete job succeeded by 08:56:52Z; the cancel landed after the work finished — consistent with a post-job hang under the old 5-minute limit. Main still has timeout-minutes: 5 on this job.

What was checked

  • Diff is only the security-job timeout + comment; pip-audit steps, ignores, matrix, and status-gate needs.security wiring are unchanged.
  • 15 minutes matches other longish backend-ci jobs (docker-build, ingestion-full-suite, etc.) and does not weaken the audit itself.
  • No synthetic/sample data introduced. Comment references a real run id.

Non-blocking

  • Branch is behind main; remerge was clean but the PR still needs a main update before merge gates that require an up-to-date branch.
  • frontend-ci.yml still has its own Security Audit at 5 minutes — out of scope here; only backend-ci failed in the cited #3599 incident.

REVIEW: PASS codex b0369b2

@PetrefiedThunder
PetrefiedThunder merged commit 84ffe38 into main Oct 28, 2026
82 of 88 checks passed
@PetrefiedThunder
PetrefiedThunder deleted the gemini/security-audit-timeout branch October 28, 2026 13:31

This branch was successfully deployed

1 active deployment
Preview — b0369b22 Deployed Oct 28, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

agent:infra Issues found by Bot-Infra agent ci

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant