Skip to content

warehouse_forklift_routing: TIME_LIMIT = 60 kills inputs within the stated 30 s per test case #47

Closed as not planned

Description

@findalexli

Task

warehouse_forklift_routing

Claim

The instruction gives "T=5 test cases per input" and "30 seconds per test case", but TIME_LIMIT = 60 kills an input at 60 s, and any timeout makes the total inf. This is Known issue 2. The README also calls the 50 inputs "test cases", so the limit has two readings.

Impact

A solver using more than 60 s per input gets no score: a real solver edited to a 125 s deadline gets 0 of 50 OK. We know of no real submission that does this: an Opus 5.5 run chose 20 s per input and noted the ambiguity.

Evidence and how to reproduce

Set a solver's own per-input deadline above 60 s and grade with tools/judge_local.py: valid: false, 0 of 50 OK.

Proposed fix

Draft PR: #38.

Activity

  1. findalexli commented on Nov 6, 2026

    @findalexli
    ContributorAuthor

    Closing with #38, for the same reason: no real submission we checked is killed by the 60 s limit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions