Skip to content

Document local nuPlan closed-loop evaluation - #175

Closed
WCJ-BERT wants to merge 1 commit into
NVlabs:e2e_challengefrom
WCJ-BERT:docs/nuplan-local-evaluation
Closed

WCJ-BERT wants to merge 1 commit into
NVlabs:e2e_challengefrom
WCJ-BERT:docs/nuplan-local-evaluation

Conversation

@WCJ-BERT

@WCJ-BERT WCJ-BERT commented Sep 7, 2026

Copy link
Copy Markdown

Summary

  • make local nuplan track closed-loop evaluation discoverable from the top-level and challenge READMEs
  • document separate one-scene smoke and full navtest workflows
  • standardize +e2e_challenge_nuplan=full as the full local navtest entry point
  • document downloading and extracting all MTGS navtest asset shards
  • surface the NAVSIM-style model adaptation guide and complete sample submissions
  • make local evaluation examples runnable without an unpublished reference bundle
  • add configuration contract tests for the documented PAI and nuPlan commands

@copy-pr-bot

copy-pr-bot Bot commented Sep 7, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

mwatson-nvidia added a commit that referenced this pull request Sep 8, 2026
Supersedes #175.\n\nDocuments local nuPlan/MTGS closed-loop evaluation
and clarifies reference-data availability: PAI ships a bundled reference
set, while nuPlan does not yet have one. It also identifies navtest as
the public local suite, not the private official competition
suite.\n\nThe two commits are intended to be squash-merged.

---------

Co-authored-by: Caojun Wang <wangcaojunsos4@gmail.com>
@mwatson-nvidia

Copy link
Copy Markdown
Collaborator

implemented in pr 178

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants