Skip to content

Enhance EP demo runtime configuration - #59

Open
01Chen wants to merge 1 commit into
LingquLab:mainfrom
01Chen:ep_demo_engineering
Open

Enhance EP demo runtime configuration#59
01Chen wants to merge 1 commit into
LingquLab:mainfrom
01Chen:ep_demo_engineering

Conversation

@01Chen

@01Chen 01Chen commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Make the EP dispatch demo use runtime shape configuration for bs, h, and topK instead of fixed constants.
  • Add demo modes for dispatch-combine, dispatch-only, and combine-only, including seeded combine-only inputs and separate dispatch/combine validation output.
  • Extend the local demo runner to forward named options such as --bs, --h, --k, --mode, TP, shared expert, active mask, and quantization settings while preserving the existing positional form.
  • Add source checks covering runtime shape config, combine-only mode, and runner named arguments.

Validation

  • git diff --check -- tests/ep/demo/run_tilexr_ep_dispatch_demo.sh tests/ep/demo/tilexr_ep_dispatch_demo.cpp tests/ep/unit/test_tilexr_ep_kernel_sources.cpp
  • bash -n tests/ep/demo/run_tilexr_ep_dispatch_demo.sh
  • g++ -std=c++14 tests/ep/unit/test_tilexr_ep_kernel_sources.cpp and ran the resulting source-check binary

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant