Skip to content

feat(multi-stream-multi-model): segment with the registry's YOLO26s-seg - #724

Draft
Yukkta-Seelam wants to merge 1 commit into
developfrom
feat/multi-model-yolo26-seg
Draft

Yukkta-Seelam wants to merge 1 commit into
developfrom
feat/multi-model-yolo26-seg

Conversation

@Yukkta-Seelam

Copy link
Copy Markdown
Contributor

Fixes #723

Summary

The segmentation stream of multi-stream-multi-model ran the Model Zoo's YOLO11s-seg, which the Model Registry does not publish. Stream 1 now runs the registry's yolo26s_seg package, variant w8a16, with decode: yolo26. The app already supports the YOLO26 segmentation head, so neither entrypoint changes. The other three streams keep their Model Zoo packages.

Changes

  • Config. Stream 1 example: decode: yolo26, model: models/yolo26s_seg/w8a16/yolo26s_seg_w8a16_mpk.tar.gz.
  • README. The model table, the download step and the sample output name the registry package. sima-cli models download saves yolo26s_seg_w8a16_default.zip, so the README extracts the .tar.gz from it. The sample profile line is from the run below.
  • Tests. tests/test-scope.yaml fetches yolo26s_seg w8a16 from the registry's main catalog. Both e2e suites and the unit-test configs expect it on stream 1.
  • Variant. w8a16 is the only yolo26s_seg variant on main today. yolo26n_seg (w16a16, w8a16) and yolo26m_seg (w16a16) are also there; s keeps the stream's small model size.

Evidence

Modalix DevKit, Core 0.6.1+develop.f70653154707, branch head faa4510e built natively on the board. Four 1920x1080@30 H.264 RTSP streams from the Insight catalog.

Check Result
scripts/download_models.sh with this example's scope Downloaded yolo26s_seg w8a16 from main and extracted yolo26s_seg_w8a16_mpk.tar.gz
tests/test.sh --cpp --unit --strict and --cpp --e2e --strict PASS
tests/test.sh --python --unit --strict and --python --e2e --strict 74 passed; 2 passed (H.264 and H.265)
600 frames per stream, no debug saving Every stream 30.2 to 30.4 fps in C++ and Python
Segmentation output 12 to 15 instances per frame on the street clip; masks on cars, people and traffic lights in the saved frames
scripts/validate_readmes.py, scripts/generate_catalog.py, tests/scripts/test_scope_contract.py PASS

For the same 300 frames, YOLO11s-seg on stream 1 averaged 11.7 to 12.6 instances per frame at mean confidence 0.49; YOLO26s-seg averaged 12.8 to 12.9 at 0.59 to 0.61.

Not verified

  • Install check. sima-cli neat install apps@feat/multi-model-yolo26-seg and the installed README walkthrough were not run.
  • SDK container build (./build.sh) was not run. The change touches no C++ source except two test tables.

The segmentation stream ran the Model Zoo's YOLO11s-seg, which the
Model Registry does not publish. Stream 1 now runs the registry's
yolo26s_seg w8a16 package with decode: yolo26, a head layout the app
already supports, so neither entrypoint changes. The other three
streams keep their Model Zoo packages.

The README downloads the package with sima-cli models download and
extracts it from the downloaded zip. The test scope fetches it from the
registry's main catalog, and both e2e suites and the unit fixtures
expect it on stream 1.

On the DevKit (Core 0.6.1+develop.f70653154707), with four 1080p30
H.264 streams, download_models.sh fetched the package, the C++ and
Python unit and e2e suites passed with --strict, every stream held
30.2 to 30.4 fps in both languages, and the segmentation stream
averaged 12 to 15 instances per frame.

This branch was successfully deployed

3 active deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant