Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions docs/downloads/reports/Skillspace footage training pipeline.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,23 @@ An explicit supported task source permits export of a runtime-bound simulation c

Installation alone does not enable qualified execution. A separate native test in the exact scene of the held-out recording completes placement in **12.952 simulated seconds with 0.311 mm target error**. Replaying the same joint targets with open jaws fails at the 18-second horizon. This supports the contact-dependent execution path in that scene; it adds no independent scene sample or hardware evidence. Artifact hashes establish which candidate and runtime were tested, not physical accuracy. ([Qualification receipt](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-08-footage-pipeline-v1/qualification/qualification.json), [Native replay](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-08-footage-pipeline-v1/qualification/replay))

## 8 October 2026: frozen sample-count follow-up

A separate follow-up compares nested sets of **two, four and seven whole connected training groups** from the published native simulator recordings, with 1,135, 2,281 and 4,029 aligned action samples respectively. The same two development recordings, one test recording and twelve evaluation layouts remain fixed across conditions. The protocol freezes source, scene, training-code and runtime hashes before fitting; all three movement candidates are fitted, exported and installed before any evaluation scene runs. Each installed candidate uses the existing exact-scene qualification gate, with an identical-target open-jaw control. An authored teacher baseline runs once per scene. ([Benchmark guide](https://github.com/Dvidia-Inference/dvidia-training/blob/main/docs/benchmarks.md), [Frozen protocol](https://github.com/Dvidia-Inference/dvidia-training/blob/main/benchmarks/sample-count-19047/protocol.json))

| Installed candidate or baseline | Nominal completion | Actuator-stress completion |
|---|---:|---:|
| Two training groups | 8/8 | 3/4 |
| Four training groups | 7/8 | 3/4 |
| Seven training groups | 8/8 | 3/4 |
| Authored teacher | 8/8 | 3/4 |

Every successful candidate episode also passes its scene-specific qualification predicate. All **36 open-jaw controls fail**, and the experiment records **zero execution errors**. The failure cases remain in each planned denominator: all three candidates and the teacher fail the same actuator-stress scene, while the four-group candidate also fails one nominal scene. The seven-group candidate's nominal target error is **0.267 mm mean and 0.483 mm maximum**, measured across all eight nominal episodes, which all succeed. These results extend the execution evidence to the frozen layouts without changing the original one-scene pilot. ([Final report and per-scene outcomes](https://github.com/Dvidia-Inference/dvidia-training/blob/main/benchmarks/sample-count-19047/report.json), [Experiment summary](https://github.com/Dvidia-Inference/dvidia-training/blob/main/benchmarks/sample-count-19047/README.md))

The benchmark takes **102.7268 seconds of CPU wall time** on an Apple M5 host with 24 GiB RAM. Its timer includes dependency imports inside the benchmark function, input validation and copies, scene planning, fitting, installation, artifact output and **84 native episodes**: twelve teacher episodes, 36 candidate episodes and 36 controls. Process startup, top-level module imports and final report writing are excluded. Native episode clocks retain their narrower scope; throughput in the report divides total simulated time by total episode wall time. This run establishes neither minimum hardware nor an end-to-end speedup. ([Timing scope and measurements](https://github.com/Dvidia-Inference/dvidia-training/blob/main/benchmarks/sample-count-19047/report.json))

This is a **single composition-order pilot**: increasing the count changes which training groups are included, and the nonmonotonic completion counts do not establish a learning curve or a sufficient demonstration count. All conditions reuse the same twelve distinct scenes; condition-by-scene runs are not independent scenes, and nominal and actuator-stress results remain separate. Layout exclusion checks only the exact object/target positions declared in hash-bound native telemetry, without independent capture attestation or an out-of-distribution claim. The movement head consumes privileged simulator state and aligned numerical actions; the RGB predictor does not control the arm, and phases, targets and gripper logic remain authored. Human-video action recovery and hardware qualification remain unestablished. ([Frozen protocol and limitations](https://github.com/Dvidia-Inference/dvidia-training/blob/main/benchmarks/sample-count-19047/protocol.json))

## The next experiment should measure the missing bridge

The current local path avoids API dependence once its tools and data are installed. Local media decoding restricts FFmpeg protocols, while optional remote intake is explicit. Separate continuous-integration checks passed visual fitting and studio tests on Linux, macOS and Windows with Python 3.12 and 3.13, the optional Linux arm pilot, and an actual Docker example, training run and inspection under `--network none`. The image build required network access; this does not establish installation on a new air-gapped machine or minimum hardware. No GPU scaling, throughput improvement over another implementation or hardware transfer follows from the pilots. The package makes experiments inspectable and repeatable; its scientific value depends on what demonstrations, labels and task environments enter it. ([Passing software checks](https://github.com/Dvidia-Inference/dvidia-training/actions/runs/37740260434), [Source and training guide](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-08-footage-pipeline-v1/release/dvidia-training-v0.1.zip))
Expand Down
Loading
Loading