Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,8 @@ All four covers are **AI-generated editorial illustrations**, not footage, measu

## Latest study

[Installing a Skillspace on a simulated arm](reports/Installing%20a%20Skillspace%20on%20a%20simulated%20arm.md) publishes the first public-link-to-execution product path. A local installer binds DVIDIA task metadata to one authored native-contact placement controller. The same controller completes six changed scenes; no-motion and identical arm commands with open jaws each complete 0/6. [Run the local lab, inspect the source or replay the arm](topics/physical-grounding/runs/2026-10-07-skillspace-arm/PRODUCT.md). This virtual box/arm profile has no learned video policy or physical qualification.

[Offline cable training environment](reports/Offline%20cable%20training%20environment.md) publishes the first executable practice-to-pack loop. The selected controller and fixed feedback baseline both completed 10/10 held-out simulated episodes; zero-force and release controls completed 0/10. The selected controller did not outperform the baseline. [Run the source, open its replay or inspect the pack](topics/physical-grounding/runs/2026-10-07-cable-env/README.md). This remains an ideal-attachment, privileged-state CPU simulation prototype.

[Fast accurate robot training simulation](reports/Fast%20accurate%20robot%20training%20simulation.md) translates observation-to-skill research into an offline training-environment design. The published [contact fixture](topics/physical-grounding/runs/2026-10-07-contact-fixture/) contains byte-identical benchmark code and recorded outputs for 54 CPU trials. Contact-force fidelity, deformable calibration, GPU throughput and physical transfer remain separate gates.
Expand Down Expand Up @@ -49,7 +51,7 @@ npm test
python3 -m http.server 8201 --directory docs
```

Open `http://localhost:8201`. Edit report Markdown and `publications.json` for publications; edit topic metadata and bibliographies for questions. `npm run build` generates the topic catalog, seven publication readers, four topic readers, portable downloads, RSS and sitemap. Commit source edits and generated output. The static `docs/` directory supports the custom research subdomain and a subfolder preview through relative links. Validation checks references, safe links, source provenance and deterministic output.
Open `http://localhost:8201`. Edit report Markdown and `publications.json` for publications; edit topic metadata and bibliographies for questions. `npm run build` generates the topic catalog, eight publication readers, four topic readers, portable downloads, RSS and sitemap. Commit source edits and generated output. The static `docs/` directory supports the custom research subdomain and a subfolder preview through relative links. Validation checks references, safe links, source provenance and deterministic output.

The journal lists actual research footprints and distinguishes source reviews, proposed protocols and executed fixtures. DVIDIA is the publisher and `hello@dvidia.org` is the team contact. Individual contributor attribution is intentionally empty pending confirmation; `@IAMMRRIVR` is a general follow link, not an asserted author identity. Raw authenticated research sessions, environment files and private execution paths are excluded from the public archive.

Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# From public skill metadata to a contact-based arm execution

Research note, 7 October 2026. The current bridge makes a narrow part of the proposed skill workflow executable: import a DVIDIA skill envelope, install an explicitly authored local simulation adapter, create a scene, and run an articulated arm. It provides a concrete place to investigate observation-to-simulation-to-skill packaging. It does not yet infer an executable policy, object geometry, material properties, or robot calibration from human video.

The public example is [DVIDIA place_cup](https://dvidia.org/store/dvidia/place_cup), whose metadata is served at [place_cup/skill.json](https://dvidia.org/packs/dvidia/place_cup/skill.json). The recorded 360-byte source is `vdia:0`, version `0.3.0`, with task “Set a cup on the mark.” Its exact-byte SHA-256 is `16b4e1ef0f3799345c1d18ce9f1da83b072863ab00ce30a83424080fb467d4ec`. The envelope declares a demonstration count, recording format and robot identifier; these declarations do not supply trajectories, observations, trained weights, or an evaluated controller. The installation receipt preserves the source bytes, URL, source hash, separate grounding hash, adapter identity and `physical_robot_ready: false`. A later download may differ; its receipt must identify its own bytes.

In the local studio, one click installs the compatible public envelope and binds `contact-pick-place-box-v0` to `dvidia-authored-6dof-parallel-jaw-v0`. A bundled envelope supports installation without fetching the public site. JSON upload/drop accepts the supported DVIDIA formats. Missing grounding is supplied through a visible, locally authored adapter; inline grounding remains separately validated. Installation downloads metadata and executes the already installed local controller. Object and target coordinates belong to the scene and can change between executions. The browser displays recorded native simulation poses rather than inventing an object trajectory. Execution and replay are designed to work with installed dependencies and local assets; the broader product's air-gapped deployment remains a separate validation task.

The embodiment is an original six-hinge arm with two actuated sliding jaws. Native MuJoCo 3.15.0 simulates a free rigid box, gravity and jaw/object/table contact. The default proxy is a 40 mm cube weighing 40 g on a table at 0.29 m. No weld, mocap attachment, or object-state update carries the object during execution. Arm controls use bounded position servos, model-based bias compensation and current-state damped Jacobian control. The declared limits are 40 N·m per arm actuator and 15 N per jaw. Physics uses a 1 ms timestep, implicitfast integration, Newton solving and an elliptic Coulomb friction cone. These choices describe an authored fixture, not measured hardware or calibrated material fidelity.

Contact provenance matters. At equal geometry priority, MuJoCo mixes sliding friction by taking the maximum, as described in its [contact-parameter documentation](https://mujoco.readthedocs.io/en/stable/modeling.html#contact-parameters). Consequently jaw/object friction is `max(1.0, object_friction)` and table/object friction is `max(0.8, object_friction)`; lowering the object parameter below those floors does not produce a low-friction grasp. Only the jaws, object and table collide. Arm links and palm are collision-excluded, so obstacle avoidance and self-collision are unqualified. Observations expose simulator positions, velocities and contacts directly. The controller has no camera perception, tactile sensor model, cup handle geometry, deformable object, or learned recovery policy. A cup-labelled envelope currently selects a declared box proxy.

Success requires bilateral loaded jaw contact, a table-free lift of at least 55 mm retained for 100 ms, subsequent open jaws with no object contact, and a hand at least 100 mm above the object. The object must contact the table, remain within its target tolerance, have linear speed below 35 mm/s and angular speed below 0.3 rad/s, and satisfy the complete condition for the declared dwell, normally 250 ms. Textual engine warnings and native warning counters invalidate execution. A 0.56 m radial guard supplements rectangular placement bounds. Qualification should include identical arm-command replay with open jaws, deliberate release, varied scene positions and contact/retention traces. Changing seeds with scene jitter disabled is repetition, not new scene coverage. Full accepted-domain reach checks, contact calibration, perception and physical robot transfer remain pending.


## Frozen scene evaluation

The six-layout protocol was fixed in source before evaluation, using the same authored controller with no parameter training. It covers six different object/target coordinate pairs. The default and two layout families had been exercised during development, so these results are regression and scene-variation evidence rather than a claim of unseen generalization. Seeds 400–405 label the runs; jitter is disabled, and additional seeds alone would not create new physical layouts.

| Scene | Outcome | Final target error (mm) | Object lift (mm) | Active simulation (s) | Episode wall (s) |
|---|---|---:|---:|---:|---:|
| default | success | 0.286 | 128.9 | 11.310 | 0.642 |
| cross_right | success | 0.400 | 128.2 | 13.356 | 0.739 |
| cross_left | success | 0.353 | 124.1 | 11.334 | 0.567 |
| forward | success | 0.329 | 129.0 | 11.591 | 0.616 |
| reverse | success | 0.330 | 124.7 | 13.594 | 0.684 |
| wide | success | 0.437 | 127.7 | 12.715 | 0.665 |

Placement completed **6/6** scenes; no-motion and replayed joint commands with the jaws held open each completed **0/6**. The open-jaw replay uses the successful run's exact joint targets, forcing an 80 mm jaw gap and holding the last command if the control horizon is longer. It provides a contact-coupling control, not the same object trajectory. Each failed control exhausts its 18-second horizon. Placement totals 73.90 active simulated seconds in 3.91 wall seconds, approximately 18.9×, on Apple M5 CPU. Wall time includes model compilation, reset/settling, IK, physics, observations and trace collection. UI, process startup, installation and output I/O are excluded. Another test process was running during this local measurement. No GPU throughput or minimum-memory requirement was measured.

Three of the qualified scene layouts also completed under macOS's process-level network-denial sandbox, after a native libc connection self-test returned EPERM. This tests installed runtime on this host and repeats existing layouts. It does not test downloading dependency wheels into an air-gapped server. An extracted-source reproduction, using the preinstalled pinned dependencies, matched all recorded control frames, commanded actions and final diagnostics exactly after JSON normalization for the first three placement scenes. Sixty-five distinct tests cover native contact execution, installation/HTTP boundaries, provenance integrity and the existing cable foundation.

## Product and evidence

The public release provides a [standalone arm replay](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-07-skillspace-arm/release-v0/replay.html), an [executable source adapter archive](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-07-skillspace-arm/release-v0/skill-adapter.zip), [full control evidence, gzip JSON](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-07-skillspace-arm/release-v0/run.json.gz), [compact metrics](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-07-skillspace-arm/release-v0/metrics.json), [integrity manifest](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-07-skillspace-arm/release-v0/manifest.json), [reproduction receipt](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-07-skillspace-arm/release-v0/reproduction.json), [native offline receipt](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-07-skillspace-arm/native-offline/native-policy.json), and a [local product guide](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-07-skillspace-arm/PRODUCT.md). The replay samples recorded observations every 100 ms; full evidence retains 20 ms control observations and action commands. Hashes establish content consistency, not publisher authenticity or physical competence.

This implements the link-to-compatible-arm execution path within an explicit simulated skill space. The environment supplies metric object/target state, the installed adapter converts current state into joint/jaw actions, and the verifier checks the resulting object state. The initial thesis's spatial operating region becomes a bounded task contract; feedback supplies the missing connection between a skill name and effective movement. Demonstrations becoming learned policies, calibrated objects, realistic perception, repair policies and robot-specific physical qualification remain the next capability gates.
4 changes: 4 additions & 0 deletions docs/downloads/topics/physical-grounding/README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
# Physical grounding

## Skillspace link to articulated arm — 7 October 2026

[Installing a Skillspace on a simulated arm](../../reports/Installing%20a%20Skillspace%20on%20a%20simulated%20arm.md) publishes a one-click local installer, authored placement adapter and native articulated-arm environment. The same controller completes 6/6 changed layouts; no-motion and replayed joint commands with jaws held open each complete 0/6. Three layouts repeat successfully under native network denial. [Local product guide and source](runs/2026-10-07-skillspace-arm/PRODUCT.md). DVIDIA metadata provides task identity, not a learned policy; the box proxy, privileged state and collision-excluded arm links bound the result.

## Runnable cable environment — 7 October 2026

[Offline cable training environment](../../reports/Offline%20cable%20training%20environment.md) publishes the first practice-to-pack prototype: native CPU cable dynamics, local controller search, frozen simulated evaluation, replay and hashed export. The selected controller and fixed feedback baseline both completed 10/10 held-out episodes; zero-force and release controls completed 0/10. Search did not improve held-out completion. A separate native macOS network-denial check completed 3/3 additional episodes. [Runnable archive and instructions](runs/2026-10-07-cable-env/README.md). Ideal endpoint attachment and privileged state remain explicit; this is not the retrieval baseline, physical gripping, calibrated rope accuracy or GPU qualification.
Expand Down
Loading
Loading