Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 8 additions & 2 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -72,14 +72,15 @@ jobs:
dvidia-robot-sim --help
dvidia-robot-sim list
dvidia-piper-grip --help
dvidia-piper-contact --help
dvidia-training-doctor --json
- name: Test footage, visual training and loopback studio
run: python -m unittest tests.test_footage_data tests.test_footage_train tests.test_footage_pipeline tests.test_footage_benchmark tests.test_training_studio tests.test_doctor tests.test_coverage tests.test_episode_tape tests.test_reaction tests.test_reaction_metrics tests.test_reaction_convergence tests.test_reaction_benchmark tests.test_motor_memory tests.test_motor_metrics tests.test_motor_benchmark tests.test_observations tests.test_observation_models tests.test_motion tests.test_motion_benchmark tests.test_transition_model tests.test_transition_pilot tests.test_transition_cli tests.test_embodiment_calibration tests.test_embodiment_cli tests.test_reference_sim -v

reference:
name: Hardware reference / Linux / Python 3.12
runs-on: ubuntu-latest
timeout-minutes: 15
timeout-minutes: 30
steps:
- uses: actions/checkout@fbc6f3992d24b796d5a048ff273f7fcc4a7b6c09 # v5.1.0
with:
Expand Down Expand Up @@ -138,7 +139,7 @@ jobs:
- name: Test profile contracts against pinned native assets
env:
DVIDIA_ROBOT_PROFILE_ASSETS: runs/robot-profile-assets-ci
run: python -m unittest tests.test_robot_profiles tests.test_piper_task tests.test_piper_task_benchmark tests.test_piper_grip_guard tests.test_piper_grip_benchmark -v
run: python -m unittest tests.test_robot_profiles tests.test_piper_task tests.test_piper_task_benchmark tests.test_piper_grip_guard tests.test_piper_grip_benchmark tests.test_piper_contact_memory tests.test_piper_contact_benchmark -v
- name: Retain PiPER contact task and matched controls
run: |
dvidia-piper-task benchmark runs/robot-profile-assets-ci --output runs/piper-task-ci --nominal 1 --stress 0
Expand All @@ -152,6 +153,10 @@ jobs:
python -m pip install -r publishing/huggingface/requirements.txt
python -m unittest discover -s publishing/huggingface -p 'test_publish_robot_sim.py' -v
python -m unittest discover -s publishing/huggingface/robot-simulation-lab -p 'test_*.py' -v
- name: Retain contact history, slowdown and recovery comparison
run: |
dvidia-piper-contact benchmark --assets runs/robot-profile-assets-ci --output runs/piper-contact-ci
dvidia-piper-contact inspect runs/piper-contact-ci
- name: Preserve additional profile evidence
if: always()
uses: actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02 # v4.6.2
Expand All @@ -160,6 +165,7 @@ jobs:
path: |
runs/piper-task-ci
runs/piper-grip-ci
runs/piper-contact-ci
runs/piper-smoke-ci
runs/so101-smoke-ci
if-no-files-found: ignore
Expand Down
8 changes: 8 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,14 @@ test lift before carrying, one supported recovery attempt, and a paired
benchmark against the original controller. It uses current simulator state;
task completion, grip qualification, retries and aborts are recorded separately.

The [contact-history v0.3 candidate](docs/piper-contact-memory-v03.md) compares
the original controller, test lift alone, and bounded slowdown/closed-hold
reassessment. Its complete paired benchmark varies object mass and friction;
resuming a movement and recovering a completed placement are separate outcomes.
The [84-attempt confirmation](benchmarks/piper-contact-v03-20261011/README.md) completes
6/12 history placements versus 4/12 for each paired alternative, with all 48
negative controls failing. These are synthetic, privileged-state results.

Train a small visual model from Skillspace footage on your own computer or server. The pipeline checks actual videos and source groups, fixes training/development/test splits, fits weights on a CPU, and exports a result with held-out measurements and integrity hashes.

The base install needs **Python 3.12+, NumPy and FFmpeg**. It needs no GPU, CUDA, account or API key. Training is offline by default; downloading software or public footage is a separate, explicit step.
Expand Down
23 changes: 23 additions & 0 deletions benchmarks/piper-contact-development-20261011/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
# PiPER contact-memory development appendix

This archive retains all 13 scripted exploratory development attempts, including four unsuccessful tasks, before the separately reserved confirmation cohort. These repeated fixtures are development evidence and do not estimate reliability or detector accuracy. Every attempt was numerically valid, used its original fixed 20-second window, and retains all 1,000 commands and 1,001 native states. No attempt was removed or overwritten.

The new controller inherits the exact v0.2 acquisition probe and supported one-retry limit. `probe_only` removes carry monitoring only. `history` uses a causal short TCP-local offset window and may request reduced joint deltas, hold closed, reassess and resume. Native forces, gains, dynamics and the outcome scorer are unchanged. Contacts and object poses are privileged simulator observations; this is not a hardware safety controller or a learned model.

| Candidate | Recorded attempts | Change |
| --- | ---: | --- |
| r0 | 6 | Initial finite parameter design: probe-only/history at three friction values, 40 g |
| r1 | 6 | Correctness checks: maximum pairwise excursion prevents endpoint-canceling oscillation from qualifying as settled; unscaled teacher targets are recorded for command audit. Four history scenes plus current/frozen v0.2 baseline comparison |
| r2 | 1 | Clear completed settling dwell after resume; controller motion is unchanged. Final-source 40 g moderate-friction check |

No controller threshold was tuned between these candidates. Complete exact source snapshots are under `sources/r0`, `sources/r1`, `sources/r2`, and `sources/frozen-v02`. `summary.json` binds every attempt to its own snapshot and includes stored/decoded hashes, events, timing and task outcomes. Original decoded JSON bytes are preserved inside deterministic gzip files.

The nominal 40 g fixture completed in both new modes. At friction 0.55, the 40 g probe-only fixture completed at 15.632 seconds; history completed at 18.421 seconds after one requested slowdown, one closed hold and one resume. The 60 g nominal-friction history fixture also completed after one hold/resume. The 60 g moderate-friction fixture failed acquisition, and low-friction fixtures failed after the inherited bounded probe/retry behavior. These results remain exploratory; they are separate from confirmation denominators.

The retained current baseline and frozen v0.2 baseline have exactly equal issued commands and exactly equal every-row native `qpos` and `qvel` values. Their provenance/recording fields naturally differ with source identity.

Requested slowdown is not proof of immediate physical slowdown. For the 40 g moderate-friction fixture, actual mean TCP speed in the 120 ms before/after the slowdown request increased from 79.8 to 88.9 mm/s. In the first 120 ms after the measured-target hold it was 12.1 mm/s; in the 120 ms before resume it was 3.6 mm/s, and after resume 34.3 mm/s. The 60 g nominal-friction fixture showed the same direction of change. Actual speed/path windows are retained in `summary.json`; this archive makes no instantaneous arrest claim.

The PiPER simulation asset notices are preserved in `licenses/agilex_piper`. DVIDIA source code is MIT; its license is retained in `licenses/DVIDIA-MIT.txt`. No model mesh assets, raw video, weights or credentials are included. Fetching and simulating assets is a separate pinned operation; inspecting these recorded files requires no network or native simulation.

`integrity.json` lists every archive file with byte counts and SHA-256, plus decoded byte counts and SHA-256 for gzip attempts. This seal checks recorded file consistency; it is not cryptographic authentication of physical robot competence.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
224 changes: 224 additions & 0 deletions benchmarks/piper-contact-development-20261011/integrity.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,224 @@
{
"schema": "dvidia.piper-contact-development-integrity/v1",
"files": {
"README.md": {
"bytes": 3745,
"sha256": "4700cc4c05e6364ea32a040ffa6f154550058bc160bf30ed63fa96da393ba954"
},
"attempts/r0/history-low.json.gz": {
"bytes": 723501,
"sha256": "acee8a0f41679657a0ad00085e93b04606a712bf4612722b91bb30607ed6c196",
"encoding": "gzip",
"decoded_bytes": 4271896,
"decoded_sha256": "e0937762208f30f3efab78eaab7c0d6546f1c56921f18ab338b3cafa4480c7e6"
},
"attempts/r0/history-moderate.json.gz": {
"bytes": 797150,
"sha256": "0098f49f743cb0d5b388f77228a82862c271b028125641269083fb5176a912b6",
"encoding": "gzip",
"decoded_bytes": 4203582,
"decoded_sha256": "72340c8fc8af977f2634fcd5cde237292a771444dd411ad7a4956b93ac4d746e"
},
"attempts/r0/history-nominal.json.gz": {
"bytes": 786460,
"sha256": "89fb6ec0f87f0b9023510294b63328ec0c2a622911169515cf8ee8fe8b4c5b15",
"encoding": "gzip",
"decoded_bytes": 4206172,
"decoded_sha256": "5bfc275a5bb65f48197b965e04310a9c906124c39cc6a5d5b039d67cfd825eb9"
},
"attempts/r0/probe_only-low.json.gz": {
"bytes": 723510,
"sha256": "58d4ff92c686c93df7fc8e68f3fc02b44c8e132284164ee653f27cb2c174e167",
"encoding": "gzip",
"decoded_bytes": 4271902,
"decoded_sha256": "ce5c8f3fd0fc82745793e7feea6f23fb2d7fc226f27d1ebc2cd24fcd61de4f59"
},
"attempts/r0/probe_only-moderate.json.gz": {
"bytes": 775306,
"sha256": "bf6e0441590dcde1fa326e902a5be82e9a2d4e3de51fe33351a5ea4ed1830c52",
"encoding": "gzip",
"decoded_bytes": 4153500,
"decoded_sha256": "a939c1f5f38f2ae40cd202d8b10addc8540a554718e6bdd6cf49852c05e771c7"
},
"attempts/r0/probe_only-nominal.json.gz": {
"bytes": 786446,
"sha256": "bf95ffbeb79a67ad2b8d59cdd9af136adeabd94f46df69aaba1b7679768f0f18",
"encoding": "gzip",
"decoded_bytes": 4205430,
"decoded_sha256": "a168981d41e7151c63bdf4ab87bf342e7783452e81acb31aead0dbe39f314f86"
},
"attempts/r1/baseline-current.json.gz": {
"bytes": 715805,
"sha256": "98d4f2679745fcbceba9faba7b87b3a3b446dfe70feb8c56b88b5c0ad8720187",
"encoding": "gzip",
"decoded_bytes": 3300091,
"decoded_sha256": "d0f7408b675da05dc77e853f9c75b056367b90c03f3f36d7664e73d3df2dacde"
},
"attempts/r1/baseline-frozen-v02.json.gz": {
"bytes": 715807,
"sha256": "94ee6cb8c3580b14661be88ef9a4354124ef264e59ad459305af9bb9349a84af",
"encoding": "gzip",
"decoded_bytes": 3300087,
"decoded_sha256": "ec5d5623a3f2a6eeaa57fb4968d2de0f424d7290499e3f963f17f838f9cb9216"
},
"attempts/r1/low06.json.gz": {
"bytes": 724054,
"sha256": "bfb521bc49b896d8021db76fec50fb1c7c4681204a0d4528281af470f2301435",
"encoding": "gzip",
"decoded_bytes": 4373737,
"decoded_sha256": "e8f840e32617ebc757a82269f28a71df7d6fd3ab754aefe40cd98e5ebb98c564"
},
"attempts/r1/moderate04.json.gz": {
"bytes": 820840,
"sha256": "987f0032217d23eb588d033bd38fc6c389fbed79d466d9bc477240d220a7068c",
"encoding": "gzip",
"decoded_bytes": 4352227,
"decoded_sha256": "53655685ba5423f3c090a3b5bb1a8bd15077ed00e42f508fb5434a79d310b777"
},
"attempts/r1/moderate06.json.gz": {
"bytes": 717385,
"sha256": "4b02c5c2daad623353fa23a828133c5708683cda64d83d89f5eac9db0fc5c745",
"encoding": "gzip",
"decoded_bytes": 4398756,
"decoded_sha256": "82628ee8d86011a87362b12387fe5a13a5251857bce649562cab016edf6f55d6"
},
"attempts/r1/nominal06.json.gz": {
"bytes": 822044,
"sha256": "701523786cb50f5f14429dd97c93a3f04e392be3ba0dd27f5cb02a583e8b8a40",
"encoding": "gzip",
"decoded_bytes": 4346793,
"decoded_sha256": "5d8f984535caf453d919babd4af143eb32f56eb613d798d26d0ef31bd02ccb9a"
},
"attempts/r2/moderate04.json.gz": {
"bytes": 817971,
"sha256": "22638fc214e6df30c78bf33413e9704ab205a4968fc4e3c40916d23e1c3f5797",
"encoding": "gzip",
"decoded_bytes": 4346724,
"decoded_sha256": "e69dc8c1556160be595df323a84894cf258fe77de41974714a90c4890863e9ec"
},
"licenses/DVIDIA-MIT.txt": {
"bytes": 1076,
"sha256": "ab47d245880a661fdca3c6a4cb91671031302deee50d64f8d2d6df86832962e1"
},
"licenses/agilex_piper/LICENSE": {
"bytes": 1065,
"sha256": "e32d78fd3761052ab0b2bb42fef8a7a9ad3f298d315d305333c349d2aff1f134"
},
"licenses/agilex_piper/README.md": {
"bytes": 1681,
"sha256": "ab0d218758ec6c298417407962f49179e369236e8f316dbaa7671756d6f8eb77"
},
"sources/frozen-v02/piper_grip_guard.py": {
"bytes": 15452,
"sha256": "90895566cad8d5a3c158a14d3165fa1866cb3d7a4a3eecac3ca0ca8ab3e88dfb"
},
"sources/frozen-v02/piper_task.py": {
"bytes": 31591,
"sha256": "7ff3cbe17ce77e8fed7a097c930d8cf85f9babdccdd9a5ad18fc2cd49e33716b"
},
"sources/frozen-v02/reference_sim.py": {
"bytes": 24336,
"sha256": "c1201d22eb13dd07a236ee63cc4ba68e129f6067e8db61ed41af2d820eb5e3b8"
},
"sources/frozen-v02/reference_task.py": {
"bytes": 34166,
"sha256": "bbc768ccc202b8dd41cbd235b206e6478806ce47c1f30ae15dc662c0c1edcc3e"
},
"sources/frozen-v02/robot_profiles.lock.json": {
"bytes": 35002,
"sha256": "4b2ee2ca675aceb2f826983cb3082a3e08e9aa0ff419b23078abcff08ebcc6fe"
},
"sources/frozen-v02/robot_profiles.py": {
"bytes": 26493,
"sha256": "fb90782a6a9979e282182118ae0e3e29d00f101255cc57378dd3f692672bb13d"
},
"sources/r0/piper_contact_memory.py": {
"bytes": 13834,
"sha256": "4079a8cc6576425dca51819eff802417f32d6d5544cc9708424cd6dade353bbf"
},
"sources/r0/piper_grip_guard.py": {
"bytes": 15452,
"sha256": "90895566cad8d5a3c158a14d3165fa1866cb3d7a4a3eecac3ca0ca8ab3e88dfb"
},
"sources/r0/piper_task.py": {
"bytes": 32119,
"sha256": "4e3f16e6075842631ddb7aa7d53ea6d6c95b54934f7eb751da61b60a432fa167"
},
"sources/r0/reference_sim.py": {
"bytes": 24336,
"sha256": "c1201d22eb13dd07a236ee63cc4ba68e129f6067e8db61ed41af2d820eb5e3b8"
},
"sources/r0/reference_task.py": {
"bytes": 34166,
"sha256": "bbc768ccc202b8dd41cbd235b206e6478806ce47c1f30ae15dc662c0c1edcc3e"
},
"sources/r0/robot_profiles.lock.json": {
"bytes": 35002,
"sha256": "4b2ee2ca675aceb2f826983cb3082a3e08e9aa0ff419b23078abcff08ebcc6fe"
},
"sources/r0/robot_profiles.py": {
"bytes": 26493,
"sha256": "fb90782a6a9979e282182118ae0e3e29d00f101255cc57378dd3f692672bb13d"
},
"sources/r1/piper_contact_memory.py": {
"bytes": 14465,
"sha256": "e1101eae73e8742e92c96bf58d5245844492ef88959551e53c40af77b74010f4"
},
"sources/r1/piper_grip_guard.py": {
"bytes": 15452,
"sha256": "90895566cad8d5a3c158a14d3165fa1866cb3d7a4a3eecac3ca0ca8ab3e88dfb"
},
"sources/r1/piper_task.py": {
"bytes": 32119,
"sha256": "4e3f16e6075842631ddb7aa7d53ea6d6c95b54934f7eb751da61b60a432fa167"
},
"sources/r1/reference_sim.py": {
"bytes": 24336,
"sha256": "c1201d22eb13dd07a236ee63cc4ba68e129f6067e8db61ed41af2d820eb5e3b8"
},
"sources/r1/reference_task.py": {
"bytes": 34166,
"sha256": "bbc768ccc202b8dd41cbd235b206e6478806ce47c1f30ae15dc662c0c1edcc3e"
},
"sources/r1/robot_profiles.lock.json": {
"bytes": 35002,
"sha256": "4b2ee2ca675aceb2f826983cb3082a3e08e9aa0ff419b23078abcff08ebcc6fe"
},
"sources/r1/robot_profiles.py": {
"bytes": 26493,
"sha256": "fb90782a6a9979e282182118ae0e3e29d00f101255cc57378dd3f692672bb13d"
},
"sources/r2/piper_contact_memory.py": {
"bytes": 14507,
"sha256": "f608d6647046f6fa02d8ad5e87fad10853837520a6a0fae2043c7ad260a06c4c"
},
"sources/r2/piper_grip_guard.py": {
"bytes": 15452,
"sha256": "90895566cad8d5a3c158a14d3165fa1866cb3d7a4a3eecac3ca0ca8ab3e88dfb"
},
"sources/r2/piper_task.py": {
"bytes": 32119,
"sha256": "4e3f16e6075842631ddb7aa7d53ea6d6c95b54934f7eb751da61b60a432fa167"
},
"sources/r2/reference_sim.py": {
"bytes": 24336,
"sha256": "c1201d22eb13dd07a236ee63cc4ba68e129f6067e8db61ed41af2d820eb5e3b8"
},
"sources/r2/reference_task.py": {
"bytes": 34166,
"sha256": "bbc768ccc202b8dd41cbd235b206e6478806ce47c1f30ae15dc662c0c1edcc3e"
},
"sources/r2/robot_profiles.lock.json": {
"bytes": 35002,
"sha256": "4b2ee2ca675aceb2f826983cb3082a3e08e9aa0ff419b23078abcff08ebcc6fe"
},
"sources/r2/robot_profiles.py": {
"bytes": 26493,
"sha256": "fb90782a6a9979e282182118ae0e3e29d00f101255cc57378dd3f692672bb13d"
},
"summary.json": {
"bytes": 27441,
"sha256": "88f5bf26f3915ad7d5a1771bcd73fcfd61d1c764793b3eb24ce117e7d3607880"
}
}
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
MIT License

Copyright (c) 2026 DVIDIA contributors

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
MIT License

Copyright (c) 2024 RosenYin

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
Loading
Loading