Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 10 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -125,6 +125,16 @@ original force limits and 18-second deadline. Two frozen revisions completed
with no paired completion regressions. Both revisions and their limits are
visible in the local improvement viewer; no controller was promoted.

The [goal-image research direction](docs/goal-images-to-actuators.md) connects
visual goals to action-conditioned prediction, robot-specific joint commands
and independent contact feedback. It evaluates where TypeSafe's new Jev image
interface could fit, without adding an API dependency. The companion
[native contact audit](docs/native-contact-audit.md) replays
the existing retention tapes at the simulator's 1 kHz cadence and checks exact
agreement with all original, nominally 50 Hz physical observations. It diagnoses the
simplified rigid-box profile; it does not add a visual planner or qualify PiPER
shoe manipulation.

## Review what is visible in a video

The new [local observation lab](docs/observations.md) uses optional CPU object and
Expand Down
53 changes: 53 additions & 0 deletions benchmarks/native-contact-audit-20261018/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
# Native contact audit receipt

**14 frozen replays verified; 249,502 native physics ticks.** A separate portable
rerun reproduced all 14 compressed native traces byte-for-byte and every
physical summary exactly. These are repeated measurements of seven controller
tapes and seven open-jaw controls from two already inspected scenes, not 28 new
policy trials. No controller or model was promoted.

- [Interpretation and local reproduction](../../docs/native-contact-audit.md)
- [Goal images, Jev and the actuator interface](../../docs/goal-images-to-actuators.md)
- [Published research](https://research.dvidia.org/papers/goal-images-physical-feedback/)
- [Verified complete-bundle downloader](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-18-native-contact-audit/download-audit.py)
- [Complete public file inventory](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-18-native-contact-audit/audit/integrity.json)

Implementation source freeze: `ff40985ec076eaed8421821b1244217d8502777e`.
The runtime, physical limits, actions and original success criteria are unchanged.
Ten focused tests include an exact-state native probe and tests for contact
thresholds, sampling, dwell, tampering and portable-input paths. An independent
source and result review found no high-impact methodological defect.

This compact folder preserves the original protocol, report, protocol checksum
and full file manifest. The published 59-file bundle additionally includes all
compressed original input tapes, native traces, per-episode receipts, runtime
source snapshots and upstream experiment metadata: **151,876,079 bytes**.
`integrity.json` lists the other 58 files; its own hash is recorded below.
The separate `qa.json` records tests, execution environment and portable
reproduction; it is not part of the sealed primary bundle.

The [final publication receipt](release-receipt.json) records successful public
retrieval of all 59 files with the published downloader and verification of
68 total public files. The downloader identifies its client explicitly so
Cloudflare can serve the requests. A transient incomplete transfer was rejected;
a fresh complete run verified every byte. The original audit remains unchanged.

| Artifact | SHA-256 |
| --- | --- |
| Protocol | `f5ded43bc66dd512e223ffea76ad51897ffea15bb016fa2c29dcd1b4fb6601e2` |
| Report | `e1c8ad0fafd2aa040d215601dcdc235a9fd010dd212400a43a450bb3bf7eec63` |
| Integrity manifest | `dc7b6091b1c680b9479ea65157c7d553043af688e159463db6174696ad5949fa` |

Baseline and smoothed students sustain the native lift predicate for at most
75 ms and 89 ms, below the unchanged 100 ms requirement. Compliance sustains it
for 947 ms but still fails placement. Missing loaded contacts in these tapes
correspond to simulated geometric separations. A successful comparator also has
brief separations, so this does not establish a one-factor failure cause or
real-world slip.

The primary audit took 54.18 wall seconds; the portable repetition took 204.60
seconds under different host load. Both include instrumentation and export;
neither is an uninstrumented throughput benchmark. Tested on macOS arm64,
Python 3.12.9, MuJoCo 3.15.0 and NumPy 2.5.3 using CPU simulation. No external
inference was used. Cross-platform exact numerical reproduction remains a gate
to test, not an established guarantee.
1 change: 1 addition & 0 deletions benchmarks/native-contact-audit-20261018/integrity.json
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"files":{"episodes/baseline-student-scene14-open-jaw/native-trace.jsonl.gz":{"bytes":8914391,"sha256":"4658d2a0cea8d3eb23a51db78d28623ba38a4a4b69cc3cdf397a3981d15a296c"},"episodes/baseline-student-scene14-open-jaw/receipt.json":{"bytes":5193,"sha256":"3b97cba874afce8ac4f7ea72fa8a5899f29ae39d088f779ccbbb7eb03b886ee6"},"episodes/baseline-student-scene14/native-trace.jsonl.gz":{"bytes":9620445,"sha256":"ce562f5ba1902fde53080894b02b647da2a5ecf48a14335e780110967bdd6f40"},"episodes/baseline-student-scene14/receipt.json":{"bytes":9422,"sha256":"1bd1b7b0b0c351f44a983b20bea8c110740fcb268e0892e2f834ac8ffbfa37f9"},"episodes/baseline-student-scene15-open-jaw/native-trace.jsonl.gz":{"bytes":8889990,"sha256":"51919fd04ad242fed6b0a3a08b445149175a7d9a3f72b58298f340d6a4de0cfb"},"episodes/baseline-student-scene15-open-jaw/receipt.json":{"bytes":6035,"sha256":"1bfd93897c3de83a0e32043d5c543996f5591ddf962d974927f0c3eb8496aa96"},"episodes/baseline-student-scene15/native-trace.jsonl.gz":{"bytes":10985854,"sha256":"876091112d9856f3265cdf12bee634cd1986be8f5ed20bbe025be733c433f729"},"episodes/baseline-student-scene15/receipt.json":{"bytes":171397,"sha256":"965af5523c129bba311f0c08004a22bd39f408ba808e7dd0041bb416573ac614"},"episodes/baseline-teacher-scene15-open-jaw/native-trace.jsonl.gz":{"bytes":8889628,"sha256":"643621794fdde305f09b189c0750554987eaf69fadd540f285d617ef08bfc2ac"},"episodes/baseline-teacher-scene15-open-jaw/receipt.json":{"bytes":6354,"sha256":"d16da6cb197e3107ee6da17f2442796bf4f67a707f304114f554de8395d807bb"},"episodes/baseline-teacher-scene15/native-trace.jsonl.gz":{"bytes":11453597,"sha256":"4872a7e6409c973eef87adb87999d8304b7943c3ffa53aecd5fb0a07c8ce5505"},"episodes/baseline-teacher-scene15/receipt.json":{"bytes":211626,"sha256":"45639069a501f6fe0205d0d35cbcb67e858cd3884f6d7552bc487daf795b592b"},"episodes/compliance-student-scene15-open-jaw/native-trace.jsonl.gz":{"bytes":8894877,"sha256":"61568fb20da90b0cf46292c5d7fa81f7ad5c154bcf421c26a84a13b7b47715a0"},"episodes/compliance-student-scene15-open-jaw/receipt.json":{"bytes":6050,"sha256":"045eb331cd7355966d72060f2f3352f70d5c27e7b78be7fcb1741a86e29a0519"},"episodes/compliance-student-scene15/native-trace.jsonl.gz":{"bytes":10946227,"sha256":"11f443b778d42c7b98036b4f30a1cbe5d5b9d8cfdd3f618619e1a37de2efaf6d"},"episodes/compliance-student-scene15/receipt.json":{"bytes":122088,"sha256":"d2effecb318fcbe10c14549814b2b0ee9b2fb67fd82c6eb1ea67617a08c8654f"},"episodes/compliance-teacher-scene15-open-jaw/native-trace.jsonl.gz":{"bytes":8889040,"sha256":"9f42f3b16f0580665abec2a208824953765449344abea8124ca58af5c3d1a64a"},"episodes/compliance-teacher-scene15-open-jaw/receipt.json":{"bytes":6379,"sha256":"53cf1b4a70e5c4a581470c6cac50b1b32c76c4527eb8e18fa57a663dd07e655e"},"episodes/compliance-teacher-scene15/native-trace.jsonl.gz":{"bytes":11367554,"sha256":"220f41a3d8516906231ea4417268fe6e93c6dd703655e6a234a92f04efaf6f74"},"episodes/compliance-teacher-scene15/receipt.json":{"bytes":189002,"sha256":"d939f3274bc7c8b916aba798d1c6398f6a95404fbda569ba5d7f99572e126413"},"episodes/smoothing-student-scene15-open-jaw/native-trace.jsonl.gz":{"bytes":8888989,"sha256":"e636a3cb754c4ff4bfbf3940c8fcb48fef4e634fb21119001d04560bb803cb45"},"episodes/smoothing-student-scene15-open-jaw/receipt.json":{"bytes":6066,"sha256":"c9786e17962417c72a51fbb41b0d5f8ee4b0be80ea73569ad95c0d8603e0f2d7"},"episodes/smoothing-student-scene15/native-trace.jsonl.gz":{"bytes":11063187,"sha256":"9b8295880444754d233daebb139e7a8658f3320f5a8d59a9794e014f2e9f3e99"},"episodes/smoothing-student-scene15/receipt.json":{"bytes":154501,"sha256":"3a53f61e489f14abf526f7d2794a8a9eaab927ffea5602a8fed4667e0ce0f2af"},"episodes/smoothing-teacher-scene15-open-jaw/native-trace.jsonl.gz":{"bytes":8881614,"sha256":"42a13eaabfdc202019ca051dc820195ab76053a124c8f871377ef11978fabd01"},"episodes/smoothing-teacher-scene15-open-jaw/receipt.json":{"bytes":6359,"sha256":"093373872fdcda51142219ca442595544f202f87f9a2f67d63687ee728fc757d"},"episodes/smoothing-teacher-scene15/native-trace.jsonl.gz":{"bytes":11378112,"sha256":"0f208abdf75f1562926a6812b205b72731900fd4c5daf30ea017a75f2b7a284c"},"episodes/smoothing-teacher-scene15/receipt.json":{"bytes":195481,"sha256":"e9e8874de9a610258b06782498fe87f824034f6e292e46fe9c48a5ab8de4ed11"},"inputs/baseline-student-scene14-open-jaw.json.gz":{"bytes":564458,"sha256":"980d3b07ef717cb12697a6b74f5c256832242e692662314b20e974d9a596109e"},"inputs/baseline-student-scene14.json.gz":{"bytes":581103,"sha256":"29e336f0d56ed2cb4eb5c5eef0245475ccdc5b7222fbb9b14f65481573e0d94f"},"inputs/baseline-student-scene15-open-jaw.json.gz":{"bytes":588028,"sha256":"c234acc13fa56117fb517b774e60eecdba35c861f9d2f271597689bc567d1cca"},"inputs/baseline-student-scene15.json.gz":{"bytes":672028,"sha256":"4c4847156003fbdabbb28c2c2fb17c21a4ee90b5da3b4764d7af8589ccb31940"},"inputs/baseline-teacher-scene15-open-jaw.json.gz":{"bytes":588275,"sha256":"3ad177baa08e8b8d59e120638b93ead6c0486556223b1962f597ce134c3ae36c"},"inputs/baseline-teacher-scene15.json.gz":{"bytes":676888,"sha256":"7d30926fbed7ec24a499ebb45b291a686b8284facd860f3115ff2b4aa77fc94d"},"inputs/compliance-student-scene15-open-jaw.json.gz":{"bytes":589582,"sha256":"4a3648f7023fd882df919d18a9afc9e50098b19c92c63110bff9a9301bdb6cf4"},"inputs/compliance-student-scene15.json.gz":{"bytes":718327,"sha256":"2ba7e8cf7fff02bc352483874d83b2146fc0066b504000ed8f118c9f8c21365e"},"inputs/compliance-teacher-scene15-open-jaw.json.gz":{"bytes":587782,"sha256":"b84ceb68fd5cbefde3f7fdc742fca3e7236d6ab9e1289bada534cc6e0686fd53"},"inputs/compliance-teacher-scene15.json.gz":{"bytes":723381,"sha256":"1eda6cffc03278555c0434fd392dc26e966b7e0d2e2449eb7ea1ce7a6290b235"},"inputs/smoothing-student-scene15-open-jaw.json.gz":{"bytes":588306,"sha256":"8937295e8a7c6da3534f697f77016ec2bcaea774469f90ae70f81353e34c2734"},"inputs/smoothing-student-scene15.json.gz":{"bytes":715718,"sha256":"90139f7d757d5c78376027606db708f63349cd8dfd6634936a0a8ee9841854fd"},"inputs/smoothing-teacher-scene15-open-jaw.json.gz":{"bytes":588001,"sha256":"461053279b9696ff863e9d46801b88900d8048cda8b93daeb6c15ea9f02b5520"},"inputs/smoothing-teacher-scene15.json.gz":{"bytes":721834,"sha256":"9f5ee3649a583ea154d57aca2495bbf59886162bba6266b2edc6847b5e9ad2b7"},"progress.json":{"bytes":76,"sha256":"8701d634e6071614c8e8c2afb301b0537bc741fbd2116043bba7ca4404b82578"},"protocol.json":{"bytes":16421,"sha256":"f5ded43bc66dd512e223ffea76ad51897ffea15bb016fa2c29dcd1b4fb6601e2"},"protocol.sha256":{"bytes":65,"sha256":"6fae783469c9d0f06b6d4ddfb5456e31dd7c7c5e87441a8c5da294c67c6041e2"},"report.json":{"bytes":1097403,"sha256":"e1c8ad0fafd2aa040d215601dcdc235a9fd010dd212400a43a450bb3bf7eec63"},"sources/arm_env.py":{"bytes":27576,"sha256":"e4af9b75364a568284b1e6d96469deacf498dd87a60b067fa5e310fe15c54c00"},"sources/arm_policy.py":{"bytes":12249,"sha256":"d6d53d87703fb8608390092309285afb6a2c8fd3103a7abd77668be85469eab3"},"sources/arm_runner.py":{"bytes":14492,"sha256":"affb5812b6a395f6cca9cb4e900af2ef28162e7ff1e52a51bd29b789daa98df1"},"sources/cli.py":{"bytes":13819,"sha256":"192ec6a0852c7fd5dd3ae912815dae2fc7c9cfb93b97c85d528060e00a975b17"},"sources/env.py":{"bytes":26684,"sha256":"929c1d8c3c4cafe0054c633ee5f3e51c551dd6b26ae014ab1ea9219b58eca8e4"},"sources/installer.py":{"bytes":7649,"sha256":"d3a2c5a4913920c52beef89df9954494b89fd0becb08bb4847264dae48d3761c"},"sources/native_contact_audit.py":{"bytes":31219,"sha256":"4d5866a34503fcccfc224c9583e6aabdc9f63754d56af777c164dafb122304f6"},"sources/skillspace.py":{"bytes":20417,"sha256":"34b651609358ae9a58b9a610545ce7b85b83fb3d6c699613414ff8e0ea457b3c"},"upstream/compliance-protocol.json":{"bytes":15808,"sha256":"cc13853612a01d2f4301a9db0dbe7b2a702577f77d396ef0c4cc3af8c4b656fc"},"upstream/compliance-report.json":{"bytes":756158,"sha256":"adcace792306828353dc93e4857db6cda56e7f01692b83f2d8ba19b3f84ba5fb"},"upstream/smoothing-protocol.json":{"bytes":15279,"sha256":"cfcf9199220cbad3e9dc5acc50e00e95c5b449b3c4cc3ee6f714c422a5f85551"},"upstream/smoothing-report.json":{"bytes":749465,"sha256":"4ca816d0c1f3a03aebbceb64bf2bb116b969129b07777b8f3ecb9e9428bf26ed"}},"schema":"dvidia.native-contact-audit/v1"}
1 change: 1 addition & 0 deletions benchmarks/native-contact-audit-20261018/protocol.json

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions benchmarks/native-contact-audit-20261018/protocol.sha256
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
f5ded43bc66dd512e223ffea76ad51897ffea15bb016fa2c29dcd1b4fb6601e2
Loading
Loading