Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
672da97
Add inference runtime API design proposal
jarcherNV Jul 30, 2026
0c089c2
Add experimental inference runtime API envelope (#403)
jarcherNV Aug 4, 2026
d0c4a4c
Add flashdreams.runtime documentation
fangjunzhou-nv Aug 4, 2026
1e8fe77
Update InputSystem doc
fangjunzhou-nv Aug 5, 2026
ddae974
WIP Implement T2, T3, and part of T4 from API refactor plan (#413)
aidanfnv Aug 5, 2026
22595da
Merge remote-tracking branch 'nvidia/dev/jarcher/inference-runtime-ap…
fangjunzhou-nv Aug 5, 2026
637b38c
Create InferenceSession and moved InferenceInput to inference_session
fangjunzhou-nv Aug 5, 2026
901d8d0
Add inference runtime API design proposal
jarcherNV Jul 30, 2026
69299ec
Add experimental inference runtime API envelope (#403)
jarcherNV Aug 4, 2026
0941c86
WIP Implement T2, T3, and part of T4 from API refactor plan (#413)
aidanfnv Aug 5, 2026
4083c34
WIP InferenceSession implementation
fangjunzhou-nv Aug 5, 2026
6731cfa
Merge branch 'dev/jarcher/inference-runtime-api' of github-nvidia:NVI…
fangjunzhou-nv Aug 5, 2026
11f32a9
Merge branch 'dev/jarcher/inference-runtime-api' into dev/fangjun/inf…
fangjunzhou-nv Aug 5, 2026
de51140
Clarify global conditioning input semantics
aidanfnv Aug 6, 2026
e1fa7d0
Rename misleading `semantic_type` to `input_modality`
aidanfnv Aug 6, 2026
4964503
Correct disagreements in docs from PR #413
aidanfnv Aug 6, 2026
cced4c7
Fix input canonicalization in tests
aidanfnv Aug 6, 2026
8610c0f
Add experimental inference runtime and shared demo API (#422)
jarcherNV Aug 6, 2026
7246e7b
Merge branch 'dev/jarcher/inference-runtime-api' into dev/fangjun/inf…
fangjunzhou-nv Aug 6, 2026
3de1996
Add local nvim config for pyright lsp
fangjunzhou-nv Jul 22, 2026
2e82c2a
Refactor of flashdreams.runtime
fangjunzhou-nv Aug 6, 2026
3c910f1
Add inference_session and inference_runtime
fangjunzhou-nv Aug 7, 2026
c832e56
Update inference_runtime
fangjunzhou-nv Aug 7, 2026
80dcb56
Add omnidreams inference session
fangjunzhou-nv Aug 7, 2026
3af81e5
Add input/output to flashdreams.runtime
fangjunzhou-nv Aug 7, 2026
8080d88
Changed InferenceOutput to BaseModel instead of TypedDict
fangjunzhou-nv Aug 7, 2026
5251ea3
Changed inference input/output, user/global condition to Pydantic Bas…
fangjunzhou-nv Aug 7, 2026
4950f55
Add video output handler
fangjunzhou-nv Aug 7, 2026
fac23bc
Add hdmap input handler
fangjunzhou-nv Aug 7, 2026
859bbed
Rename private fields
fangjunzhou-nv Aug 7, 2026
e0c63a8
Update test mock
fangjunzhou-nv Aug 8, 2026
c7d5a06
Add Application base class
fangjunzhou-nv Aug 8, 2026
4aebecb
Add VideoOutputApplication
fangjunzhou-nv Aug 8, 2026
bcd48f2
Add omnidreams headless application
fangjunzhou-nv Aug 8, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .nvim.lua
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
vim.lsp.config("pyright", {
root_markers = { ".git" },
})
1 change: 1 addition & 0 deletions THIRD-PARTY-NOTICES
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,7 @@ huggingface-hub Apache-2.0 https://github.com/huggingface/huggingface_h
loguru MIT https://github.com/Delgan/loguru
numpy BSD-3-Clause https://github.com/numpy/numpy
nvidia-ml-py BSD-3-Clause https://pypi.org/project/nvidia-ml-py/
pydantic MIT https://github.com/pydantic/pydantic
safetensors Apache-2.0 https://github.com/huggingface/safetensors
torch BSD-3-Clause https://pytorch.org
torchvision BSD-3-Clause https://github.com/pytorch/vision
Expand Down
88 changes: 88 additions & 0 deletions configs/omnidreams_demo_replay_benchmarks.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,88 @@
{
"schema_version": 1,
"description": "Manual one-minute local benchmark scenarios for comparing the legacy Omnidreams single-view runner against the experimental shared demo replay path. The runner writes the legacy stacked HDMap/RGB canvas while the shared demo writes generated RGB output, so use the report for manual MP4 comparison rather than automatic pixel quality scoring.",
"scenarios": [
{
"id": "omnidreams-sv-runner-baseline",
"name": "Omnidreams single-view runner baseline",
"description": "Runs the stable legacy Omnidreams single-view runner with the bundled example data for the same one-minute block count used by the shipped Omnidreams baseline.",
"report_group": {
"id": "omnidreams-demo",
"name": "Omnidreams Demo Comparison"
},
"tags": [
"manual",
"gpu",
"real-demo",
"omnidreams",
"i2v",
"replay",
"baseline"
],
"env": {
"CUBLAS_WORKSPACE_CONFIG": ":4096:8",
"PYTORCH_CUDA_ALLOC_CONF": "expandable_segments:True"
},
"command": [
"uv",
"run",
"--project",
"integrations/omnidreams",
"flashdreams-run",
"omnidreams-sv-2steps-chunk2-loc6-lightvae-lighttae",
"--example-data",
"True",
"--example-data-uuid",
"239560dc-33d1-11ef-9720-00044bcbccac",
"--total-blocks",
"226"
],
"warmup_steps": 1,
"quality_baseline_compare": false,
"timeout_s": 7200
},
{
"id": "omnidreams-sv-demo-replay",
"name": "Omnidreams shared demo replay",
"description": "Runs the experimental shared demo API replay path with the same stable non-perf preset, bundled example data, and one-minute block count as the legacy runner.",
"report_group": {
"id": "omnidreams-demo",
"name": "Omnidreams Demo Comparison"
},
"tags": [
"manual",
"gpu",
"real-demo",
"omnidreams",
"i2v",
"replay",
"shared-demo"
],
"env": {
"CUBLAS_WORKSPACE_CONFIG": ":4096:8",
"PYTORCH_CUDA_ALLOC_CONF": "expandable_segments:True"
},
"command": [
"uv",
"run",
"--project",
"integrations/omnidreams",
"omnidreams-demo",
"replay",
"--preset-id",
"omnidreams-sv-2steps-chunk2-loc6-lightvae-lighttae",
"--example-data",
"--example-data-uuid",
"239560dc-33d1-11ef-9720-00044bcbccac",
"--total-blocks",
"226",
"--output",
"{output_dir}/omnidreams-sv-demo-replay.mp4"
],
"output_dir_arg": null,
"warmup_steps": 1,
"quality_baseline_compare": false,
"timeout_s": 7200
}
]
}
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading