Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
204 commits
Select commit Hold shift + click to select a range
6f27698
Add audio_lyrics runtime setting so ACE-Step generates vocals
Skystar9999 Oct 16, 2026
12647c9
docs: plan five ProsperoAI improvements
quatrixone Oct 16, 2026
46a891d
docs: expand ProsperoAI improvement roadmap
quatrixone Oct 16, 2026
d53981f
docs: add three improvements to roadmap
quatrixone Oct 16, 2026
9a2da55
Add YuE2 song generation on Vulkan
Skystar9999 Oct 16, 2026
3021bf3
Make YuE2 build against the shared pinned ggml
Skystar9999 Oct 16, 2026
ed48a66
Keep preset order stable and harden the compat header include
Skystar9999 Oct 16, 2026
218ad23
Implement ten ProsperoAI improvements
quatrixone Oct 16, 2026
0c39718
Track implementation status for the improvement plan
quatrixone Oct 16, 2026
73244e2
Point the compat header configure_file at tools/
Skystar9999 Oct 16, 2026
050eb43
Restore the causal-decoder runtime for YuE2
Skystar9999 Oct 16, 2026
00c9ac3
Improve incremental and CI build speed
quatrixone Oct 16, 2026
6bd8a62
Fix C++ formatting for CI lint
quatrixone Oct 16, 2026
c941d5c
Fix integration tests for updated web and memory APIs
quatrixone Oct 16, 2026
ebb6c3f
Keep host audio preparation patches repeatable
quatrixone Oct 16, 2026
3fb6010
Show API security status in settings
quatrixone Oct 16, 2026
46f933f
yue2: size graph arenas for full-length songs
Skystar9999 Oct 16, 2026
2c24075
Correlate diagnostic operation outcomes
quatrixone Oct 16, 2026
c10c8ab
yue2: right-size arenas for base PS5 heap budget
Skystar9999 Oct 17, 2026
54b747b
yue2: surface audiocpp_last_error in generate response
Skystar9999 Oct 17, 2026
fba1940
yue2: size graph arenas per console profile (PS5 Pro gets larger VAE …
Skystar9999 Oct 17, 2026
055f0b9
yue2: ps5pro arenas to VAE 512 (1024 crashes app at VAE decode, 64 to…
Skystar9999 Oct 17, 2026
cfe21e0
yue2: cap semantic_max_tokens at 1500 to bound VAE decode buffer
Skystar9999 Oct 17, 2026
1cb9cd1
Cover model preparation recovery and API busy errors
quatrixone Oct 17, 2026
49f324c
Record PS5 browser session verification
quatrixone Oct 17, 2026
b304718
yue2: raise semantic cap to 5000 (~3.3 min) now that VAE tiling is fi…
Skystar9999 Oct 17, 2026
1a6bfae
Match memory observations to active settings
quatrixone Oct 17, 2026
9b8c745
Record live PS5 model concurrency verification
quatrixone Oct 17, 2026
5faa43e
Record PS5 diagnostics journal verification
quatrixone Oct 17, 2026
9bde46f
yue2: raise semantic cap to 10000 (~6.6 min) for full-length songs
Skystar9999 Oct 17, 2026
60adf85
Remove unused root copy of the YuE2 ggml compat header
Skystar9999 Oct 17, 2026
3ad6ea5
Forward YuE2 engine options and save run artifacts
Skystar9999 Oct 17, 2026
380d1b4
Fix work-tree prefix check: compare() truncated the 27-char prefix
Skystar9999 Oct 17, 2026
e69be5e
Add Web UI for music engine options and artifact downloads
Skystar9999 Oct 17, 2026
fd767c8
Cap NAR attention tiles on base PS5 to fit long songs with large ABC
Skystar9999 Oct 17, 2026
fadccdd
web: dedicated Music Studio page (/music) + music file/ABC endpoints
Skystar9999 Oct 17, 2026
a16a326
web/music: hide key-bar via CSS so display:flex can't override [hidden]
Skystar9999 Oct 17, 2026
4b7adcd
web: Music Studio link in main nav + collapsible ABC block; hide key-…
Skystar9999 Oct 17, 2026
1f22b67
web/music: auto-save typed ABC; only send abc_file when file exists
Skystar9999 Oct 17, 2026
e1cd47b
music: DELETE /api/music/file endpoint + delete button in library UI
Skystar9999 Oct 17, 2026
3349f4e
web/music: UI version chip (diagnostic tab-uri vechi)
Skystar9999 Oct 17, 2026
84d7596
server: drop missing abc_file from audio_options instead of failing g…
Skystar9999 Oct 17, 2026
5f1e323
web/music: always send audio_options (empty clears stale abc_file fro…
Skystar9999 Oct 17, 2026
088ce81
web/music: load ABC from local file + clear editor buttons
Skystar9999 Oct 17, 2026
6484cf2
server: pass audio_options through untouched unless an abc_file is ac…
Skystar9999 Oct 17, 2026
b68e813
music: track-name field -> auto-rename output to nume_seedN (rename e…
Skystar9999 Oct 17, 2026
e9b06e8
web/music: regen button (seed+1, pastreaza tot)
Skystar9999 Oct 17, 2026
6863485
music: rename checks src existence before dst (404 beats 409 for miss…
Skystar9999 Oct 17, 2026
18a0afd
music: clamp VAE decode tiles to PS5 budget on every model load; Engl…
Skystar9999 Oct 17, 2026
f9fe97e
music: call the VAE tile clamp at model load and preserve the pinned …
Skystar9999 Oct 18, 2026
e16c550
spike: add sheetsage2 to PS5 audio.cpp model set (cover feature feasi…
Skystar9999 Oct 18, 2026
2468154
Cover feature: native SheetSage2 audio->ABC transcription on PS5
Skystar9999 Oct 18, 2026
7c31878
router host test: stub ps5_sheetsage_transcribe/release (fixes link i…
Skystar9999 Oct 18, 2026
c8cbffd
Cover debug: file-based stage log in sheetsage adapter + surface adap…
Skystar9999 Oct 18, 2026
314c3c8
music upload: part-0 fopen 'wb' not 'wbx' (repeat uploads of same nam…
Skystar9999 Oct 18, 2026
4b6f7e9
cover: audio_options backend=cpu passthrough (isolate ggml-Vulkan run…
Skystar9999 Oct 18, 2026
7ba0c3b
cover: forward sheetsage2.* audio_options to audiocpp + PS5 default d…
Skystar9999 Oct 18, 2026
f1be7f0
cover: fix sheetsage2.* passthrough prefix length (compare(0,11) — 10…
Skystar9999 Oct 18, 2026
38719a9
link: route ggml allocations >=8MB to PS5 direct memory (11 GiB pool)…
Skystar9999 Oct 18, 2026
cee2719
runtime: enable direct-arena fallback for SheetSage transcription and…
Skystar9999 Oct 18, 2026
420a772
sheetsage: drop ps5SetDirectFallback call (symbol lives in the app_cp…
Skystar9999 Oct 18, 2026
3193dae
sheetsage: probe ps5_heap_stats + 1 GiB title-heap allocation before …
Skystar9999 Oct 18, 2026
a2e3e86
sheetsage: probe posix_memalign(64,1GiB) exactly as ggml calls it + a…
Skystar9999 Oct 18, 2026
0f3ed10
sheetsage: replace allocation probes with zero-touch measurement + SI…
Skystar9999 Oct 18, 2026
5328fef
sheetsage: detached sampler thread logging heap+pool every 200ms via …
Skystar9999 Oct 18, 2026
6974bb7
sheetsage: bake validated PS5 defaults (cpu backend, q4_0, weight_con…
Skystar9999 Oct 18, 2026
fad0c77
sheetsage: flip PS5 default to backend=vulkan (validated 62s vs 376s,…
Skystar9999 Oct 18, 2026
6af41bf
web/music: UI v25 custom player - big seekbar under play button, per-…
Oct 18, 2026
e737e02
http: HTTP Range/206 for /download0 media (iOS seek); music UI v26: m…
Oct 18, 2026
21f9069
http: fix const-correctness on Range dash pointer (clang)
Oct 18, 2026
8bec82d
http: treat only digits as present range end (Chrome sends 'bytes=N-\…
Oct 18, 2026
b9d0bf0
http: fix find_header loop bound never testing the colon position (Ra…
Oct 18, 2026
3988bff
web/music v27: style box becomes 3-row textarea; all form fields pers…
Oct 19, 2026
86198ca
music v28: per-track metadata sidecar (.track.json via /api/music/met…
Oct 19, 2026
9a4ee6c
ci: fetch pinned Lapy helper from ArkSama fork (blackbearreloaded ups…
Oct 19, 2026
f269720
web/music: empty meta object counts as no settings for the Cover button
Oct 19, 2026
30aa4dd
web/music v29: per-player volume slider (persisted, applies live to a…
Oct 19, 2026
d30e741
music-studio: stems separation UI + /stems-worker.js route (v30)
Skystar9999 Oct 19, 2026
a2b9ea9
csp: allow wasm-unsafe-eval + blob (ONNX Web stems need wasm compile …
Skystar9999 Oct 19, 2026
2971492
stems-worker: CSP-safe loader (fetch+blob+dynamic import, no eval, MI…
Skystar9999 Oct 19, 2026
67bca32
http: COOP/COEP headers enable SharedArrayBuffer -> threaded wasm EP …
Skystar9999 Oct 19, 2026
a9997ee
Sprint 3: browser-orchestrated multi-seed queue + /api/system/restart…
Skystar9999 Oct 19, 2026
af1fdc5
web: restartTitle retry loop + no-cors launch (PNA preflight blocks C…
Skystar9999 Oct 19, 2026
f2aae7f
Sprint 4: /api/music/uploadbin streaming binary uploads (64 MiB) + Sa…
Skystar9999 Oct 19, 2026
3197a83
http: defer oversized-body 413 to post-header checks so uploadbin str…
Skystar9999 Oct 19, 2026
c7a705b
http: uploadbin recv retry-on-idle (nonblocking accept sockets return…
Skystar9999 Oct 19, 2026
872aac9
http: uploadbin proper ok-flag (body can lag headers by a packet; wri…
Skystar9999 Oct 19, 2026
18d2aa4
yue2: default cot=melody (off blows up Qwen decode graph on full-leng…
Skystar9999 Oct 19, 2026
bc0ccc1
Stems feature: native HTDemucs 4-stem separation on PS5 Vulkan
Skystar9999 Oct 19, 2026
1a793b0
stems: add ps5_stems_separate/release stubs to the host router test
Skystar9999 Oct 19, 2026
9d75621
fetch-opengl-sdk: mirror fallbacks after upstream account rename
Skystar9999 Oct 19, 2026
76947a5
stems: restore fast_projection_modules for the demucs link, mirror bu…
Skystar9999 Oct 19, 2026
79d91c2
stems: neutralize ggml_mul_mat_pack4 for the pinned ggml
Skystar9999 Oct 19, 2026
69e96dc
stems: WAV reader never returned true — chunk walk and EOF guard bugs
Skystar9999 Oct 19, 2026
99defc1
stems: resample 48k input to the engine's 44.1 kHz domain
Skystar9999 Oct 19, 2026
c2e0f77
stems: set_audio takes FRAMES, not sample count — stems were 2x long
Skystar9999 Oct 19, 2026
e628e40
stems: overwrite stale stem files (wbx -> wb)
Skystar9999 Oct 19, 2026
7a920ef
music UI: group stems under parent track + server-side stems ZIP
Skystar9999 Oct 19, 2026
2b02798
stems zip: send_all takes const char* (uint8_t records need a cast)
Skystar9999 Oct 19, 2026
d2fe8b6
stems zip route: prefix is 27 chars (handler got 'k=Name.wav' at 25)
Skystar9999 Oct 19, 2026
f562724
music UI: Cover+ABC menu item — one-click subtle-variation recipe
Skystar9999 Oct 19, 2026
b567c5f
sheetsage: overwrite artifacts, contiguous-memory gate, auto-restart …
Skystar9999 Oct 19, 2026
4726b23
sheetsage gate: require 7 GiB contiguous (weights land in the direct …
Skystar9999 Oct 19, 2026
a53fe32
music UI v31: ABC generation status line (busy/ready/failed) + back-t…
Skystar9999 Oct 20, 2026
0727bd8
music UI v33: PS5-stems survive dropped client connections — poll for…
Skystar9999 Oct 20, 2026
19eb6d4
async generate jobs: /api/generate async:true -> job_id + /api/jobs p…
Skystar9999 Oct 20, 2026
b855134
async jobs: host-build shim mapping job threads to pthreads (CI harne…
Skystar9999 Oct 20, 2026
ef40944
async jobs: reinterpret_cast for pthread_t pointer conversions
Skystar9999 Oct 20, 2026
9e5d8c9
yue2: contiguous-memory gate on cold engine load (7 GiB) + UI auto-re…
Skystar9999 Oct 20, 2026
2070fce
UI v43: restart loop survives DERP tunnel — AbortController timeouts …
Skystar9999 Oct 20, 2026
872b625
Build #19: server-side self-heal restart — loopback mount+launch on g…
Skystar9999 Oct 20, 2026
79d405b
self_restart: BSD loopback on host harness (no sceNet* to link), libS…
Skystar9999 Oct 20, 2026
b2d217b
Build #20: mount Content-Length 24 (was truncating JSON), gate 7.5 Gi…
Skystar9999 Oct 20, 2026
c934fdf
Build #21: self-heal matcher on content not state (adapter reports VA…
Skystar9999 Oct 20, 2026
9196901
UI v46: Enhance (style+lyrics, mlx-serve prompts via /api/chat MiniCP…
Skystar9999 Oct 20, 2026
80ced87
UI v48: Enhance default model -> Ternary-Bonsai-2-27B-PTQ1_0 (native,…
Skystar9999 Oct 20, 2026
ef80397
UI v49: chat-model selector in header (syncs /api/models/selection — …
Skystar9999 Oct 20, 2026
6873fa2
UI v50 + build #22: /api/chat unload_after (release chat model right …
Skystar9999 Oct 20, 2026
63b81e0
UI v50b: mark active chat model with checkmark in selector
Skystar9999 Oct 20, 2026
295ca6d
UI v50c: job-lost detection on app restart + elapsed timer during gen…
Skystar9999 Oct 20, 2026
5666cb9
Probe: /api/system/memory dumps direct-pool allocation map (fragmenta…
Skystar9999 Oct 20, 2026
0f0d6ae
Fragmentation hunt: log >=64MiB vk allocs + yue2 gate probe 7500->5000
Skystar9999 Oct 20, 2026
54897de
yue2: lower memory gate 5000->2500 MiB (endurance data: Bonsai 5.6GB …
Skystar9999 Oct 20, 2026
b4e64ea
UI v51: portrait header wraps (chat-model selector was off-screen on …
Skystar9999 Oct 20, 2026
7de2850
UI v52: job-lost (app self-restart racing the poll) now auto-waits an…
Skystar9999 Oct 20, 2026
f574c2b
ggml-vulkan slab sub-allocation: small (<64MiB) device buffers carved…
Skystar9999 Oct 21, 2026
a8bb2e3
RADV arena patch: keep the kernel direct-memory pool whole across mod…
Skystar9999 Oct 21, 2026
97bbe27
CI arena guard: the cutoff is defined in the winsys source, not the h…
Skystar9999 Oct 21, 2026
4994fed
RADV arena: keep window32 buffers dedicated
Skystar9999 Oct 21, 2026
071d161
CI: re-apply the arena patch when its content changes (stamp hash)
Skystar9999 Oct 21, 2026
4f68307
Disable ggml-vulkan slab engine: it pinned a 256 MiB host map per sla…
Skystar9999 Oct 21, 2026
b65b089
radv arena patch: log arena make/take/give so a fault names its alloc…
Skystar9999 Oct 21, 2026
ab28687
Re-run CI: previous radv setup step died without error output (suspec…
Skystar9999 Oct 21, 2026
a94983c
CI debug: dump the full radv meson setup log on setup failure
Skystar9999 Oct 21, 2026
2090069
radv arena logging: fix %% typo that misaligned the PRIu64 argument
Skystar9999 Oct 21, 2026
df4f88a
radv arena: return an emptied arena segment so it stops squatting on …
Skystar9999 Oct 21, 2026
7dfffc3
radv arena v3: gigabyte buffers join a 4 GiB big arena claimed while …
Skystar9999 Oct 21, 2026
33fa024
radv arena: drop per-allocation debug logs, restore quiet CI setup tail
Skystar9999 Oct 21, 2026
1a6d351
radv arena v4: chunk-backed 8 GiB big arena; SheetSage/YuE2 gates che…
Skystar9999 Oct 21, 2026
c1030aa
ci: full meson setup logs + step markers around the silent radv confi…
Skystar9999 Oct 21, 2026
d75bbae
radv arena: forward-declare map_fixed above arena_take (the implicit-…
Skystar9999 Oct 21, 2026
673ec8c
web: fix 'rate is not defined' breaking browser Cover decode (UI v53)
Skystar9999 Oct 21, 2026
8c5024d
tools: UI smoke harness for post-deploy validation
Skystar9999 Oct 21, 2026
74b2d3d
master: move mastering from browser DSP to console-side endpoint
Skystar9999 Oct 21, 2026
ed975e5
tools: harness full-mode expects console-side master output (v54)
Skystar9999 Oct 21, 2026
ea45740
tools: harness tolerates PS5 clock skew + external file fallback
Skystar9999 Oct 21, 2026
607c7a1
tools: strict yue2-<ms>-<idx>.wav filter for the generate check
Skystar9999 Oct 21, 2026
4471285
vulkan: idle heap defrag — self-restart when pool fragmented and quiet
Skystar9999 Oct 21, 2026
29f5687
vulkan: close the defrag anonymous namespace
Skystar9999 Oct 21, 2026
c7ebd4b
vulkan: defrag threshold 5->8 GiB + make it observable
Skystar9999 Oct 21, 2026
de158c8
Guard resident model admission and drain HTTP workers before teardown
quatrixone Oct 24, 2026
1f6069c
Merge release stability and Music Studio work
quatrixone Oct 24, 2026
c049dec
Refresh project Graphify map
quatrixone Oct 24, 2026
4a26727
Fix PR 43 media regressions
quatrixone Oct 28, 2026
4a783d8
Document unified cross-platform audio workspace
quatrixone Oct 28, 2026
8562d3e
Add shared audio workflow domain API
quatrixone Oct 28, 2026
9102211
Require explicit model selection for audio workflows
quatrixone Oct 28, 2026
bb0bcf2
Allow resident SheetSage retry admission
quatrixone Oct 28, 2026
1fd0828
Add HTTP audio workflow adapter
quatrixone Oct 28, 2026
3ec974f
Fix audio workflow model selection atomicity
quatrixone Oct 28, 2026
9745711
Test audio runtime lock contention safely
quatrixone Oct 28, 2026
73b58d2
Make audio runtime lock probe deterministic
quatrixone Oct 28, 2026
987b68f
feat(web): move audio workflows into Workspace
quatrixone Oct 28, 2026
fe92ce7
fix(web): address Workspace audio review findings
quatrixone Oct 28, 2026
8351938
Implement native unified Workspace audio workflows
quatrixone Oct 28, 2026
b310895
fix(native): honor audio queue stop and model eligibility
quatrixone Oct 28, 2026
9c5722d
Show live Vulkan memory in model headers
quatrixone Oct 28, 2026
95af3c1
Bound Vulkan memory debug job name
quatrixone Oct 28, 2026
2251575
Add Qwen image editing and Workspace media settings
quatrixone Oct 30, 2026
5e17c4d
feat: add PS5SD image model metadata
quatrixone Nov 2, 2026
a493f63
Remove Qwen Image product path
quatrixone Nov 2, 2026
ed19f67
Fix legacy Qwen directory deletion
quatrixone Nov 2, 2026
2729d69
Add generic PS5SD image workflows
quatrixone Nov 2, 2026
5e5a297
Fix deletion of output-reference media
quatrixone Nov 2, 2026
3550f9b
Serialize archived media reference updates
quatrixone Nov 2, 2026
ee7bc8c
feat(web): add capability-aware image studio
quatrixone Nov 2, 2026
9bd6f81
fix(web): address image workflow review findings
quatrixone Nov 2, 2026
110f3db
docs: record PS5SD handoff state
quatrixone Nov 3, 2026
2504902
style: format image workflow test harness
quatrixone Nov 3, 2026
97c09b4
docs: add approved PS5SD image plan
quatrixone Nov 3, 2026
30d29ca
fix(ci): fetch pinned diffusion headers and version
quatrixone Nov 3, 2026
67d8a15
Load and run every curated image preset on the GPU
quatrixone Nov 3, 2026
924d6af
Repair the web Media page, conversation delete and confirmations
quatrixone Nov 3, 2026
0c037e9
Give the console a Media gallery and mode-aware lists
quatrixone Nov 3, 2026
d28166e
Reach per-conversation folders from the console gallery
quatrixone Nov 3, 2026
e41bdd8
Let the Media page delete the files it lists
quatrixone Nov 3, 2026
58fdabc
Give FLUX back its own denoiser and room to sample
quatrixone Nov 3, 2026
9aa01bf
Drop the FLUX.3 presets the runtime cannot load
quatrixone Nov 3, 2026
fcc9865
Make the upscaler a factor instead of a switch
quatrixone Nov 3, 2026
0a1135d
Stop a memory reading from freezing the interface
quatrixone Nov 3, 2026
68ea743
Rewrite the handoff state for the current branch
quatrixone Nov 3, 2026
9832bad
Show the generating model in the memory readout
quatrixone Nov 3, 2026
d42ab26
Open every image model at 512x512 in the Studio
quatrixone Nov 3, 2026
2f91c79
Keep the web memory readout alive during generation
quatrixone Nov 3, 2026
409d9c2
Stream the split-file image weights from disk
quatrixone Nov 3, 2026
696080c
Size the image weight budget from the heap that is actually free
quatrixone Nov 3, 2026
16b6d2a
Render every image model at 512x512 by default
quatrixone Nov 3, 2026
2b8ba3c
Let Media delete the entries it refuses to let go of
quatrixone Nov 3, 2026
8bd59ce
Give Image Studio the Music Studio layout and a library
quatrixone Nov 3, 2026
7fb6a5b
Upscale a picture on request, not every console render
quatrixone Nov 4, 2026
0cb7bf6
Reload an image model when the heap cannot hold another pass
quatrixone Nov 4, 2026
5aad116
Update shared Vulkan runtime to upstream llama.cpp
quatrixone Nov 11, 2026
1b62b87
Merge latest main into PR 43
quatrixone Nov 11, 2026
52eac10
Fix PS5 media workflows and prepare release 01.007.000
quatrixone Nov 11, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 13 additions & 1 deletion .github/workflows/build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -139,7 +139,7 @@ jobs:
run: make lint

- name: Fetch pinned runtime test headers
run: python3 tools/deps.py fetch llama-cpp llama-prism
run: python3 tools/deps.py fetch llama-cpp llama-prism stable-diffusion-vulkan

- name: Run host regression tests
run: make test
Expand Down Expand Up @@ -311,6 +311,8 @@ jobs:
CC: clang-18
CXX: clang++-18
BUILD_JOBS: 4
CCACHE_DIR: ${{ github.workspace }}/build/ccache
CCACHE_MAXSIZE: 1G
PROSPERO_REQUIRE_VULKAN_RUNTIME: "1"
steps:
- name: Check out source
Expand All @@ -319,6 +321,13 @@ jobs:
run: |
sudo apt-get update
sudo apt-get install --yes clang-18 cmake ninja-build ccache glslc spirv-headers libvulkan-dev libespeak-ng-dev mesa-vulkan-drivers vulkan-tools git unzip
- name: Restore Vulkan runtime compiler cache
uses: actions/cache@0057852bfaa89a56745cba8c7296529d2fc39830 # v4
with:
path: build/ccache
key: ccache-vulkan-${{ runner.os }}-${{ runner.arch }}-clang18-${{ github.sha }}-${{ github.run_id }}-${{ github.run_attempt }}
restore-keys: |
ccache-vulkan-${{ runner.os }}-${{ runner.arch }}-clang18-
- name: Select the software Vulkan driver
shell: bash
run: |
Expand All @@ -332,3 +341,6 @@ jobs:
run: bash tools/build-vulkan-runtime.sh host
- name: Run mandatory ABI and Vulkan media tests
run: python3 -m unittest discover -s tests -p test_vulkan_runtime.py -v
- name: Report Vulkan runtime compiler cache statistics
if: always()
run: ccache --show-stats
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -29,3 +29,6 @@ models/*
*.sprx
*.prx
*.pkg
graphify-out/cache/
graphify-out/.graphify_*
graphify-out/[0-9]*/
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
# Task 4 implementation report — Native Workspace

## Result

Implemented native Workspace mode/model behavior and the Audio workflows using the existing App
worker and shared `audio_workflows` operations. The native build script already linked
`src/audio_workflows.cpp`, so no build-script change was required.

Workspace mode selection offers Text, Audio, SD, and TTS and filters the model chooser by the
runtime-reported capability. Staging a model or generation preferences is runtime-neutral;
generation submission selects/prepares a staged model and applies the staged options in the worker.
Switching models for an existing conversation now also updates that conversation's model
attribution at submit time, so subsequent sends remain associated with the selected model.

Audio actions (music, Cover to ABC, stems) execute on the App's serialized worker, report progress
and stable result/error state, and reject a second operation while busy. The native library chooser
only lists existing WAV or ABC entries from `work/audio/`. The transient controller queue runs
variants sequentially with consecutive seeds, supports stopping after the active operation, and
leaves failed and later pending entries visible for retry or clearing.

Controller regressions cover all four capability categories, empty capability sets, staged model
and option edits without runtime selection/preparation or settings mutation, submit-time selection
and final options, submit-time model switching, source forwarding through the shared operation,
pre-runtime source rejection, worker/runtime failures, and busy-operation rejection.

## TDD and verification

- The controller regression was first run against the missing APIs and failed as expected (the
initial red run occurred before the worker/UI implementation).
- A later submit-time model-switch regression initially failed because the session's model
attribution stayed on the prior model; the worker now updates the attribution, and the focused
regression passes.
- `PYTHONPATH=tests HOST_CXX=clang++-18 HOST_CC=clang-18 python3 -m unittest test_native_controller.NativeController.test_workspace_modes_and_audio_actions -v` — PASS.
- `HOST_CXX=clang++-18 HOST_CC=clang-18 make test` — PASS: 110 tests, 2 skipped (optional real-model cache and host Vulkan parity tests).
- `make format-check` — PASS.
- `PROSPERO_APP_TITLE=PPSA99023 bash tools/build-vulkan-native.sh` — PASS; local native app folder built under `build/vulkan-runtime/PPSA99023`.
- `git diff --cached --check` — PASS before final report/staging review.

## Scope and limitations

- No console command, deployment, launch, or hardware test was run. Native UI verification on
hardware remains deferred for user approval as requested.
- No push was performed.
- Existing unrelated KV-cache and web/SheetSage recovery changes remain outside the Task 4 commit;
the KV-cache hunks in overlapping native files must remain unstaged. Other unrelated dirty files
are likewise preserved.
- The current branch is `fix/pr43-must-fix`; the requested Task 4 commit will be made here, without
pushing.

## Fix round — queue Stop interleaving and music-model eligibility

The queue's next-item dispatch now passes through a small tested decision helper. If the queue is
active with no current item while another App worker is busy, a Stop request is consumed once that
worker clears; the queue becomes inactive without changing pending item states or starting another
variant. The regression exercises the busy → Stop → idle sequence.

The native Create music and Queue variants actions now check the shared workflow's music-model
eligibility before prompting. The guard follows the local shared-operation contract: SheetSage and
HTDemucs IDs are reserved for Cover and stems, while the runtime registry routes ACE-Step and Yue2
to their dedicated generation adapters and other audio IDs through Stable Audio. Ineligible
selections receive an explanatory message without starting a job.

- RED: `PYTHONPATH=tests HOST_CXX=clang++-18 HOST_CC=clang-18 python3 -m unittest test_native_controller.NativeController.test_workspace_modes_and_audio_actions -v` failed while compiling the new queue regression because the dispatch helper did not yet exist.
- GREEN: the same focused controller command passed after introducing the decision helper and wiring it into queue dispatch.
- `HOST_CXX=clang++-18 HOST_CC=clang-18 make test` — PASS: 110 tests, 2 skipped (optional real-model cache and host Vulkan parity tests). The run emitted two `ResourceWarning`s for unclosed sockets in existing search MCP tests; both tests passed.
- `make format-check` — initially reported formatting violations in the new UI/test lines; after applying targeted clang-format, rerun passed.
- `PROSPERO_APP_TITLE=PPSA99023 bash tools/build-vulkan-native.sh` — PASS; local native app built under `build/vulkan-runtime/PPSA99023`.
- Eligibility checks in `tests/audio_workflows_test.cpp` cover ACE-Step, Stable Audio and Yue2 as music-eligible, and reject SheetSage, HTDemucs and an empty ID.
- No console commands, deployment, launch, or hardware tests were run; no push was performed.
18 changes: 18 additions & 0 deletions AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,16 @@ Your task is whatever the user's prompt asks. `VK_ACTIVE.md`'s "Next" list is ba
where things stand, not a queue to work through unprompted — say so if the prompt and that list
disagree about what to do next.

## Codebase graph

- For architecture and code-flow questions, use the Graphify skill and query
`graphify-out/graph.json` first when it exists.
- Build the project graph with `graphify .` when no graph exists. After changing code or docs,
update it with `graphify . --update` before using it for another query.
- If full semantic extraction has no configured LLM backend, use `--code-only` and keep working;
do not ask for or expose API keys.
- Keep generated graph artifacts under `graphify-out/`.

## Build and verify

- Keep generated user-facing outputs in their persistent modality folders: `work/image/`,
Expand Down Expand Up @@ -143,6 +153,14 @@ port 2323), process list, launch and screenshots.
- Commit only on the WIP branch unless the user asks otherwise. Push only when asked.
- Do not add `Co-Authored-By` or "Generated with Claude Code" lines to commits or PR text.

## Active PS5SD image-model handoff

- Before resuming the PS5SD Image Studio work for PR #43, read the root `state.md` for completed
tasks, uncommitted files to preserve, pending checks, and the last known console/PR state.
- Keep project progress and volatile blockers in `state.md`; do not turn task-specific status into
permanent console policy here. The owner deferred tests for the handoff/documentation work; honor
the current request's scope and do not run tests or console checks for documentation-only tasks.


## Debugging a title that does not start (lessons from PPSA99014-19)

Expand Down
13 changes: 13 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,18 @@
# Changelog

## 01.007.000

- Updated the shared Vulkan inference runtime to upstream llama.cpp and GGML, including PS5
and Ternary Bonsai compatibility for the upstream API changes.
- Image Studio now passes uploaded images and masks reliably, and SDXL ControlNet keeps its
model weights resident alongside the guide network during sampling.
- Fixed Cover and Stems rejecting valid WAV files on PS5; both workflows now produce their
expected artifacts.
- Added symlink-safe file checks for image upload leases and audio workflow inputs.
- Verified all 25 installed curated model presets and their applicable workflows on the PS5
test title. Two optional local GGUFs remain outside the supported catalog because they
exceed available console Vulkan memory.

## Unreleased

- Search now reaches 41 providers in nine selectable groups from the console itself: the
Expand Down
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ how it is built, and what a run on a console showed.
> on the PS5 GPU. It is not production software.

> [!NOTE]
> `vulkan-runtime` uses one upstream GGML v0.26.0/Vulkan runtime for llama.cpp text,
> `vulkan-runtime` uses one upstream GGML/Vulkan runtime for llama.cpp text,
> Stable Diffusion, audio.cpp and Kokoro adapters on RADV. The dedicated AGC inference
> backend is removed. CPU operations still handle remaining media kernels; RADV
> continues to use the platform GPU driver. See [current status](docs/VK_ACTIVE.md),
Expand Down Expand Up @@ -376,6 +376,7 @@ to suggest another.
- Vision models: let a text model look at a picture.
- Image-to-image, and variations of a generated picture.
- More image models beside SD-Turbo, with size and step settings.
- Qwen-Image 2.1 text-to-image using the PS5-sized GGUF diffusion and text-encoder weights.
- Speech to text: dictate a prompt through the DualSense microphone.
- Spoken answers: read a text answer aloud, with a choice of voices.
- Personas and system prompts, saved per conversation.
Expand Down
2 changes: 1 addition & 1 deletion THIRD_PARTY_NOTICES.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ POSSIBILITY OF SUCH DAMAGE.

The shared-Vulkan SD compile probe fetches stable-diffusion.cpp (MIT) at
`f89d9b13d730eabeede7314ce49dacd18d3c90c2`, pinned in `tools/deps.json`.
The experimental shared folder builds this source against upstream GGML v0.26.0; default
The experimental shared folder builds this source against the pinned upstream GGML; default
release packaging retains the previously shipped media runtime until console gates pass.
Host-only recursive PickleValue adaptation and constant-initialized TLS declarations
are maintained in `tools/vulkan-runtime/`; the pinned source checkout is unchanged.
Expand Down
Loading
Loading