Danmo Make

Language: English | 中文

Local image / video / audio studio on MLX (Apple Silicon Metal; Linux mlx[cuda]). Split stack: FastAPI + Vue 3 SPA + CLI + SQLite, with bilingual UI and fail-loud errors (no silent downgrades). Windows is temporarily unsupported.

Product name: Danmo Make. Runtime / CLI / sidecar ids stay danqing-* / DanQing*Engine for upgrade compatibility (AGENTS.md → Naming boundary).


Contributors / coding agents	AGENTS.md
Desktop (Tauri 2)	desktop/README.md
Engine architecture	docs/engine_architecture.md
Image benchmarks	tests/benchmark/README.md
Releases	GitHub Releases

Features

MLX runtime — single MLXContext stack: Metal on Apple Silicon, mlx[cuda] on Linux NVIDIA (per-model backends: ["mlx"] in the registry).
Plugin models — New families = registry JSON + model_configs + families/<family>/ + _transformer_registry; pipelines stay family-agnostic.
Contract API + CLI — Routes/CLI only through contracts + IImageEngine / IVideoEngine / IAudioEngine.
Global queue — One serial worker for image / video / audio; SSE progress, priority, persistent logs.
Studio UI — Vue 3 + Vite + TypeScript + @danqing/dq-ui; Create / Gallery / Models / Settings; bilingual registry names.
Infinite canvas — Grid and canvas share one asset library; sessions, lineage edges, staging, composer bindings.
Audio — ACE-Step music generation (danqing-audio, MLX) via MusicPipeline.
MCP for agents — Streamable HTTP at /mcp/ (tools: list_models, generate_*, edit_*, …). Pair with Danmo Work builtin danmo-make expert (bound-only).
Desktop apps — macOS MLX .dmg; Linux mlx[cuda] desktop / server tar.gz. Windows packs are temporarily unsupported.

Requirements

Platform	Notes
macOS (Apple Silicon)	Primary; MLX via Metal — `pip install -r requirements-macos.txt`
Linux + NVIDIA	MLX via mlx[cuda] — `pip install -r requirements-linux.txt`
Windows	Temporarily unsupported
Python	3.11+ (repo `.venv/` for web/dev)
RAM	32 GB+ recommended for large models
Node.js	Frontend + desktop packaging
ffmpeg / ffprobe	Recommended for video thumbnails / duration

Missing backends or unsupported actions fail loudly — no silent CLI/model fallback.

Install from release (recommended)

Download from GitHub Releases. Windows packs are temporarily unsupported.

macOS (Apple Silicon) — `.dmg`

Open the DMG and drag Danmo Make.app into Applications.
First launch may be blocked (unsigned / quarantine). Prefer Control-click → Open, or:

xattr -dr com.apple.quarantine "/Applications/Danmo Make.app"

More detail: desktop/README.md → quarantine tip.

Linux (x86_64 + NVIDIA) — thin server `.tar.gz`

CI ships danmo-make-linux-mlx-x86_64-<version>.tar.gz (headless API + built UI). Needs an NVIDIA driver; first start downloads mlx[cuda] into ~/.danmo-make/runtime-venv (console progress). No CPU fallback.

tar -xzf danmo-make-linux-mlx-x86_64-*.tar.gz
cd danmo-make-linux-mlx-x86_64-*

# optional:
# export DANQING_USER_DATA_DIR=$HOME/.danmo-make
# export DANQING_PIP_MIRROR=tuna    # official | tuna | aliyun
# export DANQING_HTTP_HOST=0.0.0.0
# export DANQING_HTTP_PORT=7800

./run.sh

UI / API: http://127.0.0.1:7800 · docs /docs · MCP /mcp/
Repair: ./run.sh --repair-runtime · reinstall: ./run.sh --reinstall-runtime · status: ./run.sh --status-runtime
Bundle also includes README.txt and danqing-runtime-setup

Linux desktop (AppImage / .deb) is packable locally (make pack-linux-desktop) but not attached by current CI.

Quick start (from source)

For contributors / local development. End users: use Install from release above.

Install (web / CLI)

git clone https://github.com/danmo-ai/danmo-make.git
cd danmo-make

python3.11 -m venv .venv
source .venv/bin/activate
# macOS Apple Silicon:
pip install -r requirements-macos.txt
# Linux (NVIDIA / mlx[cuda]):
# pip install -r requirements-linux.txt

Run (web)

make dev      # uvicorn --reload (:7800) + Vite HMR (:5800)
# make start / make stop

UI: http://localhost:5800 (proxies /api → :7800)
API / Swagger: http://localhost:7800/docs
MCP: http://127.0.0.1:7800/mcp/ (trailing slash)

Dev ports (Danmo line)

Product	Backend	Frontend
Make (this repo)	7800	5800
Work (Teams)	7801	5801
Inbox (Mail)	7802	5802

Override: DQ_BACKEND_PORT, DQ_FRONTEND_PORT.

Pack desktop / server (from source)

make pack-macos-desktop    # .app / .dmg (MLX Metal sidecar)
make pack-linux-desktop    # AppImage / .deb (mlx[cuda]; local)
make pack-linux-server     # Linux MLX thin server tar.gz

Windows is temporarily unsupported. Details: desktop/README.md.

CLI

bin/danqing-generate --model z-image-turbo --prompt "a cat on a windowsill"
bin/danqing-edit --model <id> --image input.png --prompt "add a hat" --operation rewrite
bin/danqing-video-generate --model <id> --prompt "ocean waves at sunset"
bin/danqing-audio-generate --model ace-step-xl-sft --prompt "lofi beat" --duration 10 --output /tmp/t.wav
bin/danqing-mcp   # stdio MCP host; discovers port via env / ~/.danmo-make/api.port / 7800

CLI ↔ REST: AGENTS.md.

Data layout

Path	Role
`~/.danmo-make/`	Control plane: workspace pointer, app config, logs, `api.port`, optional Linux `runtime-venv`
`{workspace}/config/`	Runtime `models_registry.json`, presets (seeded from `default_config/`)
`{workspace}/models/`	Weights / LoRAs
`{workspace}/outputs/`	Generations
`{workspace}/db/studio.db`	Tasks + assets (SQLite WAL)

Dev (make dev, no pointer): media root can stay the repo (./models, ./outputs, …); control plane is still ~/.danmo-make.

Override control plane: DANQING_USER_DATA_DIR.

Agent / MCP

With the API up:


Endpoint	`http://127.0.0.1:7800/mcp/` (streamable HTTP; `/mcp` is normalized to `/mcp/`)
Stdio	`bin/danqing-mcp`
Auth	Loopback free; remote needs `Authorization: Bearer <key>` — separate HTTP vs MCP keys (Settings → Integrations)

list_models filters by API action (generate / edit / upscale; aliases create→generate). Cards expose actions and type; LoRA adapters are omitted. Use action=generate before generate_image / generate_video.

Danmo Work: enable builtin connector danmo-make + expert (bound-only, not ambient).

Env overrides: DANQING_HTTP_API_KEY, DANQING_MCP_API_KEY, DANQING_MCP_BASE_URL.

Studio ↔ model `actions`

Tabs only list models that declare the required registry action (seeded from default_config/models_registry.json).

Image

Tab	Registry action	API
Text-to-image	`create`	`POST /api/images/generations`
Instruct / reference edit	`rewrite`	`POST /api/images/edits`
Inpaint	`retouch`	`POST /api/images/edits`
Outpaint	`extend`	`POST /api/images/edits`
Upscale	`upscale`	`POST /api/images/upscales`

API / MCP surface maps create→generate, rewrite/retouch/extend→edit.

Video

Tab	Registry action	API
Text-to-video	`create`	`POST /api/videos/generations`
Image-to-video	`animate`	`POST /api/videos/edits`

MiniMax H3 (minimax-h3-fl2va) — joint audio+video FL2VA on MLX (Metal / mlx[cuda], mlx >= 0.32.3, mlx-vlm >= 0.7.6, transformers >= 5.19). Correctness aligned with PipeNetwork/minimax-h3-mlx (scheduler t=1−σ, aspect-normalized RoPE, keyframe posterior sample). Generation is compute-bound; mlx-q4/q8 mainly reduces footprint. balanced / quality / oracle run the full Euler trajectory. draft only enables Turbo LoRA (6–8 steps recommended). Non-turbo clips are usually run at 8–16 steps; the registry default stays 30 so the sampling integral does not change silently. Denoiser reuse, fewer DiT layers, and a smaller internal canvas are lossy and are not turned on by presets. Tests: make test-h3-parity; smoke benchmark (installed bundle): make bench-h3-smoke.

Audio

Action	API
Text-to-music (`create`)	`POST /api/audios/generations`
Cover	`POST /api/audios/edits`

Infinite canvas (short)

Create → Canvas view: import (I), generate into staging (S snap), lineage edges (E / Y / G). Sessions via /api/canvas/sessions. See AGENTS.md for the full shortcut table.

ControlNet (FLUX.1)

Structural guide on text-to-image for flux1* (Canny / Depth / Redux); Fill model for retouch/extend. MLX stack only. Details in AGENTS.md → Gotchas.

Project layout

danmo-make/
├── backend/
│   ├── api/routes/       # REST
│   ├── mcp/              # MCP tools + model cards
│   ├── cli/              # bin/danqing-*
│   ├── core/             # contracts, interfaces, i18n
│   ├── engine/           # pipelines, families, runtime, common
│   ├── persistence/      # SQLite stores
│   ├── scheduler/        # TaskScheduler
│   └── main.py
├── frontend/             # Vue 3 SPA
├── desktop/              # Tauri 2 shell
├── bin/                  # CLI + danqing-mcp
├── default_config/       # factory registry / presets / locales
├── scripts/              # pack, gates, release
├── tests/benchmark/
├── docs/
└── out/                  # build artifacts (gitignored)

Architecture

REST / MCP / CLI
        ↓
TaskScheduler  (single global queue)
        ↓
DanQingImageEngine / DanQingVideoEngine / DanQingAudioEngine
        ↓
Pipelines + FamilyPlugin + RuntimeContext (MLX)
        ↓
V3TaskStore + SQLiteAssetStore

Add a model: registry → model_configs → families/<family>/ → weights.py → _transformer_registry. Checklist: AGENTS.md.

Release artifacts (CI)

Tag v* → .github/workflows/release.yml. Install steps: Install from release.

Platform	CI artifact
macOS Apple Silicon	MLX `.dmg` (Metal)
Linux x86_64	*`danmo-make-linux-mlx-x86_64-.tar.gz`** (thin server; mlx[cuda] on first `./run.sh`)
Windows	Temporarily unsupported

Local pack (not all attached by CI):

make pack-macos-desktop
make pack-linux-desktop    # AppImage / .deb — local only for now
make pack-linux-server

Single MLX stack (Metal or mlx[cuda]) — no separate torch CUDA engine.

Configuration

App settings — under the control plane / workspace (~/.danmo-make/… or {workspace}/config/.app_config.json): language, theme, default model, memory limit, queue policy, integration API keys.

Registry — {workspace}/config/models_registry.json (schema_version: 3). Sync factory → workspace: make sync-models-registry.

Useful env:

HF_ENDPOINT=https://hf-mirror.com
MLX_METAL_MEMORY_LIMIT=120
DANQING_USER_DATA_DIR=~/.danmo-make
# Prefer Settings → Integrations over plaintext keys:
# DANQING_HTTP_API_KEY=...
# DANQING_MCP_API_KEY=...

Development

Command	Purpose
`make dev` / `stop`	API + Vite
`make dev-desktop`	Tauri + Vite (`SKIP_BACKEND=1` if API already up)
`make frontend-build`	→ `out/frontend/dist/`
`make verify-engine-stack`	Governance + engine unit tests
`make check-consistency`	Registry / routes / i18n / frontend gates
`make bench-eval-smoke`	Image eval smoke
`make clean`	Remove `out/`

API overview

Area	Endpoints
Images	`POST /api/images/generations` \| `edits` \| `upscales`
Videos	`POST /api/videos/generations` \| `edits` \| `upscales`
Audios	`POST /api/audios/generations` \| `edits`
Tasks	`GET/PATCH/DELETE /api/tasks/{id}`, SSE `…/stream`, `…/diagnose`
Assets / canvas	`/api/assets`, `/api/canvas/sessions`
Models	`/api/models`, `/api/registry`
MCP	`/mcp/`
System	`/api/system/health`, `/api/settings/*`

Interactive docs: http://localhost:7800/docs

License

MIT

Navigation Menu

Repository navigation

About

Repository files navigation

Danmo Make

Features

Requirements

Install from release (recommended)

macOS (Apple Silicon) — `.dmg`

Linux (x86_64 + NVIDIA) — thin server `.tar.gz`

Quick start (from source)

Install (web / CLI)

Run (web)

Dev ports (Danmo line)

Pack desktop / server (from source)

CLI

Data layout

Agent / MCP

Studio ↔ model `actions`

Image

Video

Audio

Infinite canvas (short)

ControlNet (FLUX.1)

Project layout

Architecture

Release artifacts (CI)

Configuration

Development

API overview

License

About

Releases

Packages

Contributors

Languages

Name		Name	Last commit message	Last commit date
.cursor/skills/build-release		.cursor/skills/build-release
.github		.github
.vercel-tmp		.vercel-tmp
backend		backend
backend_llm		backend_llm
bin		bin
default_config		default_config
desktop		desktop
docs		docs
frontend		frontend
scripts		scripts
shared		shared
tests		tests
.gitignore		.gitignore
AGENTS.md		AGENTS.md
Cargo.toml		Cargo.toml
Makefile		Makefile
README.md		README.md
README_zh.md		README_zh.md
requirements-linux.txt		requirements-linux.txt
requirements-macos.txt		requirements-macos.txt
requirements.txt		requirements.txt

Latest commit

History

Folders and files

Repository files navigation

Danmo Make

Features

Requirements

Install from release (recommended)

macOS (Apple Silicon) — .dmg

Linux (x86_64 + NVIDIA) — thin server .tar.gz

Quick start (from source)

Install (web / CLI)

Run (web)

Dev ports (Danmo line)

Pack desktop / server (from source)

CLI

Data layout

Agent / MCP

Studio ↔ model actions

Image

Video

Audio

Infinite canvas (short)

ControlNet (FLUX.1)

Project layout

Architecture

Release artifacts (CI)

Configuration

Development

API overview

License

About

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages

macOS (Apple Silicon) — `.dmg`

Linux (x86_64 + NVIDIA) — thin server `.tar.gz`

Studio ↔ model `actions`