Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 30 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,12 +41,13 @@ Version 0.5.0 turns a raw talking-head recording into a clean, captioned cut: ve
| **Captions** | Burned-in captions timed to the words, as short phrases or one word at a time | `clip timeline captions` |
| **Reframe** | Turns a landscape cut into 9:16, 1:1 or 4:5, filling the frame and choosing the part that shows; zoom and position per clip | `clip timeline reframe` |
| **Loudness** | Evens out the exported mp4's volume to a target (-14 LUFS for YouTube, Shorts, Reels and TikTok; -16 for podcasts), measured in two passes | `clip timeline loudness` |
| **Shorts from a long recording** | Turns ranges of words from a long recording into a vertical short on a timeline of its own: captioned, at -14 LUFS, with the cuts already made on the recording; the long cut stays as it is | `clip timeline short` |
| **Cut check** | Flags cuts where a word may be clipped, with a contact sheet of the frames on each side | `clip timeline check` |
| **Export to Final Cut Pro and DaVinci Resolve** | FCPXML 1.10 project | `clip timeline export --format fcpxml` |
| **Export to Premiere Pro** | Final Cut Pro 7 XML project, captions as `.srt` files | `clip timeline export --format xmeml` |
| **Render** | mp4 of the finished cut | `clip timeline export` |

All of it works from chat (the Claude Code skill or the MCP server), the CLI, and the browser UI; the cut check isn't in the UI yet. Every edit is one step on a non-destructive timeline that `undo` and `redo` walk through. Underneath sit [19 single-file FFmpeg tools](#all-19-tools) for everything else: trim, split, concat, transitions, text and title cards, zoom/pan, overlay, speed, color, chroma key, stabilize, and render.
All of it works from chat (the Claude Code skill or the MCP server), the CLI, and the browser UI; the cut check and shorts aren't in the UI yet. Every edit is one step on a non-destructive timeline that `undo` and `redo` walk through. Underneath sit [19 single-file FFmpeg tools](#all-19-tools) for everything else: trim, split, concat, transitions, text and title cards, zoom/pan, overlay, speed, color, chroma key, stabilize, and render.

---

Expand Down Expand Up @@ -149,6 +150,29 @@ A cut splits the clip into pieces: the first keeps its id, and `clip timeline sh

---

## Quick start: a long recording → vertical shorts

Each short is a timeline of its own, cut from the main timeline's clips, so the pauses and retakes you cut there stay cut. In Claude Code or Claude Desktop, ask:

> *Transcribe podcast.mp4 and cut the pauses. Then find the three strongest moments, 20 to 60 seconds each, and make each one a short.*

The same steps from the CLI:

```bash
clip timeline new
clip timeline add-media podcast.mp4 # prints the clip id, e.g. clip_ec2f047d
clip timeline transcribe clip_ec2f047d # each word with its index and time
clip timeline silence clip_ec2f047d # cut the pauses on main
clip timeline short best-1 clip_ec2f047d 1400 1478 --x 0.4 # words 1400–1478 as a 9:16 short
clip timeline --timeline best-1 frame 3 check.jpg # look at it; move --x if the speaker is off
clip timeline --timeline best-1 export best-1.mp4
clip timeline list # main and every short
```

`short` starts 0.25 s before the first word and ends with the last, fills the 9:16 frame (`--x` picks the part that shows), sets -14 LUFS and burns in captions. Give several `<clipId> <from> <to>` ranges to join moments, in the order you give them. Any command takes `--timeline <id>` to work on a short, `clip timeline --timeline best-1 undo` takes the short apart again, and `short best-1 … --replace` rebuilds it.

---

## Another example: a product demo from screen recordings

Five screen recordings → one polished product demo. Type this into Claude Code (or Claude Desktop, via the MCP server):
Expand Down Expand Up @@ -374,7 +398,7 @@ MakeMyClip Editor is built for that job: an open-source video editor that Claude

### Is there an MCP server for video editing?

Yes. `npx -y @makemyclip/editor mcp` starts MakeMyClip Editor's local MCP server over stdio for Claude Desktop, Cursor, or any MCP client. Its tools show the timeline, edit it (add media, trim, split, remove silence, cut words, remove retakes, caption speech, reframe to 9:16, set loudness, transitions), check the cuts, transcribe, undo, redo, and export to mp4, FCPXML or Premiere XML. Media stays in one workspace folder, and no API key is needed.
Yes. `npx -y @makemyclip/editor mcp` starts MakeMyClip Editor's local MCP server over stdio for Claude Desktop, Cursor, or any MCP client. Its tools show the timeline, edit it (add media, trim, split, remove silence, cut words, remove retakes, caption speech, reframe to 9:16, set loudness, make shorts, transitions), check the cuts, transcribe, undo, redo, and export to mp4, FCPXML or Premiere XML. Media stays in one workspace folder, and no API key is needed.

### How do I remove silence from a video automatically?

Expand All @@ -388,6 +412,10 @@ Yes. MakeMyClip Editor transcribes with whisper.cpp on your machine; install it

Yes. After transcription, MakeMyClip Editor's `clip timeline captions` (or the UI's Captions button) puts captions timed to the words on a track above the video, and export burns them in. Captions come as short phrases or one word at a time, with your choice of size, color, position, and background. Non-Latin scripts use an installed font that has the glyphs. In the Premiere export, captions become `.srt` files. On Linux, the bundled FFmpeg can't draw text, so set `MAKEMYCLIP_FFMPEG_PATH` to an FFmpeg built with libfreetype and libharfbuzz.

### Can it cut Shorts or Reels out of a podcast?

Yes. Transcribe the recording, then `clip timeline short best-1 <clipId> <fromWord> <toWord>` (or the `make_short` verb from chat) turns that range of words into a vertical short on a timeline of its own: 9:16, filling the frame, captioned, normalized to -14 LUFS, with the silence and retake cuts already made on the recording. Make as many as you like; the long cut stays untouched, and each short exports on its own. You or the agent pick the moments: nothing scores highlights for you, and nothing is uploaded.

### Can I finish an AI edit in DaVinci Resolve, Premiere Pro or Final Cut Pro?

Yes. MakeMyClip Editor's `clip timeline export cut.fcpxml` writes FCPXML 1.10 for Final Cut Pro and DaVinci Resolve, and `clip timeline export cut.xml` writes Final Cut Pro 7 XML for Premiere Pro. Both keep the cuts, gaps, fades, volume, and cross dissolves, and point at your original files by path. Anything the format can't hold (speed, color adjustments, chroma key, a reframe's fill, zoom or position) is refused with the fix to make.
Expand Down
5 changes: 4 additions & 1 deletion SKILL.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
name: editor
description: Local, open-source video editor that agents drive with FFmpeg and whisper.cpp. Use when the user wants to edit a video file - cut out silence, pauses or dead air; remove repeated takes or cut words using the transcript; add captions or subtitles; make a vertical 9:16 (Shorts, Reels, TikTok), square or 4:5 version; even out the volume (loudness normalization); trim, split, join or crossfade clips; add text, title cards or zoom; clean up a talking-head video, screen recording, tutorial or podcast; render an mp4; or export the cut to Final Cut Pro, DaVinci Resolve or Premiere Pro (FCPXML / XML). Runs offline with no API key; every timeline edit can be undone; no generative AI.
description: Local, open-source video editor that agents drive with FFmpeg and whisper.cpp. Use when the user wants to edit a video file - cut out silence, pauses or dead air; remove repeated takes or cut words using the transcript; add captions or subtitles; make a vertical 9:16 (Shorts, Reels, TikTok), square or 4:5 version; cut clips or shorts from a long video or podcast; even out the volume (loudness normalization); trim, split, join or crossfade clips; add text, title cards or zoom; clean up a talking-head video, screen recording, tutorial or podcast; render an mp4; or export the cut to Final Cut Pro, DaVinci Resolve or Premiere Pro (FCPXML / XML). Runs offline with no API key; every timeline edit can be undone; no generative AI.
license: MIT
compatibility: Requires Node 24+. FFmpeg is auto-downloaded via ffmpeg-static on first use; override with MAKEMYCLIP_FFMPEG_PATH. Transcription (transcript cuts, retakes, captions) needs a user-installed whisper.cpp and a model file set in MAKEMYCLIP_WHISPER_MODEL.
metadata:
Expand All @@ -22,6 +22,7 @@ Trigger this skill when the user asks to:
- Cut the silence, pauses, or dead air out of a recording ("tighten it up", "remove the gaps")
- Remove repeated takes or bad takes, or cut a sentence or words by the transcript
- Clean up a talking-head video, tutorial, lecture, or video podcast
- Cut clips or vertical shorts (Shorts, Reels, TikTok) out of a long video, webinar or podcast
- Add captions or subtitles timed to the speech, or titles and lower-thirds
- Zoom, pan, or apply Ken Burns to a region of a clip
- Assemble multiple clips into one (concat, montage)
Expand Down Expand Up @@ -332,6 +333,8 @@ To make a vertical (9:16), square (1:1) or feed (4:5) version, run `timeline ref

To even out the volume of the exported mp4, run `timeline loudness -14` (YouTube, Shorts, Reels, TikTok) or `-16` (podcasts); `off` turns it off. Export then measures the finished mp4 and normalizes it to that integrated loudness in a second pass (EBU R128, true peak at most -1.5 dBTP), and reports `loudness` with the measured before and after values. `mode: dynamic` means loudnorm couldn't apply one gain (steady or very short audio, a wide loudness range, or peaks); `skipped` means the audio was silent or too short to measure. It's one setting on the timeline that `timeline undo` reverses, it applies to the mp4 only, and it doesn't even out clips recorded at different levels.

To cut vertical shorts out of a long recording, transcribe it and make the cuts you want everywhere (pauses, retakes) on the main timeline first, then pick each moment by its words and run `timeline short <id> <clipId> <fromIndex> <toIndex>`, where `<id>` is a new name such as `best-1`. Pick whole sentences, 15–60 s in all; you choose the moments, the editor doesn't score them. The short is a timeline of its own, cut from main's clips (main's cuts carry in, main itself doesn't change): it starts 0.25 s before the first word and ends with the last (whisper's last word already covers the pause after it), fills a 9:16 frame, sets -14 LUFS and burns in captions. More `<clipId> <from> <to>` triples join several moments in the order given, so a later line can open the short as its hook. Options: `--x 0..1` to keep the speaker in frame, `--aspect 1:1|4:5`, `--words N` per caption, `--no-captions`, `--loudness <LUFS|off>`, `--source <timeline>`, `--dry-run` (prints the pieces), `--replace` to rebuild it. Every other command works on a short with `--timeline <id>`: look at it with `timeline --timeline best-1 frame 3 check.jpg`, adjust with `timeline --timeline best-1 reframe 9:16 --x 0.3`, and render it with `timeline --timeline best-1 export best-1.mp4`. `timeline list` shows every timeline, `timeline --timeline best-1 undo` takes the short apart, and `timeline delete best-1` removes it. Over MCP, it's the `make_short` verb in `timeline_edit` with `timeline` set to the new id; every timeline tool takes `timeline`, and `timeline_show` lists them all.

To hand the cut to an editor app, export the timeline as an editor project instead of a render. `timeline export cut.fcpxml` (or `--format fcpxml`) writes FCPXML 1.10 for Final Cut Pro and DaVinci Resolve; `timeline export cut.xml` (or `--format xmeml`) writes Final Cut Pro 7 XML for Premiere Pro, which Resolve reads too. Premiere doesn't import FCPXML, so use `xmeml` for it. Both reference the source files by absolute path (nothing is copied, so keep the sources where they are), place camera files by their start timecode, and keep the mp4's timing: clips, gaps, fades, volume, fade/dissolve transitions (as cross dissolves) and black or colored cards. Text over the picture becomes titles in FCPXML; in the Premiere XML it goes to `.srt` caption files next to the XML, since Premiere drops that format's titles. What the file can't hold — speed, color adjustments, chroma key, a reframe's fill, zoom or position (set the timeline to `--fit contain` and reset clip framing to carry it), rotation, wipe/slide/circle transitions, audio-only tracks, media on two tracks, a frame rate editors don't offer — is refused with the fix to make; what it holds only in part (text styling, caption boxes) is listed in the output's `notes`.

### Open the local UI (implemented)
Expand Down
3 changes: 3 additions & 0 deletions docs/backlog/review-test-timeout.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Review integration test timeout

`tests/integration/timeline-review.test.ts` ("flags a cut planted mid-tone…") runs under vitest's default 5 s timeout but renders several FFmpeg steps, so it sometimes times out on a busy machine (seen once in two runs on `feat/shorts` at 18511f1). Give it an explicit timeout like the other integration tests (`120_000`).
3 changes: 3 additions & 0 deletions docs/backlog/segment-duration-rounding.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Segment duration rounding

Export renders each clip as its own segment and joins them, and each segment comes out a little longer than its clip: the video rounds up to a whole frame and the AAC audio to a whole 1024-sample frame. A three-piece short planned at 16.200 s exported as 488 video frames (16.267 s at 30 fps) and 16.25 s of audio. Check whether the audio-video offset accumulates over a timeline with hundreds of cuts (a silence-cut hour), and if it does, trim each segment to a frame-aligned length or carry the remainder into the next segment.
3 changes: 3 additions & 0 deletions docs/backlog/short-edges-snap-to-pause.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Snap short edges to the pause

whisper.cpp (`-ml 1 -sow`) gives each pause to the word before it, so at a sentence edge its words run late. On a 30-sentence test recording (macOS `say`, model base.en), a short ending on a sentence's last word ran past the pause into the next sentence in 18 of 29 cases, by up to 0.35 s. Even with the 0.25 s lead, 3 of 29 starts lost up to 0.1 s of the first word. No fixed padding fixes both. Move each edge of a range to the quietest point of the audio near it: run a silencedetect pass over a second or so around the edge and keep the edge inside the pause between the range and its neighbors. `-dtw base.en` didn't change the per-word offsets in a quick check.
3 changes: 2 additions & 1 deletion llms.txt
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@
- **Captions:** `clip timeline captions` burns in captions timed to the words (short phrases or one word at a time)
- **Reframe:** `clip timeline reframe 9:16` turns a landscape cut vertical (also 1:1, 4:5); `--x` picks the part that shows, `clip timeline framing <clipId>` sets one clip's zoom and position
- **Loudness:** `clip timeline loudness -14` normalizes the exported mp4 to -14 LUFS (or `-16` for podcasts) in two passes
- **Shorts from a long recording:** `clip timeline short best-1 <clipId> <fromIndex> <toIndex>` (MCP: the `make_short` verb) turns a range of transcript words into a 9:16 short on a timeline of its own, captioned and at -14 LUFS, keeping the cuts made on the main timeline; `--timeline <id>` points any command at a short
- **Cut check:** `clip timeline check --sheet cuts.jpg` flags cuts that may clip a word and writes a contact sheet
- **Export to pro editors:** `clip timeline export --format fcpxml` (Final Cut Pro, DaVinci Resolve) or `--format xmeml` (Premiere Pro; captions as .srt)
- Every timeline edit is one undoable step (`clip timeline undo` / `redo`), from the CLI, the MCP server or the browser UI
Expand Down Expand Up @@ -52,7 +53,7 @@ Plus session meta-ops not in the tool registry: snapshot, undo, inspect, delete.
- Different category from Runway/Pika (generative AI), Premiere/DaVinci (heavy NLEs) — but it exports its cut to Final Cut Pro, Resolve and Premiere for finishing
- Overlaps with auto-editor (open-source CLI: silence cuts, transcript edits, NLE export); MakeMyClip Editor adds a shared timeline document that an agent and a person (browser UI) both edit, with undo per step
- Transcription is local (whisper.cpp); nothing is uploaded
- Single workspace folder holds composition.json (the timeline), session.json (the op log), output files, snapshots/ — fully version-controllable
- Single workspace folder holds composition.json (the main timeline), timelines/ (shorts and other named timelines), session.json (the op log), output files, snapshots/ — fully version-controllable
- Stream-copy for lossless trim/split/concat; re-encodes only when filter graphs require it

## Architecture
Expand Down
2 changes: 1 addition & 1 deletion mcpb/manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@
},
{
"name": "timeline_edit",
"description": "Apply editing verbs as one undoable change: add media, text or color, trim, move, split, remove, remove silence, cut words or retakes, caption speech, reframe to 9:16 / 1:1 / 4:5, frame a clip, set loudness, transition."
"description": "Apply editing verbs as one undoable change: add media, text or color, trim, move, split, remove, remove silence, cut words or retakes, caption speech, reframe to 9:16 / 1:1 / 4:5, frame a clip, set loudness, make a vertical short from transcript words, transition."
},
{
"name": "timeline_check",
Expand Down
Loading
Loading