Skip to content

release: v0.5.2 — vertical shorts from a long recording - #87

Merged
yultyyev merged 44 commits into
mainfrom
feat/shorts
Nov 16, 2026
Merged

yultyyev merged 44 commits into
mainfrom
feat/shorts

Conversation

@yultyyev

Copy link
Copy Markdown
Collaborator

Release PR for the shorts work. It merges the integration branch feat/shorts into main with a merge commit, not a squash, so semantic-release sees each slice's commits and cuts v0.5.2.

Closes #80
Closes #81

What ships in 0.5.2

Finish line: a long talking-head or podcast recording becomes N vertical shorts. Each is picked by its transcript, reframed to 9:16, captioned inside the safe zone and normalized to -14 LUFS, from the CLI, MCP and the UI.

# Slice PR
1 Named timelines (timelines/<id>/; main stays at composition.json) and the make_short verb. CLI clip timeline short / list / delete / --timeline; MCP timeline input on every tool #73
2 Long recordings: a paged sentence outline (timeline_transcript without a clip, transcribe --sentences), mid-sentence warnings, short edges cut inside the pause the audio shows, and frame previews from a short window (a frame 9 minutes into a 10-minute clip in under 100 ms) #78
3 Captions inside the safe zone on portrait canvases (bottom 25%, sides 14%), style.margin, caption line width from the font size #85
4 Shorts in clip ui: a tab per timeline, Make short from a transcript selection, delete, Export all shorts; clip timeline export --all <dir> #86

Also on feat/shorts:

Release version: this PR adds { "type": "feat", "release": "patch" } to .releaserc.json, because the maintainer chose 0.5.2 over the 0.6.0 that these feat commits would cut. It applies to this release only. A ci(ci) PR removes it right after 0.5.2 is out.

Mixed versions: an older clip (0.5.1 or earlier) on the same workspace ignores timelines/, so it doesn't see the shorts. It also drops style.margin from any document it writes, which moves captions back to 40 px from the edge. Shorts and the main timeline otherwise keep working.

What the release job does on merge

Same as 0.5.0 and 0.5.1:

  1. tests, lint and build;
  2. semantic-release: CHANGELOG, package.json → 0.5.2, .mcpb, npm with provenance, the GitHub release with makemyclip-editor.mcpb, then the MCP Registry listing.

Checks

Run at the release tip, 72d3c31:

yultyyev and others added 30 commits November 15, 2026 14:08
…mpeg

A color clip's color and the canvas background went into the filter graph
unquoted (`color=c=…`, `pad=…:color=…`), so a value like
`black[p];movie=/path[m];[p][m]overlay` added filters: it read a file
outside the workspace into the export, and `metadata=…:file=` created one.

Validate colors where they enter (the add_color verb for MCP and the UI,
and `clip timeline new --background` / `add-color --color`), and have the
compiler refuse a stored value that is not a color with a CompileError.
Accepted: FFmpeg color names in any case, #rrggbb[aa], 0xrrggbb[aa], with
an optional @Alpha.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A workspace now holds several timelines: main stays at composition.json,
others live in timelines/<id>/ with their own rev, lock and undo history.
The make_short verb builds a vertical short on its own timeline from
transcript word ranges of a source timeline: padded edges, cut from the
source's clips so its silence and retake cuts carry in, a 9:16 cover
canvas, -14 LUFS and captions, as one undoable edit.

The CLI gains --timeline, `short`, `list` and `delete`; every MCP
timeline tool takes an optional timeline id and timeline_show lists them.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A piece that only touches a range's words (they were cut out exactly) is
dropped, so make_short refuses instead of playing padding alone. A range
that continues the one before it in the same file starts where that one's
padding ended, so neighboring words play straight through.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Adds the long recording → shorts quick start, the `short` command, the
make_short verb in the MCP lists and an FAQ entry, and polishes the
missing-timeline and non-empty-short errors for CLI users.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
whisper.cpp words abut, each pause going to the word before it, so the
neighbor-word clamp removed all padding. Measured on a 30-sentence say
recording with base.en and on jfk.wav: a range now starts 0.25 s before
its first word (stopping halfway into the word before) and ends with its
last word, which already runs through the pause after it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ords

A timeline's folder is now checked against the workspace too, not only
its files, so a timelines/ symlink out of the workspace can't receive
temp files or a recursive delete through files that link back in.
Captions on a short come only from the chosen words, not the word the
lead padding reaches into, and a range whose words were all cut is
refused even when a clip still covers the gap between them.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Captions came from the union of every range's words, so with reordered
neighboring ranges one range's word could show in another's lead. Each
piece now captions only the ranges it plays, from the transcripts the
ranges were already read with.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(timeline): named timelines and make_short (shorts slice 1)
The frame preview encoded the clip's whole segment to grab one frame,
which took minutes on a long recording. A media clip's frame is now one
step: seek the source to the frame and run the segment's own video chain
on timestamps offset to the frame's time, so fades, captions and speed
read the same time they do in the segment. Text and color cards keep the
two-step path.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
After setpts, a sped-up clip's frames reached the encoder off the canvas
frame grid, and the encoder's frame dropping repeated some frames and
shifted others by up to two frames. An fps filter right after the speed
setpts picks the nearest frame for each slot, so export is steady and the
frame preview shows the frame export plays.

Adds the CI-gated check: the window frame matches the frame of the fully
encoded clip at PSNR >= 40 dB mid-clip, inside a fade and at 2x, and a
frame 9 minutes into a 10-minute clip renders in under a second.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
timelineOutline lists the timeline's speech as numbered sentences, across
silence-cut sub-clips, one 40 KB page at a time with nextFromSec. MCP
timeline_transcript returns it when no clipId is given (view, fromSec and
toSec added), and `clip timeline transcribe --sentences [--from --to]`
prints one line per sentence. make_short now warns when a range starts or
ends mid-sentence, and timeline_edit passes the warnings on.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(timeline): refuse colors that are not colors before they reach FFmpeg
The window frame rounded its seek to the millisecond, which could land
past a clip's last frame (no image) or its out-point; it now rounds down
at microsecond precision. The outline merged a word repeated by
consecutive clips as if a cut split it; it merges only when the next clip
carries on later in the source, and a word played again starts a new
sentence.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A source slower than the canvas shows a frame export repeats into later
slots, and seeking straight to the frame skipped it (at a clip's end, no
image at all). The window now reads from a second earlier and trims to
the first frame at the frame's segment time, timestamped from the seek
point. An outline of an explicit clip off the picture track lists its
sentences, and the MCP outline no longer suggests cut_words for sentences
that can span clips.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…time

trim rounds an off-grid start to the nearest frame, so a preview between
two frames could show the earlier one where export shows the later. The
boundary is now the next canvas frame. The CI-gated test's pattern turns
its hue 24 degrees a frame, so a preview off by one frame fails it (21 dB
with the old boundary), and it adds a case between two frames.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Encoding a clip to its length keeps round(length x fps) frames, so on a
clip whose length is off the frame grid the next-frame boundary could
pick a frame export leaves out. The boundary now stops at the segment's
last frame, with a unit test and a CI-gated case (21 dB without it).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A frame preview now keeps every frame from the keyframe before its seek
(-noaccurate_seek) instead of a 1 s preroll, so a sparse source, such as
a screen recording holding a still, previews the frame export holds
(19.5 dB before, now matching). Frames before the clip's in-point are
dropped as export's seek drops them.

The outline names each sentence's source when the timeline has more than
one, so its transcriptId can be found, and a page never splits sentences
that start at the same time, so paging always moves on.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A frame preview restored its timestamps with a fractional offset while
the seek rounds to whole stream ticks, so a 24 fps frame on a 30 fps
canvas could land one canvas frame early (21 dB at 1.391 s). It now
undoes the seek in whole ticks, leaving the timestamps export's own seek
gives.

An outline sentence ends where the timeline skips ahead over words it
plays elsewhere (clips moved out of source order), so its index range
never takes in words it doesn't show. The CLI sentence lines name the
source when the timeline has more than one.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… on a closed pipe

A slow-motion frame can need the source frame before the keyframe its
own time falls just after; the preview now seeks a second early as well
as keeping the frames from the keyframe before (21 dB before at 0.25x).

`clip timeline transcribe --sentences | head` ended with an unhandled
EPIPE once head closed the pipe on a long listing; a closed pipe now
just ends it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
whisper.cpp gives each pause to the word before it and runs late at
sentence ends, so a short cut by the transcript kept up to 0.35 s of the
next sentence. make_short now measures the source's levels around each
edge (one short FFmpeg read, 10 ms RMS frames), finds the pause the
transcript boundary points at by a threshold set from those levels, and
cuts 0.1 s into it. An edge with no clear pause keeps the transcript rule
and warns; a word whisper places past the cut keeps its caption.

On the 30-sentence say recording every sentence-short is clean: no edge
clipped, none keeping a neighbor's speech (before: 18 ends kept the next
sentence, 3 starts were clipped). On jfk.wav every cut lands in a pause.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…rder

Levels are measured with the transcription's aresample=async=1:first_pts=0,
so a late audio start or a timestamp gap can't shift a pause; digital
silence counts as quiet but is left out of the floor estimate, or room
tone between sentences would read as sound. A word pulled inside a cut
keeps its place after the word before it, and the speech check uses the
pulled words, so a one-word range whisper places past its cut is kept.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Media clips on the browser timeline and in the clip inspector showed their
media ID (m_821d98105d7c) instead of the file name. The session log's ingest
entries already map each media ID to its path, so the UI now builds a
name map from them and labels clips with the file's base name, falling back
to the ID when the session doesn't name it.

Closes #80

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Each op in the list left of the monitor is a <button>, and `.op-list .op`
never cleared the browser's button styles. Ops showed as light gray boxes
with centered text and a raised border, and the light gray text on them
was hard to read. Clear the background, border, font and alignment so the
existing dark rules show: the panel color by default, a lighter row on
hover, and the blue tint and left bar when selected.

Closes #81

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…in order

A pause that ends by the time the last word starts is the one before it,
so an accurately timed last word with a long pause ahead of it is no
longer cut off. A range across a source split captions its words once,
and words crowded against a cut move earlier to make room instead of
sharing a start, so no caption shown a word at a time is lost.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(ui): draw the op list in the dark theme
feat(timeline): long recordings — sentence outline, edge warnings, pause-snapped edges, fast frames (shorts slice 2)
Text styles gain an optional margin ({ x, y } pixels from the anchored
edges; absent stays 40, so existing documents render byte for byte).
On a portrait canvas captions default to the safe area: above the bottom
quarter and 14% in from each side, clear of the Shorts, Reels and TikTok
overlays. The caption line limit now follows the font size, so a line
fits between the side margins (22 characters at 54 px on 1080x1920, 32 on
landscape as before), and a bigger font makes shorter lines everywhere.
caption_speech and `clip timeline captions` take a margin; FCPXML places
titles by it too.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…e word

A character count let W- and M-heavy capitals overflow (WOW WOW WOW at
96 px fit 12 characters but not the 754 px of room). Lines now break by
an em-width estimate that errs wide, at least Arial's and DejaVu Sans's
advance per character class, with the 32-character cap kept. A single
word too wide for the room on a line of its own gets a font size that
fits it. Measured on 1080x1920: every case inside x 151–929, above 1440.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
yultyyev and others added 14 commits November 15, 2026 18:38
fix(ui): label media clips with their file name
…stimate

The box drawtext draws behind a caption reaches 12 px past its text, so
on a portrait canvas the text now keeps 163 px from the sides and 492 px
from the bottom and the box itself stays within x 151–929, above y 1440.
The width estimate counts m, w, # and & as 1 em (DejaVu draws m at 0.97)
and any non-Latin letter as 0.9–1 em; accented Latin counts as its base.
The CI-gated check now measures each caption's box, for capitals, a
96 px font, a long word, m-heavy lowercase and Cyrillic capitals.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
DejaVu Sans draws Щ and Ю at about 1.1 em, so a run of them could pass the
caption width check and overflow. Non-Latin capitals now count as 1.1 em
and lowercase as 0.95.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…afe-zone

# Conflicts:
#	src/mcp/server.ts
#	src/timeline/captions.ts
#	src/timeline/shorts.ts
DejaVu Sans draws + = < > ~ ^ at about 0.84 em, so a caption of them
could pass the width check and overflow; they now count as 0.85 em.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(timeline): captions inside the vertical feeds' safe area (shorts slice 3)
… all shorts

Every /api/timeline route reads ?timeline= (default main): a malformed id
answers 400 and a short that doesn't exist 404. GET /api/timelines lists
them, DELETE /api/timelines/:id removes a short (main is refused), and
POST /api/timelines/export renders every short through exportTimelines,
which `clip timeline export --all <dir>` shares. The verbs route now
returns make_short's warnings.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ll shorts

Tabs above the timeline list main and every short with its shape; the
open one lives in the page URL and every fetch names it. A short's tab
deletes it after a confirm, and a short deleted elsewhere falls back to
main. Selecting words in a clip's transcript offers Make short (a name
and the left-right position), which opens the new short and shows
make_short's warnings. Export all shorts renders every one and lists
each with its loudness.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Also logs the clip inspector getting no height on a short window as a
backlog note; it predates the tabs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…o its timeline

The export-all route now resolves each short's files through
confinedMediaMap, so a registered file swapped for a link out of the
workspace is refused instead of rendered. useTimeline remembers which
timeline answered 404, so switching to another short right after a
fallback doesn't bounce back to main.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(ui): shorts in clip ui, and export every short
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The maintainer chose a patch for this release. The rule is removed again
after 0.5.2 ships.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@yultyyev
yultyyev merged commit 0fce8bb into main Nov 16, 2026
1 check passed
@github-actions

Copy link
Copy Markdown

🎉 This PR is included in version 0.5.2 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

UI: op list renders light boxes in the dark theme UI: label timeline clips with the file name, not the media ID

1 participant