Repository navigation
release: v0.5.2 — vertical shorts from a long recording - #87
Merged
Merged
Conversation
…mpeg A color clip's color and the canvas background went into the filter graph unquoted (`color=c=…`, `pad=…:color=…`), so a value like `black[p];movie=/path[m];[p][m]overlay` added filters: it read a file outside the workspace into the export, and `metadata=…:file=` created one. Validate colors where they enter (the add_color verb for MCP and the UI, and `clip timeline new --background` / `add-color --color`), and have the compiler refuse a stored value that is not a color with a CompileError. Accepted: FFmpeg color names in any case, #rrggbb[aa], 0xrrggbb[aa], with an optional @Alpha. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A workspace now holds several timelines: main stays at composition.json, others live in timelines/<id>/ with their own rev, lock and undo history. The make_short verb builds a vertical short on its own timeline from transcript word ranges of a source timeline: padded edges, cut from the source's clips so its silence and retake cuts carry in, a 9:16 cover canvas, -14 LUFS and captions, as one undoable edit. The CLI gains --timeline, `short`, `list` and `delete`; every MCP timeline tool takes an optional timeline id and timeline_show lists them. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A piece that only touches a range's words (they were cut out exactly) is dropped, so make_short refuses instead of playing padding alone. A range that continues the one before it in the same file starts where that one's padding ended, so neighboring words play straight through. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Adds the long recording → shorts quick start, the `short` command, the make_short verb in the MCP lists and an FAQ entry, and polishes the missing-timeline and non-empty-short errors for CLI users. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
whisper.cpp words abut, each pause going to the word before it, so the neighbor-word clamp removed all padding. Measured on a 30-sentence say recording with base.en and on jfk.wav: a range now starts 0.25 s before its first word (stopping halfway into the word before) and ends with its last word, which already runs through the pause after it. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ords A timeline's folder is now checked against the workspace too, not only its files, so a timelines/ symlink out of the workspace can't receive temp files or a recursive delete through files that link back in. Captions on a short come only from the chosen words, not the word the lead padding reaches into, and a range whose words were all cut is refused even when a clip still covers the gap between them. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Captions came from the union of every range's words, so with reordered neighboring ranges one range's word could show in another's lead. Each piece now captions only the ranges it plays, from the transcripts the ranges were already read with. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(timeline): named timelines and make_short (shorts slice 1)
The frame preview encoded the clip's whole segment to grab one frame, which took minutes on a long recording. A media clip's frame is now one step: seek the source to the frame and run the segment's own video chain on timestamps offset to the frame's time, so fades, captions and speed read the same time they do in the segment. Text and color cards keep the two-step path. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
After setpts, a sped-up clip's frames reached the encoder off the canvas frame grid, and the encoder's frame dropping repeated some frames and shifted others by up to two frames. An fps filter right after the speed setpts picks the nearest frame for each slot, so export is steady and the frame preview shows the frame export plays. Adds the CI-gated check: the window frame matches the frame of the fully encoded clip at PSNR >= 40 dB mid-clip, inside a fade and at 2x, and a frame 9 minutes into a 10-minute clip renders in under a second. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
timelineOutline lists the timeline's speech as numbered sentences, across silence-cut sub-clips, one 40 KB page at a time with nextFromSec. MCP timeline_transcript returns it when no clipId is given (view, fromSec and toSec added), and `clip timeline transcribe --sentences [--from --to]` prints one line per sentence. make_short now warns when a range starts or ends mid-sentence, and timeline_edit passes the warnings on. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(timeline): refuse colors that are not colors before they reach FFmpeg
The window frame rounded its seek to the millisecond, which could land past a clip's last frame (no image) or its out-point; it now rounds down at microsecond precision. The outline merged a word repeated by consecutive clips as if a cut split it; it merges only when the next clip carries on later in the source, and a word played again starts a new sentence. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A source slower than the canvas shows a frame export repeats into later slots, and seeking straight to the frame skipped it (at a clip's end, no image at all). The window now reads from a second earlier and trims to the first frame at the frame's segment time, timestamped from the seek point. An outline of an explicit clip off the picture track lists its sentences, and the MCP outline no longer suggests cut_words for sentences that can span clips. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…time trim rounds an off-grid start to the nearest frame, so a preview between two frames could show the earlier one where export shows the later. The boundary is now the next canvas frame. The CI-gated test's pattern turns its hue 24 degrees a frame, so a preview off by one frame fails it (21 dB with the old boundary), and it adds a case between two frames. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Encoding a clip to its length keeps round(length x fps) frames, so on a clip whose length is off the frame grid the next-frame boundary could pick a frame export leaves out. The boundary now stops at the segment's last frame, with a unit test and a CI-gated case (21 dB without it). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A frame preview now keeps every frame from the keyframe before its seek (-noaccurate_seek) instead of a 1 s preroll, so a sparse source, such as a screen recording holding a still, previews the frame export holds (19.5 dB before, now matching). Frames before the clip's in-point are dropped as export's seek drops them. The outline names each sentence's source when the timeline has more than one, so its transcriptId can be found, and a page never splits sentences that start at the same time, so paging always moves on. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A frame preview restored its timestamps with a fractional offset while the seek rounds to whole stream ticks, so a 24 fps frame on a 30 fps canvas could land one canvas frame early (21 dB at 1.391 s). It now undoes the seek in whole ticks, leaving the timestamps export's own seek gives. An outline sentence ends where the timeline skips ahead over words it plays elsewhere (clips moved out of source order), so its index range never takes in words it doesn't show. The CLI sentence lines name the source when the timeline has more than one. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… on a closed pipe A slow-motion frame can need the source frame before the keyframe its own time falls just after; the preview now seeks a second early as well as keeping the frames from the keyframe before (21 dB before at 0.25x). `clip timeline transcribe --sentences | head` ended with an unhandled EPIPE once head closed the pipe on a long listing; a closed pipe now just ends it. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
whisper.cpp gives each pause to the word before it and runs late at sentence ends, so a short cut by the transcript kept up to 0.35 s of the next sentence. make_short now measures the source's levels around each edge (one short FFmpeg read, 10 ms RMS frames), finds the pause the transcript boundary points at by a threshold set from those levels, and cuts 0.1 s into it. An edge with no clear pause keeps the transcript rule and warns; a word whisper places past the cut keeps its caption. On the 30-sentence say recording every sentence-short is clean: no edge clipped, none keeping a neighbor's speech (before: 18 ends kept the next sentence, 3 starts were clipped). On jfk.wav every cut lands in a pause. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…rder Levels are measured with the transcription's aresample=async=1:first_pts=0, so a late audio start or a timestamp gap can't shift a pause; digital silence counts as quiet but is left out of the floor estimate, or room tone between sentences would read as sound. A word pulled inside a cut keeps its place after the word before it, and the speech check uses the pulled words, so a one-word range whisper places past its cut is kept. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Media clips on the browser timeline and in the clip inspector showed their media ID (m_821d98105d7c) instead of the file name. The session log's ingest entries already map each media ID to its path, so the UI now builds a name map from them and labels clips with the file's base name, falling back to the ID when the session doesn't name it. Closes #80 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Each op in the list left of the monitor is a <button>, and `.op-list .op` never cleared the browser's button styles. Ops showed as light gray boxes with centered text and a raised border, and the light gray text on them was hard to read. Clear the background, border, font and alignment so the existing dark rules show: the panel color by default, a lighter row on hover, and the blue tint and left bar when selected. Closes #81 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…in order A pause that ends by the time the last word starts is the one before it, so an accurately timed last word with a long pause ahead of it is no longer cut off. A range across a source split captions its words once, and words crowded against a cut move earlier to make room instead of sharing a start, so no caption shown a word at a time is lost. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(ui): draw the op list in the dark theme
feat(timeline): long recordings — sentence outline, edge warnings, pause-snapped edges, fast frames (shorts slice 2)
Text styles gain an optional margin ({ x, y } pixels from the anchored
edges; absent stays 40, so existing documents render byte for byte).
On a portrait canvas captions default to the safe area: above the bottom
quarter and 14% in from each side, clear of the Shorts, Reels and TikTok
overlays. The caption line limit now follows the font size, so a line
fits between the side margins (22 characters at 54 px on 1080x1920, 32 on
landscape as before), and a bigger font makes shorter lines everywhere.
caption_speech and `clip timeline captions` take a margin; FCPXML places
titles by it too.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…e word A character count let W- and M-heavy capitals overflow (WOW WOW WOW at 96 px fit 12 characters but not the 754 px of room). Lines now break by an em-width estimate that errs wide, at least Arial's and DejaVu Sans's advance per character class, with the 32-character cap kept. A single word too wide for the room on a line of its own gets a font size that fits it. Measured on 1080x1920: every case inside x 151–929, above 1440. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(ui): label media clips with their file name
…stimate The box drawtext draws behind a caption reaches 12 px past its text, so on a portrait canvas the text now keeps 163 px from the sides and 492 px from the bottom and the box itself stays within x 151–929, above y 1440. The width estimate counts m, w, # and & as 1 em (DejaVu draws m at 0.97) and any non-Latin letter as 0.9–1 em; accented Latin counts as its base. The CI-gated check now measures each caption's box, for capitals, a 96 px font, a long word, m-heavy lowercase and Cyrillic capitals. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
DejaVu Sans draws Щ and Ю at about 1.1 em, so a run of them could pass the caption width check and overflow. Non-Latin capitals now count as 1.1 em and lowercase as 0.95. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…afe-zone # Conflicts: # src/mcp/server.ts # src/timeline/captions.ts # src/timeline/shorts.ts
DejaVu Sans draws + = < > ~ ^ at about 0.84 em, so a caption of them could pass the width check and overflow; they now count as 0.85 em. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(timeline): captions inside the vertical feeds' safe area (shorts slice 3)
… all shorts Every /api/timeline route reads ?timeline= (default main): a malformed id answers 400 and a short that doesn't exist 404. GET /api/timelines lists them, DELETE /api/timelines/:id removes a short (main is refused), and POST /api/timelines/export renders every short through exportTimelines, which `clip timeline export --all <dir>` shares. The verbs route now returns make_short's warnings. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ll shorts Tabs above the timeline list main and every short with its shape; the open one lives in the page URL and every fetch names it. A short's tab deletes it after a confirm, and a short deleted elsewhere falls back to main. Selecting words in a clip's transcript offers Make short (a name and the left-right position), which opens the new short and shows make_short's warnings. Export all shorts renders every one and lists each with its loudness. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Also logs the clip inspector getting no height on a short window as a backlog note; it predates the tabs. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…o its timeline The export-all route now resolves each short's files through confinedMediaMap, so a registered file swapped for a link out of the workspace is refused instead of rendered. useTimeline remembers which timeline answered 404, so switching to another short right after a fallback doesn't bounce back to main. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(ui): shorts in clip ui, and export every short
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The maintainer chose a patch for this release. The rule is removed again after 0.5.2 ships. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
🎉 This PR is included in version 0.5.2 🎉 The release is available on:
Your semantic-release bot 📦🚀 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Release PR for the shorts work. It merges the integration branch
feat/shortsintomainwith a merge commit, not a squash, so semantic-release sees each slice's commits and cuts v0.5.2.Closes #80
Closes #81
What ships in 0.5.2
Finish line: a long talking-head or podcast recording becomes N vertical shorts. Each is picked by its transcript, reframed to 9:16, captioned inside the safe zone and normalized to -14 LUFS, from the CLI, MCP and the UI.
timelines/<id>/;mainstays atcomposition.json) and themake_shortverb. CLIclip timeline short/list/delete/--timeline; MCPtimelineinput on every tooltimeline_transcriptwithout a clip,transcribe --sentences), mid-sentence warnings, short edges cut inside the pause the audio shows, and frame previews from a short window (a frame 9 minutes into a 10-minute clip in under 100 ms)style.margin, caption line width from the font sizeclip ui: a tab per timeline, Make short from a transcript selection, delete, Export all shorts;clip timeline export --all <dir>Also on
feat/shorts:Release version: this PR adds
{ "type": "feat", "release": "patch" }to.releaserc.json, because the maintainer chose 0.5.2 over the 0.6.0 that thesefeatcommits would cut. It applies to this release only. Aci(ci)PR removes it right after 0.5.2 is out.Mixed versions: an older
clip(0.5.1 or earlier) on the same workspace ignorestimelines/, so it doesn't see the shorts. It also dropsstyle.marginfrom any document it writes, which moves captions back to 40 px from the edge. Shorts and the main timeline otherwise keep working.What the release job does on merge
Same as 0.5.0 and 0.5.1:
package.json→ 0.5.2,.mcpb, npm with provenance, the GitHub release withmakemyclip-editor.mcpb, then the MCP Registry listing.Checks
Run at the release tip, 72d3c31:
pnpm lint: 0 errors. The 7 warnings were already there. This matters because a Biome error blocks the npm publish.pnpm type-check: clean.pnpm test: 965 passed, 34 skipped.pnpm buildandpnpm build:mcpbpass.CI=true: 34 passed, 4 skipped (15 files).@semantic-release/commit-analyzerwith this.releaserc.json, over the 44 commits frommainto the tip, returns patch. Without the new rule it returns minor.mainis fully insidefeat/shorts(0 commits ahead), so the merge brings no conflicts.llms.txttest counts updated to 965; Roadmap "Now" is v0.5.2.