Skip to content

BREAKING CHANGE: v0.0.8 -> sort/merge --rename impl + merge preserves unique metadata lines#7

Merged
alejandrogzi merged 1 commit into
masterfrom
0.0.8
Jun 13, 2026
Merged

BREAKING CHANGE: v0.0.8 -> sort/merge --rename impl + merge preserves unique metadata lines#7
alejandrogzi merged 1 commit into
masterfrom
0.0.8

Conversation

@alejandrogzi

Copy link
Copy Markdown
Owner

[0.0.8] - 2025-06-13

Added

  • --rename/-r flag for mergechaintools merge --rename reassigns chain
    IDs sequentially in sorted output order, so the first emitted chain receives
    id 1, the next 2, and so on. The flag implies sorting: it defaults to
    --sort-by score when no key is given, and respects an explicit --sort-by <KEY>
    when one is provided. Renaming is applied at final emission for both the in-memory
    and external (spill-to-disk) merge paths, with no extra pass over the data. Backed
    by new write_chain_dense_with_id / write_chain_header_with_id writer helpers.

  • --rename/-r flag for sortchaintools sort --rename reassigns chain
    IDs sequentially in sorted output order, following the selected --sort-by key
    (default score). When combined with --out-index, the recorded offsets are
    computed against the renamed output so they remain consistent with the written
    bytes.

Changed

  • merge deduplicates metadata — when merging with --sort-by/--rename,
    identical metadata (#) lines that appear in more than one input (for example,
    files produced by a previous split) are now emitted once, in first-seen order.
    Deduplication is performed at the byte level and does not affect sort, which
    continues to preserve a single input's metadata verbatim.

@alejandrogzi alejandrogzi merged commit 151896f into master Jun 13, 2026
2 checks passed
@alejandrogzi alejandrogzi deleted the 0.0.8 branch June 13, 2026 14:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant