Skip to content

feat: image-sequence input + reconstruction performance - #19

Open
258014 wants to merge 1 commit into
ooolabdev:mainfrom
258014:feat/input-and-reconstruction-updates
Open

feat: image-sequence input + reconstruction performance#19
258014 wants to merge 1 commit into
ooolabdev:mainfrom
258014:feat/input-and-reconstruction-updates

Conversation

@258014

@258014 258014 commented Aug 30, 2026

Copy link
Copy Markdown

变更内容

  • 新增"图片文件夹 / 图片序列"输入:除 mp4/mov 外,可直接选一个装有序图片的文件夹作为重建输入;前端新增"选择图片文件夹",后端按输入类型自动选匹配器(图片→穷举,视频→顺序),并复用整条 COLMAP + Brush 链路。
  • 重建性能:
    • 特征提取 max_num_features=8192(family 自适应)。
    • 图片序列默认 exhaustive_matcher
    • 接入 COLMAP GLOMAP 全局建图:检测到 global_mapper 时先 view_graph_calibrator 再用 global_mapper;不支持则回退增量 mapper。
    • 接入 vocab_tree_matcher / 顺序匹配 loop_detection:引擎根目录存在 vocab_tree.bin 时启用;否则回退 exhaustive / sequential。
  • ROADMAP 同步更新(图片序列输入、重建性能、Windows 打包已列入"已完成")。

说明

  • GLOMAP 与词汇树均为"运行时检测 + 回退",缺对应引擎/资产时不影响现有流程(视频→3DGS 行为不变)。
  • 词汇树需 faiss 兼容格式(内置 COLMAP 为 faiss 版);当前公开预训练树为 flann,暂未预置,故该路径默认禁用,等有 faiss 树再启用。
  • 已通过:cargo checkcargo test(56 passed)、前端 tsc + vite buildtauri build
  • 本分支已 rebase 到最新上游 main(含 feat: add anonymous usage telemetryfeat(preview): show centered camera orbit axis),已解决与上游在 commands/mod.rspipeline/runner.rs 等的冲突;cargo check 通过。

- Add image-folder/image-sequence input alongside the existing video path
  (frontend folder picker + backend scan/sort/renormalize into work/frames).
- Add GLOMAP global mapping (detected at runtime, falls back to incremental).
- Add vocab-tree matching / sequential loop detection (runtime-detect, needs a
  faiss-compatible vocab tree; falls back to exhaustive/sequential otherwise).
- Image sequences default to exhaustive matching; bump SIFT max_num_features to
  8192 for more stable initial models.
@258014
258014 force-pushed the feat/input-and-reconstruction-updates branch from cdb8ef1 to 365d303 Compare August 30, 2026 13:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant