Repository navigation
[flow] T-078 修复批量/合集任务串行与媒体、OCR、判定、ASR 五类报错 - #74
Merged
Merged
Conversation
- 新增 specs/022-batch-concurrency-and-media-reliability/spec.md(draft) - 记录 R1-R6 根因、D1-D7 已定决策、Q1-Q4 待拍板问题 - 定义 checkpoint/调度/OCR/判定/数据根接口草案与 W0-W5 验收命令 - specs/README.md 索引追加 022 不含任何实现代码;W1-W4 等 Q1-Q4 答复后开工。
- _run_with_parallel_gate 直接执行任务体,删除 task_serial_executor 固定 5 线程池,实际在途=用户设置 - 合并任务按 min(gate, 条数) 扇出,父任务不占槽位,章节按输入顺序落位 - 每条成功即原子写 checkpoint,429 停放后恢复只补未完成条目,成功保存后清理 - 画面判定解析失败降级保留候选(detail.judgement_degraded),不触发整任务重试 - _run_ocr_stage 预留进程级 OCR 上限接线 - tests/022.../w1:闸门/扇出/断点/降级 11 例;tests/001、tests/009 适配新语义
- get_data_dir 只拼一次:DATA_DIR 绝对/相对 backend 解析,默认 <backend>/data;export/media/downloader/note 全改调它 - init_db 启动打印媒体数据根,旧 data/data 非空时告警且不自动迁移,回填计数写日志 - OCR 429/5xx/超时最多重试 3 次(Retry-After 优先、0.5/1/2s 抖动、单次≤30s),新增进程级 BoundedSemaphore(OCR_MAX_CONCURRENCY,默认 4) - 判定层显式空清单→empty_frames、全批次解析失败→parse_failed,均降级保留全部候选,不触发任务级重试 - ASR model_dump(warnings=False),segments[].id/seek 字符串数值规整为 int - tests/022 w2-w4;tests/008 两例按 spec 022 D6 新语义更新 验证:pytest tests → 994 passed, 15 subtests;相关子集 374 passed
Owner
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
flow task: T-078
修复批量/合集任务串行与媒体、OCR、判定、ASR 五类报错
验收摘要:
卡链接:flow://task/T-078