Skip to content

[model, conversion] fix: Handle optional DeepSeek V4 config and PP mappings - #4

Closed
bobboli wants to merge 2 commits into
fix/dsv4-integrationfrom
fix/dsv4-optional-config-and-pp
Closed

[model, conversion] fix: Handle optional DeepSeek V4 config and PP mappings#4
bobboli wants to merge 2 commits into
fix/dsv4-integrationfrom
fix/dsv4-optional-config-and-pp

Conversation

@bobboli

@bobboli bobboli commented Aug 19, 2026

Copy link
Copy Markdown
Owner

Summary

  • accept nested rope_theta values in DeepSeek V4 Hugging Face configs
  • skip auto-mapped parameters that are absent from every pipeline-parallel stage during Megatron-to-HF export
  • add focused regression coverage for both cases

These defensive compatibility changes are separated from the required DeepSeek V4 hash-routing fix. They are not dependencies of #3 and are retained as a draft for independent review.

Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
@bobboli

bobboli commented Aug 19, 2026

Copy link
Copy Markdown
Owner Author

Not required by the current DeepSeek V4 direct-HF rollout chain. The optional rope/config and PP mapping branch is retained for possible follow-up work.

@bobboli bobboli closed this Aug 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant