Skip to content

Add native ImageNet data and generation path for the joint MoT model - #322

Draft
ElmoPA wants to merge 1 commit into
codex/elmo-qknorm-swiglu-rmsnorm-20261026-v1from
codex/mot-imagenet-native-20261026-v1
Draft

ElmoPA wants to merge 1 commit into
codex/elmo-qknorm-swiglu-rmsnorm-20261026-v1from
codex/mot-imagenet-native-20261026-v1

Conversation

@ElmoPA

@ElmoPA ElmoPA commented Oct 26, 2026 •

Copy link
Copy Markdown
Collaborator

Image-only training now uses the full joint MoT architecture with absent vector modalities and class instructions encoded through the existing frozen Qwen path. The ImageNet adapter preserves the shared graph and Lightning evaluation path, supports fully noisy image generation, and fixes an immutable split and validation context.

A separate allocated-CPU preparation command verifies exact ImageNet image counts, class coverage, source bytes and decoded RGB hashes, with explicit handling of two historical non-image extraction scripts. Class-language joining does not reread the corpus.

Validation: 96 adapter CPU tests, 43 raw-preparation fixtures, and an independent integration review against the published architecture parent passed. No production ImageNet preparation, Qwen generation, GPU training or deployment is certified by these tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant