Fixed checkpoint weight-tying to resolve tie_word_embeddings top-level-first, matching Hugging Face tying behavior.
Merged PR fixing checkpoint weight-tying so tie_word_embeddings is resolved top-level-first, matching Hugging Face’s tying semantics.
NVIDIA NeMo
Backported the Gemma4 MoE re-tie fix (#2601) into the r0.5.0 release branch.
Cherry-pick of #2601 into the r0.5.0 release branch.
Fixed Gemma4 MoE weight tying where lm_head drifted from the active embed_tokens during training.
Merged PR fixing weight tying on the Gemma4 MoE path: the language-model replacement orphaned the lm_head ↔ embed_tokens link, so the tied weights drifted during training. The fix re-ties lm_head to the active embed_tokens.
Resolved ImportError: AnthropicOutputConfig in nightly images by busting BuildKit layer cache with wheel SHA-256 checksums.
Merged PR fixing stale wheel installs in nightly Docker images. Bind-mount installs were skipped on warm BuildKit agents; copying only wheel.sha256 busts the cache without bloating the image. Added regression test for Anthropic protocol exports.