gemma3 multi-gpu bug-fix (#42630)

Signed-off-by: Philip Maybank <pmaybank@amd.com> Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
2026-05-15 02:32:05 -07:00
parent d26a28ab03
commit 1dc3fe08ea
1 changed files with 1 additions and 0 deletions
@@ -421,6 +421,7 @@ class Gemma3nMultimodalEmbedder(nn.Module):
            self.multimodal_hidden_size,
            self.text_hidden_size,
            bias=False,
+            input_is_parallel=False,  # scatter the full-width input internally
        )

        self.embedding_post_projection_norm = RMSNorm(