stanrom
/

ShareCaptioner

Feature Extraction

InternLMXComposer

Model card Files Files and versions

stanrom commited on May 15, 2024

Commit

8f2d100

·

verified ·

1 Parent(s): bea937b

only meta

Files changed (1) hide show

modeling_InternLM_XComposer.py +1 -1

modeling_InternLM_XComposer.py CHANGED Viewed

@@ -68,7 +68,7 @@ class InternLMXComposerForCausalLM(PreTrainedModel):
             with torch.device('meta'):
                 self.internlm_model = InternLMForCausalLM._from_config(config)
             self.internlm_model.to_empty(device='meta').to(torch.float16)
-            self.internlm_model.to(config.device)
         self.internlm_proj = nn.Linear(4096,
                                     self.internlm_model.config.hidden_size)

             with torch.device('meta'):
                 self.internlm_model = InternLMForCausalLM._from_config(config)
             self.internlm_model.to_empty(device='meta').to(torch.float16)
+            # self.internlm_model.to(config.device)
         self.internlm_proj = nn.Linear(4096,
                                     self.internlm_model.config.hidden_size)