jinaai
/

xlm-roberta-flash-implementation

🇪🇺 Region: EU

Model card Files Files and versions

lora-multiple-adapters

#11

by jupyterjazz - opened May 15, 2024

base: refs/heads/main

←

from: refs/pr/11

Discussion Files changed

Files changed (1) hide show

modeling_lora.py +1 -1

modeling_lora.py CHANGED Viewed

@@ -233,7 +233,7 @@ class XLMRobertaLoRA(XLMRobertaModel):
         self._alpha = config.lora_alpha
         self._register_lora(
-            num_adaptations=self._num_adaptations,
             rank=self._rank,
             dropout_p=self._dropout_p,
             alpha=self._alpha,

         self._alpha = config.lora_alpha
         self._register_lora(
+            num_adaptations=len(self._lora_adaptations),
             rank=self._rank,
             dropout_p=self._dropout_p,
             alpha=self._alpha,