XiaoluBELLA
/

llama3_models

text-generation-inference

Model card Files Files and versions

XiaoluBELLA commited on Sep 19, 2024

Commit

88c3b3b

·

verified ·

1 Parent(s): b2235af

Upload model trained with Unsloth

Upload model trained with Unsloth 2x faster

Files changed (1) hide show

adapter_config.json +2 -2

adapter_config.json CHANGED Viewed

@@ -20,11 +20,11 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "up_proj",
     "gate_proj",
     "k_proj",
     "v_proj",
-    "o_proj",
     "q_proj",
     "down_proj"
   ],

   "rank_pattern": {},
   "revision": null,
   "target_modules": [
+    "o_proj",
     "gate_proj",
     "k_proj",
     "v_proj",
+    "up_proj",
     "q_proj",
     "down_proj"
   ],