AlexHung29629
/

test_mllama_v14

Feature Extraction

Model card Files Files and versions

AlexHung29629 commited on Nov 21, 2024

Commit

ad9aaef

·

verified ·

1 Parent(s): d040a98

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -26,7 +26,7 @@
   "norm_init": 0.4,
   "pad_token_id": 128009,
   "projector_act": "swiglu",
-  "stack_factor": 8,
   "text_model_id": "voidful/Llama-3.2-8B-Instruct",
   "torch_dtype": "bfloat16",
   "transformers_version": "4.46.2",

   "norm_init": 0.4,
   "pad_token_id": 128009,
   "projector_act": "swiglu",
+  "stack_factor": 4,
   "text_model_id": "voidful/Llama-3.2-8B-Instruct",
   "torch_dtype": "bfloat16",
   "transformers_version": "4.46.2",