AlSamCur123
/

OSSFineMerge

Text Generation

text-generation-inference

Model card Files Files and versions

AlSamCur123 commited on Nov 12

Commit

aff214d

·

verified ·

1 Parent(s): 027c710

(Trained with Unsloth)

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -5,7 +5,7 @@
     "attention_bias": true,
     "attention_dropout": 0.0,
     "bos_token_id": 199998,
-    "torch_dtype": "float16",
     "eos_token_id": 200002,
     "experts_per_token": 4,
     "head_dim": 64,

     "attention_bias": true,
     "attention_dropout": 0.0,
     "bos_token_id": 199998,
+    "torch_dtype": "bfloat16",
     "eos_token_id": 200002,
     "experts_per_token": 4,
     "head_dim": 64,