tugbatumer
/

OpenELM-450M-Instruct-databaes-SFT-DPO-4bitquantized

Text Generation

4-bit precision

Model card Files Files and versions

tugbatumer commited on Jun 14, 2024

Commit

bde9853

·

verified ·

1 Parent(s): ed2f830

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -113,7 +113,7 @@
     "tokenizer": null,
     "true_sequential": true,
     "use_cuda_fp16": false,
-    "use_exllama": false,
   },
   "rope_freq_constant": 10000,
   "rope_max_length": 4096,

     "tokenizer": null,
     "true_sequential": true,
     "use_cuda_fp16": false,
+    "use_exllama": false
   },
   "rope_freq_constant": 10000,
   "rope_max_length": 4096,