twhoool02
/

Falcon-7B-instruct-NF4

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

twhoool02 commited on Mar 17, 2024

Commit

0309c7d

·

verified ·

1 Parent(s): f366363

Upload FalconForCausalLM

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -48,6 +48,6 @@
   "rope_theta": 10000.0,
   "torch_dtype": "float16",
   "transformers_version": "4.38.2",
-  "use_cache": false,
   "vocab_size": 65024
 }

   "rope_theta": 10000.0,
   "torch_dtype": "float16",
   "transformers_version": "4.38.2",
+  "use_cache": true,
   "vocab_size": 65024
 }