Hugging Face's logo

DanielClough
/
Candle_OrcaMini-3B

Text Generation
GGUF
English
Model card Files
xet
Community
Ubuntu commited on
Commit
562bfc7
·
1 Parent(s): 84282ad

add .gguf

Browse files
Files changed (14) hide show
  1. Candle_OrcaMini-3B_f16.gguf +0 -0
  2. Candle_OrcaMini-3B_q2k.gguf +0 -0
  3. Candle_OrcaMini-3B_q3k.gguf +0 -0
  4. Candle_OrcaMini-3B_q4_0.gguf +3 -0
  5. Candle_OrcaMini-3B_q4_1.gguf +0 -0
  6. Candle_OrcaMini-3B_q4k.gguf +0 -0
  7. Candle_OrcaMini-3B_q5_0.gguf +0 -0
  8. Candle_OrcaMini-3B_q5_1.gguf +0 -0
  9. Candle_OrcaMini-3B_q5k.gguf +0 -0
  10. Candle_OrcaMini-3B_q6k.gguf +0 -0
  11. Candle_OrcaMini-3B_q8_0.gguf +0 -0
  12. Candle_OrcaMini-3B_q8_1.gguf +0 -0
  13. Candle_OrcaMini-3B_q8k.gguf +0 -0
  14. README.md +13 -0
Candle_OrcaMini-3B_f16.gguf ADDED
File without changes
Candle_OrcaMini-3B_q2k.gguf ADDED
File without changes
Candle_OrcaMini-3B_q3k.gguf ADDED
File without changes
Candle_OrcaMini-3B_q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80d3d247e073f90001df111327dcd955a2b2c1438a9c713df1a382a240358e1f
3
+ size 1928000288
Candle_OrcaMini-3B_q4_1.gguf ADDED
File without changes
Candle_OrcaMini-3B_q4k.gguf ADDED
File without changes
Candle_OrcaMini-3B_q5_0.gguf ADDED
File without changes
Candle_OrcaMini-3B_q5_1.gguf ADDED
File without changes
Candle_OrcaMini-3B_q5k.gguf ADDED
File without changes
Candle_OrcaMini-3B_q6k.gguf ADDED
File without changes
Candle_OrcaMini-3B_q8_0.gguf ADDED
File without changes
Candle_OrcaMini-3B_q8_1.gguf ADDED
File without changes
Candle_OrcaMini-3B_q8k.gguf ADDED
File without changes
README.md ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - pankajmathur/orca_mini_3b
4
+ language:
5
+ - en
6
+ pipeline_tag: text-generation
7
+ license: apache-2.0
8
+ ---
9
+
10
+ This repo includes `.gguf` built for HuggingFace/Candle.
11
+ They will not work with `llama.cpp`.
12
+
13
+ Refer to the [original repo](https://huggingface.co/pankajmathur/orca_mini_3b) for more details.