Hugging Face's logo

abacaj
/
Replit-v2-CodeInstruct-3B-ggml

Text Generation
Transformers
mpt
custom_code
Model card Files
xet
Community
2
abacaj commited on
Commit
9328566
·
1 Parent(s): 0bd6d0a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -4,5 +4,5 @@ license: other
4
 
5
  ---
6
 
7
- This is a ggml quantized version of [Replit-v2-CodeInstruct-3B](https://huggingface.co/teknium/Replit-v2-CodeInstruct-3B). Quantized to 4bit -> q4_1.
8
- To run inferene you can use ggml directly or ctranformers (bindings/demo repo to be added): https://github.com/marella/ctransformers
 
4
 
5
  ---
6
 
7
+ This is a [ggml](https://github.com/ggerganov/ggml/) quantized version of [Replit-v2-CodeInstruct-3B](https://huggingface.co/teknium/Replit-v2-CodeInstruct-3B). Quantized to 4bit -> q4_1.
8
+ To run inferene you can use ggml directly or ctransformers (bindings/demo repo to be added): https://github.com/marella/ctransformers