nisten
/

BigCodeLlama-92b

Text Generation

text-generation-inference

Model card Files Files and versions

nisten commited on Jan 30, 2024

Commit

77640c1

·

verified ·

1 Parent(s): 1c120ff

Update README.md

Files changed (1) hide show

README.md +1 -5

README.md CHANGED Viewed

@@ -40,8 +40,4 @@ slices:
       model:
         path: ../CodeLlama-70b-Python-hf
 ```
-And to put together the .gguf grab the 2 part files and unite to have your 8bit 92gb gguf.
-```bash
-cat BigCodeLlama-92b-q9.gguf.part0 BigCodeLlama-92b-q8.gguf.part1 > BigCodeLlama-92b-q8.gguf
-```

       model:
         path: ../CodeLlama-70b-Python-hf
 ```
+Gguf available here https://huggingface.co/nisten/BigCodeLlama-92b-GGUF