Add GGUF models

.gitattributes

@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 FP16.gguf filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,20 +0,0 @@
----
-license: apache-2.0
-tags:
-- gguf
-- llama.cpp
-- quantized
----
-
-# FP16
-
-This repository contains the `FP16.gguf` model in GGUF format, quantized with llama.cpp.
-
-## Usage
-
-```python
-from llama_cpp import Llama
-model = Llama(model_path="FP16.gguf")
-output = model("Hello, world!")
-print(output)
-```

FP16.gguf → deepseek_sunfall_merged_Model.Q3_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b6eab5584dd9781569ef564d73b033f4e9880fbf877acfb31068c4c65462edb4
-size 16068893920
+oid sha256:98a0011114e512cb19b96c324e467ae164be1fb07318b4adafead1caaf0cdf03
+size 80374

deepseek_sunfall_merged_Model.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06588fb414c507b94a2e758b1c80207ff41d7eca9352bc42c4de533f5bc99563
+size 80374

deepseek_sunfall_merged_Model.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf90c062269148e94bc4407a99ec0b97fbd0158b14bf1396937a9435821bb644
+size 80374

deepseek_sunfall_merged_Model.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c5f324c447c94a9a7221c49dc25abcaef92d7929aa92fd22266c2e626ab4d9f
+size 80298

deepseek_sunfall_merged_Model.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:92a48bb4b4e08a863981f6f36e62829061932ea5bf4e76f4b682c16940444dc3
+size 80299