Upload folder using huggingface_hub

.gitattributes

@@ -37,3 +37,13 @@ LocoOperator-4B.f16.gguf filter=lfs diff=lfs merge=lfs -text
 LocoOperator-4B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
 LocoOperator-4B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 LocoOperator-4B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+LocoOperator-4B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

LocoOperator-4B.IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1fa5c7f1b9c016bbe4981dcc33b57b99e533d48cdb57579a3ffe96f8902fbf20
+size 1962894752

LocoOperator-4B.IQ3_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7709ea42adc7dcf57e7aae09e5a22c5b5eb6194b6743ef535722f3eb8d147d58
+size 1899529632

LocoOperator-4B.IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9005ef14a0c19b338bf86fe7621fe636632e2f0cbdb64c94c50a7af8ccdd5865
+size 2286314912

LocoOperator-4B.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b5c33995fd3bf21f6ea3b65868330736718282f436b624a5022f0c5b0b914c6
+size 2239784352

LocoOperator-4B.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e02b8528ecc526a0c20ca3f33e2ce1d61c053364980bf00e938c12ddd030ec6
+size 2075616672

LocoOperator-4B.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b3e4837c98fdfbc9f71fc3ea250bcf3561f40413f1e68876e44c992be2b7e02a
+size 1886995872

LocoOperator-4B.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:875604c43649e95cf96b6e5460f4df3d72d9c9a437b42ec39d9f38869e01b7b6
+size 2383308192

LocoOperator-4B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4228512d50eac591f696b6ab51d854b76cb7ec628bcaf55db35ff5f7db6dc9b3
+size 2889512352

LocoOperator-4B.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e80eab3002d462b6fbac80eaa93de497922e5b3ff5d06eef70acabc4d322eb2
+size 2823710112

LocoOperator-4B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e91debf1572f3d6003797aab351dd509c439e8c9841dcb774fc129a324758552
+size 3306259872

README.md

@@ -15,35 +15,42 @@ language:
 pipeline_tag: text-generation
 ---
 
-# GGUF Files for LocoOperator-4B
-
-These are the GGUF files for [LocoreMind/LocoOperator-4B](https://huggingface.co/LocoreMind/LocoOperator-4B).
-
-> [!NOTE]  
-> **Note:** this model has only been quantized to **Q2_K**, **Q4_K_M**, and **Q8_0**. Other quantizations may become available later.
-
-## Downloads
-
-| GGUF Link | Quantization | Description |
-| ---- | ----- | ----------- |
+# GGUF Files for LocoOperator-4B
+
+These are the GGUF files for [LocoreMind/LocoOperator-4B](https://huggingface.co/LocoreMind/LocoOperator-4B).
+
+## Downloads
+
+| GGUF Link | Quantization | Description |
+| ---- | ----- | ----------- |
 | [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q2_K.gguf) | Q2_K | Lowest quality |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q3_K_S.gguf) | Q3_K_S |  |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.IQ3_S.gguf) | IQ3_S | Integer quant, preferable over Q3_K_S |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.IQ3_M.gguf) | IQ3_M | Integer quant |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q3_K_M.gguf) | Q3_K_M |  |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q3_K_L.gguf) | Q3_K_L |  |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.IQ4_XS.gguf) | IQ4_XS | Integer quant |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q4_K_S.gguf) | Q4_K_S | Fast with good performance |
 | [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q4_K_M.gguf) | Q4_K_M | **Recommended:** Perfect mix of speed and performance |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q5_K_S.gguf) | Q5_K_S |  |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q5_K_M.gguf) | Q5_K_M |  |
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q6_K.gguf) | Q6_K | Very good quality |
 | [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.Q8_0.gguf) | Q8_0 | Best quality |
-| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.f16.gguf) | f16 | Full precision, don't bother; use a quant |
-
-## Note from Flexan
-
-I provide GGUFs and quantizations of publicly available models that do not have a GGUF equivalent available yet.
-This process is not yet automated and I download, convert, quantize, and upload them **by hand**, usually for models **I deem interesting and wish to try out**.
-
-If there are some quants missing that you'd like me to add, you may request one in the community tab.
-If you want to request a public model to be converted, you can also request that in the community tab.
+| [Download](https://huggingface.co/Flexan/LocoreMind-LocoOperator-4B-GGUF/resolve/main/LocoOperator-4B.f16.gguf) | f16 | Full precision, don't bother; use a quant |
+
+## Note from Flexan
+
+I provide GGUFs and quantizations of publicly available models that do not have a GGUF equivalent available yet.
+This process is not yet automated and I download, convert, quantize, and upload them **by hand**, usually for models **I deem interesting and wish to try out**.
+
+If there are some quants missing that you'd like me to add, you may request one in the community tab.
+If you want to request a public model to be converted, you can also request that in the community tab.
 If you have questions regarding the model, please refer to the original model repo.
 
 # Model Card for LocoOperator-4B
 
 <div align="center">
-  <img src="https://huggingface.co/LocoreMind/LocoOperator-4B/resolve/main/assets/loco_operator.png" width="55%" alt="LocoOperator" />
+  <img src="assets/loco_operator.png" width="55%" alt="LocoOperator" />
 </div>
 
 <br>