Add Q2_K GGUF quantization

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text
+shenwen-coderV2-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text

LICENSE

@@ -0,0 +1,61 @@
+                                 Apache License
+                           Version 2.0, January 2004
+                        http://www.apache.org/licenses/
+
+   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity.
+
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+   2. Grant of Copyright License.
+
+   3. Grant of Patent License.
+
+   4. Redistribution.
+
+   5. Submission of Contributions.
+
+   6. Trademarks.
+
+   7. Disclaimer of Warranty.
+
+   8. Limitation of Liability.
+
+   9. Accepting Warranty or Additional Liability.
+
+   END OF TERMS AND CONDITIONS
+
+   Copyright 2025 shenwenAI
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+       http://www.apache.org/licenses/LICENSE-2.0
+
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.

README.md

@@ -0,0 +1,89 @@
+---
+quantization: Q2_K
+AIGC:
+    ContentProducer: Minimax Agent AI
+    ContentPropagator: shenwenAI
+    Label: AIGC
+---
+
+# shenwen-coderV2-Q2_K-GGUF
+
+<p align="center">
+  <img src="https://huggingface.co/front/assets/huggingface_logo.svg" alt="Hugging Face" width="50" height="50">
+</p>
+
+<div align="center">
+
+[![GGUF Model](https://img.shields.io/badge/Model-shenwen--coderV2--GGUF-blue.svg)](https://huggingface.co/shenwenAI/shenwen-coderV2-GGUF)
+[![Quantization](https://img.shields.io/badge/Quantization-Q2_K-yellow.svg)]()
+[![Format](https://img.shields.io/badge/Format-GGUF-green.svg)]()
+[![License](https://img.shields.io/badge/License-Apache%202.0-green.svg)]()
+
+</div>
+
+## Model Overview
+
+**shenwen-coderV2-Q2_K-GGUF** is a quantized GGUF version of [shenwen-coderV2-Instruct](https://huggingface.co/shenwenAI/shenwen-coderV2-Instruct), optimized for efficient inference with llama.cpp and compatible tools.
+
+## Quantization Details
+
+| Attribute | Value |
+|-----------|-------|
+| **Format** | GGUF |
+| **Quantization** | Q2_K |
+| **File Size** | ~323MB |
+| **Original Size** | ~949MB |
+| **Compression** | ~34% of original |
+
+## Usage with llama.cpp
+
+### Prerequisites
+
+```bash
+# Download llama.cpp CLI tools
+git clone https://github.com/ggerganov/llama.cpp
+cd llama.cpp
+mkdir build && cd build
+cmake .. && make -j
+```
+
+### Running Inference
+
+```bash
+# Download model
+wget https://huggingface.co/shenwenAI/shenwen-coderV2-GGUF/resolve/main/q2_k/shenwen-coderV2-Q2_K.gguf
+
+# Run inference
+./build/bin/llama-cli -m shenwen-coderV2-Q2_K.gguf -n 512 -p "Write a Python function to calculate factorial:"
+```
+
+### Running with quantize tools
+
+```bash
+# Quantize your own models
+./build/bin/llama-quantize input.gguf output-Q2_K.gguf Q2_K
+```
+
+## Usage with Ollama
+
+```bash
+# Pull the model
+ollama pull shenwenai/shenwen-coderV2:q2_k
+
+# Run inference
+ollama run shenwenai/shenwen-coderV2:q2_k "Write a hello world in Python"
+```
+
+## Model Source
+
+This GGUF model is converted from [shenwenAI/shenwen-coderV2-Instruct](https://huggingface.co/shenwenAI/shenwen-coderV2-Instruct), which is based on Qwen2.5-Coder-0.5B-Instruct.
+
+## License
+
+Apache 2.0 - See [LICENSE](https://huggingface.co/shenwenAI/shenwen-coderV2-Instruct/blob/main/LICENSE)
+
+## Acknowledgments
+
+- [Qwen Team](https://github.com/QwenLM/Qwen) for Qwen2.5-Coder
+- [llama.cpp](https://github.com/ggerganov/llama.cpp) for GGUF format
+- [shenwenAI](https://huggingface.co/shenwenAI) for model training

shenwen-coderV2-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9505cf477aff4b7dbacf358efee190fdeeed3026e4e7fe308c01e788698897eb
+size 338606944