Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Kodify_Nano.gguf filter=lfs diff=lfs merge=lfs -text
+Kodify_Nano_q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
+Kodify_Nano_q8_0.gguf filter=lfs diff=lfs merge=lfs -text

Kodify_Nano.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b24bfe506b639b3d344e0a0397abee0e271ec606cb4402698fed53db30169f8
+size 3093669120

Kodify_Nano_q4_k_s.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea4fd817a09aa78db97429688f092ee0af2d03655ae4207649ce820243aceed1
+size 940312320

Kodify_Nano_q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d258ab956fc7ed8da7600ee16da820b16d799c4ac173b3d70abe20b440a635d
+size 1646572800

README.md

@@ -0,0 +1,106 @@
+---
+library_name: ggml
+language:
+- ru
+- en
+pipeline_tag: text-generation
+license: apache-2.0
+license_name: apache-2.0
+license_link: https://huggingface.co/MTSAIR/Kodify-Nano-GGUF/blob/main/Apache%20License%20MTS%20AI.docx
+---
+
+# Kodify-Nano-GGUF 🤖
+
+Kodify-Nano-GGUF - 4-битная квантизированная GGUF версия модели [MTSAIR/Kodify-Nano](https://huggingface.co/MTSAIR/Kodify-Nano), оптимизированная для CPU-инференса. Легковесная LLM для задач разработки кода с минимальными ресурсами.
+
+Kodify-Nano-GGUF - 4-bit quantized GGUF version of [MTSAIR/Kodify-Nano](https://huggingface.co/MTSAIR/Kodify-Nano), optimized for CPU inference. Lightweight LLM for code development tasks with minimal resource requirements.
+
+## Download Models
+
+Available quantization variants:
+- Kodify_Nano_q4_k_s.gguf (balanced)
+- Kodify_Nano_q8_0.gguf (high quality)
+- Kodify_Nano.gguf (best quality, unquantized)
+
+Download using huggingface_hub:
+
+```bash
+pip install huggingface-hub
+python -c "from huggingface_hub import hf_hub_download; hf_hub_download(repo_id='MTSAIR/Kodify-Nano-GGUF', filename='Kodify_Nano_q4_k_s.gguf', local_dir='./models')"
+```
+
+## Using with Ollama
+
+1. Install Ollama: 
+https://ollama.com/download
+
+2. Create Modelfile:
+
+```
+FROM ./models/Kodify_Nano_q4_k_s.gguf
+PARAMETER temperature 0.4
+PARAMETER top_p 0.8
+PARAMETER num_ctx 8192
+TEMPLATE """<s>[INST] {{ .System }} {{ .Prompt }} [/INST]"""
+```
+
+3. Create and run model:
+ollama create kodify-nano -f Modelfile
+ollama run kodify-nano "Write a Python function to check prime numbers"
+
+## Python Integration
+
+Install Ollama Python library:
+
+```bash
+pip install ollama
+```
+
+Example code:
+
+```python
+import ollama
+
+response = ollama.generate(
+    model="kodify-nano",
+    prompt="Write a Python function to calculate factorial",
+    options={
+        "temperature": 0.4,
+        "top_p": 0.8,
+        "num_ctx": 8192
+    }
+)
+
+print(response['response'])
+```
+
+## Usage Examples
+
+### Code Generation
+
+```python
+response = ollama.generate(
+    model="kodify-nano",
+    prompt="""<s>[INST] 
+Write a Python function that:
+1. Accepts a list of numbers
+2. Returns the median value
+[/INST]""",
+    options={"max_tokens": 512}
+)
+
+### Code Refactoring
+response = ollama.generate(
+    model="kodify-nano",
+    prompt="""<s>[INST] 
+Refactor this Python code:
+
+def calc(a,b):
+    s = a + b
+    d = a - b
+    p = a * b
+    return s, d, p
+[/INST]""",
+    options={"temperature": 0.3}
+)
+```