Instructions to use DKTechin/kanana with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use DKTechin/kanana with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf DKTechin/kanana:Q4_K_M # Run inference directly in the terminal: llama cli -hf DKTechin/kanana:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf DKTechin/kanana:Q4_K_M # Run inference directly in the terminal: llama cli -hf DKTechin/kanana:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf DKTechin/kanana:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf DKTechin/kanana:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf DKTechin/kanana:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf DKTechin/kanana:Q4_K_M
Use Docker
docker model run hf.co/DKTechin/kanana:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use DKTechin/kanana with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DKTechin/kanana" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DKTechin/kanana", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/DKTechin/kanana:Q4_K_M
- Ollama
How to use DKTechin/kanana with Ollama:
ollama run hf.co/DKTechin/kanana:Q4_K_M
- Unsloth Studio
How to use DKTechin/kanana with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for DKTechin/kanana to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for DKTechin/kanana to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for DKTechin/kanana to start chatting
- Pi
How to use DKTechin/kanana with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf DKTechin/kanana:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "DKTechin/kanana:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use DKTechin/kanana with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf DKTechin/kanana:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "DKTechin/kanana:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use DKTechin/kanana with Docker Model Runner:
docker model run hf.co/DKTechin/kanana:Q4_K_M
- Lemonade
How to use DKTechin/kanana with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull DKTechin/kanana:Q4_K_M
Run and chat with the model
lemonade run user.kanana-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use DKTechin/kanana with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf DKTechin/kanana:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default DKTechin/kanana:Q4_K_M
Run Hermes
hermes
- Atomic Chat
docs: Kanana Open License 사본·NOTICE·모델 카드 추가 (§3.1 재배포 의무)
#1
by heewoon - opened
LICENSE
ADDED
|
@@ -0,0 +1,186 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# KANANA OPEN LICENSE AGREEMENT
|
| 2 |
+
|
| 3 |
+
|
| 4 |
+
|
| 5 |
+
Kanana Release Date: July 17, 2025
|
| 6 |
+
|
| 7 |
+
This KANANA OPEN LICENSE AGREEMENT (this “Agreement”) is made by and between you and Kakao Corp. (“KAKAO”) that governs your use of Kanana Materials that KAKAO provides to you.
|
| 8 |
+
|
| 9 |
+
By using, copying, modifying, distributing, performing, or displaying all or part of Kanana Materials, or otherwise accepting the terms and conditions of this Agreement, you agree to be bound by this Agreement. You hereby represent and warrant that (i) you are legally authorized to enter into this Agreement, and (ii) if you are entering into this Agreement on behalf of a legal entity, you have the authority to legally and validly bind such entity.
|
| 10 |
+
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
## 1. Definition
|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
|
| 17 |
+
* **“Agreement”** means the terms and conditions for use, copying, distribution and modification of Kanana Materials as set forth herein.
|
| 18 |
+
|
| 19 |
+
|
| 20 |
+
* **“KAKAO”** means Kakao Corp.
|
| 21 |
+
|
| 22 |
+
|
| 23 |
+
* **“You”** means an individual or legal entity that enters into this Agreement with KAKAO and exercises its rights hereunder or uses Kanana Materials for any purpose. If you enter into this Agreement on behalf of a legal entity, “you” shall include such entity.
|
| 24 |
+
|
| 25 |
+
|
| 26 |
+
* **“Kanana”** means the basic large-scale language model, software, and algorithms distributed by KAKAO under this Agreement, including parameters (such as Model Weights and optimizer status), machine learning model codes, inference/learning/fine-tuning codes, and other related elements.
|
| 27 |
+
|
| 28 |
+
|
| 29 |
+
* **“Documentation”** means the specifications, manuals, and other documentation accompanying Kanana distributed by KAKAO.
|
| 30 |
+
|
| 31 |
+
|
| 32 |
+
* **“Kanana Materials”** means, collectively, Kanana and Documentation, including any portions or components thereof.
|
| 33 |
+
|
| 34 |
+
|
| 35 |
+
* **“Outputs”** means information content generated by operating or otherwise using Kanana Materials.
|
| 36 |
+
|
| 37 |
+
|
| 38 |
+
* **“Derivative Works”** means (i) any modifications to Kanana, (ii) any work of authorship based on Kanana, or (iii) any other designed machine learning models that either directly use the patterns of Model Weights, parameters, operations, and/or outputs or incorporate a substantial part of Kanana’s performance or functional characteristics through methods including, but not limited to, transfer learning, fine-tuning, or knowledge distillation. This includes distillation methods using Kanana’s intermediate data representations or a method based on the synthetic data outputs generated by Kanana; *provided, however*, that Outputs shall not be deemed to be Derivative Works.
|
| 39 |
+
|
| 40 |
+
|
| 41 |
+
* **“Model Weights”** means a set of numerical parameter values generated during Kanana’s learning process, representing the result of substantial investment and effort by KAKAO.
|
| 42 |
+
|
| 43 |
+
|
| 44 |
+
|
| 45 |
+
---
|
| 46 |
+
|
| 47 |
+
## 2. Grant of License and Use Policy
|
| 48 |
+
|
| 49 |
+
|
| 50 |
+
|
| 51 |
+
**2.1 Grant of License.** Subject to the terms and conditions of this Agreement, you are granted a non-exclusive, worldwide, non-transferrable, royalty-free limited license under KAKAO’s intellectual property or other rights owned by KAKAO that enables you to access, download, install, copy, use, reproduce, distribute, create Derivative Works of, and make modifications to Kanana Materials.
|
| 52 |
+
|
| 53 |
+
**2.2 Policy on Prohibited Use.** Your use of Kanana Materials and Derivative Works must comply with applicable laws and regulations and adhere to KAKAO’s Guidelines For Responsible AI, which is hereby incorporated into this Agreement.
|
| 54 |
+
|
| 55 |
+
**2.3** This Agreement applies solely to Kanana-*** and shall not apply to any other models distributed by KAKAO under separate licenses. Licenses applicable to such other models shall not apply to Kanana-***.
|
| 56 |
+
|
| 57 |
+
**2.4** The license terms applicable to a specific version of Kanana applies exclusively to that version and shall not extend to any other versions. Each version shall be deemed as an independent and separate work of authorship.
|
| 58 |
+
|
| 59 |
+
**2.5** You may use each version of Kanana only in accordance with the license terms expressly specified for that version, and you shall not claim that the license terms applicable to one version apply to any other version.
|
| 60 |
+
|
| 61 |
+
**2.6** You shall not combine different versions of Kanana versions that are subject to different license terms in order to circumvent any applicable license terms.
|
| 62 |
+
|
| 63 |
+
---
|
| 64 |
+
|
| 65 |
+
## 3. Redistribution
|
| 66 |
+
|
| 67 |
+
|
| 68 |
+
|
| 69 |
+
**3.1** You may copy, distribute or disclose Kanana, Derivative Works, or any products or services that contain Kanana or Derivative Works; provided, however, that you shall:
|
| 70 |
+
|
| 71 |
+
* **(i)** incorporate the compliance obligation set forth in the Policy on Prohibited Use provision of Section 2.2 in any agreement for use and distribution and notify subsequent users that such use restrictions apply;
|
| 72 |
+
|
| 73 |
+
|
| 74 |
+
* **(ii)** provide any recipients of Kanana Materials or Derivative Works a copy of this Agreement;
|
| 75 |
+
|
| 76 |
+
|
| 77 |
+
* **(iii)** expressly indicate in any files you have modified that it has been modified by you;
|
| 78 |
+
|
| 79 |
+
|
| 80 |
+
* **(iv)** include a “Notice” text file that includes the following notice:
|
| 81 |
+
> “Kanana is licensed in accordance with the Kanana Open License Agreement. Copyright © KAKAO Corp. All Rights Reserved.”; and
|
| 82 |
+
>
|
| 83 |
+
>
|
| 84 |
+
|
| 85 |
+
|
| 86 |
+
* **(v)** clearly display the phrase **“Powered by Kanana”** on related websites, user interfaces, blog posts, introduction pages, or product documentation in a manner that is easily recognizable to users. In addition, if you use Kanana Materials or their outputs to create, train, improve, or enhance other AI models and distribute them, you must include **‘Kanana’** as a prefix to the name of such AI models.
|
| 87 |
+
|
| 88 |
+
|
| 89 |
+
|
| 90 |
+
**3.2** You may add your own copyright statement to your modifications of Kanana Materials and may provide additional or different license terms and conditions; provided, however, that such additional or different license terms and conditions shall not violate or conflict with any provisions of this Agreement.
|
| 91 |
+
|
| 92 |
+
---
|
| 93 |
+
|
| 94 |
+
## 4. Additional Commercial Terms
|
| 95 |
+
|
| 96 |
+
|
| 97 |
+
|
| 98 |
+
**4.1** If you wish to engage in any of the following activities using Kanana Materials or any Derivative Works, you must obtain a separate commercial license expressly granted by KAKAO:
|
| 99 |
+
|
| 100 |
+
* **(i)** Offering or (re)selling to third parties access to Kanana Materials or any Derivative Works through API, cloud platforms, or other remote access services;
|
| 101 |
+
|
| 102 |
+
|
| 103 |
+
* **(ii)** Offering or (re)selling to third parties Kanana Materials or any Derivative Works in whole or in part, as part of a system integration (SI) or on-premise deployment solution; or
|
| 104 |
+
|
| 105 |
+
|
| 106 |
+
* **(iii)** Offering or (re)selling to third parties Kanana Materials or any Derivative Works embedded in on-device domains.
|
| 107 |
+
|
| 108 |
+
|
| 109 |
+
|
| 110 |
+
**4.2** For clarity, unless your activities or conditions fall within those specified in Section 4.1 above, you may use Kanana Materials or any Derivative Works for the development and operation of your own services without obtaining a commercial license from KAKAO.
|
| 111 |
+
|
| 112 |
+
**4.3** The grant of any commercial license under Section 4.1 shall be at KAKAO’s sole discretion.
|
| 113 |
+
|
| 114 |
+
---
|
| 115 |
+
|
| 116 |
+
## 5. Outputs
|
| 117 |
+
|
| 118 |
+
|
| 119 |
+
|
| 120 |
+
KAKAO will not claim any rights to Outputs you generate using Kanana Materials. You shall be solely responsible for Outputs and the use thereof.
|
| 121 |
+
|
| 122 |
+
---
|
| 123 |
+
|
| 124 |
+
## 6. Disclaimer of Warranty
|
| 125 |
+
|
| 126 |
+
|
| 127 |
+
|
| 128 |
+
UNLESS REQUIRED BY LAW, KANANA MATERIALS ARE PROVIDED ON AN “AS IS” BASIS, AND KAKAO DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE.
|
| 129 |
+
|
| 130 |
+
---
|
| 131 |
+
|
| 132 |
+
## 7. Limitation on Liability
|
| 133 |
+
|
| 134 |
+
|
| 135 |
+
|
| 136 |
+
UNLESS REQUIRED BY LAW, IN NO EVENT SHALL KAKAO BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY DIRECT, INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, AND PUNITIVE DAMAGES OF ANY CHARACTER ARISING OUT OF THE USE OR INABILITY TO USE KANANA MATERIALS, DERIVATIVE WORKS, OR OUTPUTS, EVEN IF KAKAO HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
|
| 137 |
+
|
| 138 |
+
---
|
| 139 |
+
|
| 140 |
+
## 8. Indemnification
|
| 141 |
+
|
| 142 |
+
|
| 143 |
+
|
| 144 |
+
You shall indemnify and hold KAKAO harmless from and against any and all claims that may be filed by a third party as a result of your infringement of any third party’s rights or violation of any applicable law, to the extent caused by your use or distribution of Kanana Materials, Derivative Works, or Outputs; provided, however, that the foregoing shall not apply to claims resulting from KAKAO’s willful or gross negligence.
|
| 145 |
+
|
| 146 |
+
---
|
| 147 |
+
|
| 148 |
+
## 9. Intellectual Property
|
| 149 |
+
|
| 150 |
+
|
| 151 |
+
|
| 152 |
+
**9.1** This Agreement does not grant you any rights to use KAKAO’s trademarks, service marks, or product names. However, on a limited basis and solely for the purpose of complying with Section 3.1(v), KAKAO authorizes you to use the Kanana trademark, provided that KAKAO may require you to discontinue such use at any time if you impair the value of the Kanana trademark. For clarity, such limited license for trademark use shall not be interpreted as KAKAO’s endorsement, sponsorship, or guarantee of, or the assumption of any liability for, your Derivative Works, Outputs, or any associated services.
|
| 153 |
+
|
| 154 |
+
**9.2** KAKAO retains ownership of Kanana Materials and Derivative Works created by KAKAO, but you will retain ownership of any Derivative Works and modifications made by you.
|
| 155 |
+
|
| 156 |
+
**9.3** If you bring any legal action or proceeding against KAKAO or a third party alleging that the Kanana Materials, Derivative Works, or Outputs infringe your intellectual property rights, your rights under this Agreement shall automatically terminate as of the date such action is filed.
|
| 157 |
+
|
| 158 |
+
**9.4** You acknowledge that Model Weights are a valuable asset of KAKAO. You shall not extract, copy, distribute, modify Model Weights or use them to train new models, except as expressly permitted under this Agreement.
|
| 159 |
+
|
| 160 |
+
**9.5** The protections under this Agreement apply to all components of Kanana Materials (irrespective of whether it is recognized as a work of authorship), including, but not limited to, Model Weights, parameters, algorithms, or structures. You may exercise your rights in these components only to the extent expressly permitted under this Agreement.
|
| 161 |
+
|
| 162 |
+
---
|
| 163 |
+
|
| 164 |
+
## 10. Term and Termination
|
| 165 |
+
|
| 166 |
+
|
| 167 |
+
|
| 168 |
+
The term of this Agreement will commence upon your acceptance of this Agreement or access to Kanana Materials and will continue in full force and effect until terminated in accordance with the terms and conditions herein. KAKAO may terminate this Agreement if you are in breach of any term or condition of this Agreement. Upon termination of this Agreement, you shall delete and cease use of Kanana Materials and Derivative Works. Sections 5, 6, 7, 8, 10 and 11 shall survive the termination of this Agreement.
|
| 169 |
+
|
| 170 |
+
---
|
| 171 |
+
|
| 172 |
+
## 11. Governing Law and Arbitration
|
| 173 |
+
|
| 174 |
+
|
| 175 |
+
|
| 176 |
+
**11.1** This Agreement will be governed and construed under the laws of the Republic of Korea, without regard to its conflicts of laws principles.
|
| 177 |
+
|
| 178 |
+
**11.2** Any disputes arising out of or in connection with this Agreement shall be finally settled by arbitration in accordance with the International Arbitration Rules of the Korean Commercial Arbitration Board. The number of arbitrators shall be one. The seat, or legal place, of arbitral proceedings shall be Seoul, Republic of Korea. The language to be used in the arbitral proceedings shall be English. Either party may seek interim or provisional relief from a court of competent jurisdiction, which shall not be considered a waiver of any provision in this Section. The arbitral tribunal also has the authority to issue orders for interim or provisional relief.
|
| 179 |
+
|
| 180 |
+
---
|
| 181 |
+
|
| 182 |
+
## 12. No Waiver
|
| 183 |
+
|
| 184 |
+
|
| 185 |
+
|
| 186 |
+
KAKAO’s failure or delay in exercising any of its rights under this Agreement shall not constitute a waiver of such rights.
|
NOTICE
ADDED
|
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Kanana is licensed in accordance with the Kanana Open License Agreement.
|
| 2 |
+
Copyright © KAKAO Corp. All Rights Reserved.
|
README.md
ADDED
|
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: kanana
|
| 4 |
+
license_link: LICENSE
|
| 5 |
+
base_model: kakaocorp/kanana-2-3b-instruct
|
| 6 |
+
base_model_relation: quantized
|
| 7 |
+
pipeline_tag: text-generation
|
| 8 |
+
language:
|
| 9 |
+
- ko
|
| 10 |
+
- en
|
| 11 |
+
tags:
|
| 12 |
+
- gguf
|
| 13 |
+
- llama.cpp
|
| 14 |
+
- quantized
|
| 15 |
+
- kanana
|
| 16 |
+
---
|
| 17 |
+
|
| 18 |
+
# Kanana 2 3B Instruct — GGUF (Q4_K_M)
|
| 19 |
+
|
| 20 |
+
**Powered by Kanana**
|
| 21 |
+
|
| 22 |
+
[`kakaocorp/kanana-2-3b-instruct`](https://huggingface.co/kakaocorp/kanana-2-3b-instruct) 를 llama.cpp 에서 바로 쓸 수 있게 GGUF 로 변환하고 4bit(Q4_K_M) 양자화한 파일입니다. 원본 배포에는 GGUF 가 없어 사내 온디바이스(로컬 LLM) 용도로 직접 변환했습니다.
|
| 23 |
+
|
| 24 |
+
| | |
|
| 25 |
+
|---|---|
|
| 26 |
+
| 파일 | `kanana-2-3b-instruct-Q4_K_M.gguf` |
|
| 27 |
+
| 크기 | 2,161,793,408 bytes (2.01 GiB) |
|
| 28 |
+
| 양자화 | Q4_K_M — 4.92 BPW (원본 BF16 16.00 BPW) |
|
| 29 |
+
| 아키텍처 | `qwen3` (원본 `config.json` 이 `Qwen3ForCausalLM`) |
|
| 30 |
+
| 토크나이저 | `tokenizer.ggml.pre = kanana2`, vocab 128,256 |
|
| 31 |
+
| 컨텍스트 | 32,768 (rope: yarn, factor 40, original 4,096) |
|
| 32 |
+
| 대화 서식 | 원본 `chat_template.jinja` 를 GGUF 메타데이터에 포함 |
|
| 33 |
+
|
| 34 |
+
## 변경 사항 (Kanana Open License §3.1(iii))
|
| 35 |
+
|
| 36 |
+
가중치의 값을 바꾸는 학습·파인튜닝·병합은 하지 않았습니다. 원본 `safetensors` 를 아래 절차로 **형식 변환 + 4bit 양자화**만 했습니다.
|
| 37 |
+
|
| 38 |
+
```bash
|
| 39 |
+
# llama.cpp @ 7e1e28c (2026-07-28)
|
| 40 |
+
python convert_hf_to_gguf.py kanana-2-3b-instruct --outtype bf16 \
|
| 41 |
+
--outfile kanana-2-3b-instruct-BF16.gguf
|
| 42 |
+
./build/bin/llama-quantize kanana-2-3b-instruct-BF16.gguf \
|
| 43 |
+
kanana-2-3b-instruct-Q4_K_M.gguf Q4_K_M
|
| 44 |
+
```
|
| 45 |
+
|
| 46 |
+
4bit 양자화는 원본 대비 품질 손실을 수반합니다. 원본 품질이 필요하면 위 링크의 원본 저장소를 쓰세요.
|
| 47 |
+
|
| 48 |
+
## 사용법
|
| 49 |
+
|
| 50 |
+
```bash
|
| 51 |
+
# llama.cpp
|
| 52 |
+
llama-cli -hf DKTechin/kanana:Q4_K_M -c 2048 --jinja \
|
| 53 |
+
-sys "당신은 사내 메신저 대화를 간결하게 요약하는 도우미입니다." \
|
| 54 |
+
-p "아래 대화를 3줄로 요약해줘: ..."
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
LM Studio·Jan·Ollama 등 GGUF 를 읽는 런타임에서도 그대로 씁니다. 시스템 프롬프트 없이 쓰면 요약 대신 입력을 되풀이하는 경향이 있어, 역할을 지정하는 시스템 프롬프트를 함께 주는 편이 안전합니다.
|
| 58 |
+
|
| 59 |
+
## 확인한 것 · 확인하지 못한 것
|
| 60 |
+
|
| 61 |
+
- 확인: 메타데이터(arch·tokenizer pre·rope·chat template), 실제 한국어 요약 생성, macOS/Metal 기준 2048 토큰 조건에서 프롬프트 1,375 t/s · 생성 128 t/s.
|
| 62 |
+
- 미확인: 32k 장문 품질. 원본 `config.json` 은 rope 배수를 40 으로 적어 두었지만 길이 비율(32,768 / 4,096)로 계산하면 8 이라 서로 맞지 않습니다. 원본 파이썬 런타임과 동작을 맞추기 위해 **명시값 40 을 그대로 기록**했으니, 아주 긴 입력에서 이상하면 이 값을 먼저 의심하세요.
|
| 63 |
+
|
| 64 |
+
## 라이선스
|
| 65 |
+
|
| 66 |
+
이 파일은 [Kanana Open License Agreement](LICENSE) 를 따르는 파생물입니다. 사본은 이 저장소의 [`LICENSE`](LICENSE), 고지 문구는 [`NOTICE`](NOTICE) 에 있습니다.
|
| 67 |
+
|
| 68 |
+
- 사용자는 원본과 동일하게 **금지된 사용 정책(Agreement §2.2)** 과 KAKAO 의 Guidelines For Responsible AI 를 준수해야 하며, 이 파일을 재배포할 때에도 같은 의무를 후속 사용자에게 알려야 합니다.
|
| 69 |
+
- API·클라우드 등으로 제3자에게 접근을 제공하거나 재판매하려면 **KAKAO 의 별도 상업 라이선스**가 필요합니다(Agreement §4).
|
| 70 |
+
- 이 파일을 사용하는 웹사이트·UI·문서에는 **"Powered by Kanana"** 를 알아볼 수 있게 표시해야 합니다(Agreement §3.1(v)).
|
| 71 |
+
|
| 72 |
+
```
|
| 73 |
+
Kanana is licensed in accordance with the Kanana Open License Agreement.
|
| 74 |
+
Copyright © KAKAO Corp. All Rights Reserved.
|
| 75 |
+
```
|