Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,18 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+RL_scale.jpeg filter=lfs diff=lfs merge=lfs -text
+close_performance.png filter=lfs diff=lfs merge=lfs -text
+main_logo.png filter=lfs diff=lfs merge=lfs -text
+mid_train_scale.jpeg filter=lfs diff=lfs merge=lfs -text
+open_performance.png filter=lfs diff=lfs merge=lfs -text
+open_performance_white.png filter=lfs diff=lfs merge=lfs -text
+test_time_scale.jpeg filter=lfs diff=lfs merge=lfs -text
+assets/test_time_scale.jpeg filter=lfs diff=lfs merge=lfs -text
+assets/close_performance.png filter=lfs diff=lfs merge=lfs -text
+assets/mid_train_scale.jpeg filter=lfs diff=lfs merge=lfs -text
+assets/open_performance_white.png filter=lfs diff=lfs merge=lfs -text
+assets/main_logo.png filter=lfs diff=lfs merge=lfs -text
+assets/RL_scale.jpeg filter=lfs diff=lfs merge=lfs -text
+assets/open_performance.png filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

LICENSE.md

@@ -0,0 +1,2 @@
+- Kimi-Dev-72B is built with Qwen-2.5-72B. Qwen-2.5-72B is licensed under the [Qwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen2.5-72B/blob/main/LICENSE), Copyright (c) Alibaba Cloud. All Rights Reserved.
+- Subject to the Qwen LICENSE AGREEMENT, Kimi-Dev-72B is under MIT license.

README.md

@@ -0,0 +1,119 @@
+---
+license: mit
+base_model:
+- moonshotai/Kimi-Dev-72B
+tags:
+- code
+- unsloth
+- swebench
+- software
+- issue-resolving
+---
+<div>
+<p style="margin-top: 0;margin-bottom: 0;">
+    <em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
+  </p>
+  <div style="display: flex; gap: 5px; align-items: center; ">
+    <a href="https://github.com/unslothai/unsloth/">
+      <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
+    </a>
+    <a href="https://discord.gg/unsloth">
+      <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
+    </a>
+    <a href="https://docs.unsloth.ai/basics/qwen3-how-to-run-and-fine-tune">
+      <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
+    </a>
+  </div>
+</div>
+
+<!-- # Kimi-Dev -->
+
+<div align="center">
+  <img src="./assets/main_logo.png" alt="Kimi Logo" width="400" />
+<h2><a href="https://moonshotai.github.io/Kimi-Dev/">
+Introducing Kimi-Dev: <br>A Strong and Open-source Coding LLM for Issue Resolution</a></h2>
+</a></h2>
+<b>Kimi-Dev Team</b>
+<br>
+
+</div>
+<div align="center">
+  <a href="">
+    <b>📄 Tech Report (Coming soon...)</b>
+  </a> &nbsp;|&nbsp;
+  <a href="https://github.com/MoonshotAI/Kimi-Dev">
+    <b>📄 Github</b>
+  </a> &nbsp;
+</div>
+
+<br>
+<br>
+
+<!-- https://github.com/MoonshotAI/Kimi-Dev -->
+
+We introduce Kimi-Dev-72B, our new open-source coding LLM for software engineering tasks. Kimi-Dev-72B achieves a new state-of-the-art on SWE-bench Verified among open-source models.
+
+- Kimi-Dev-72B achieves 60.4% performance on SWE-bench Verified. It surpasses the runner-up, setting a new state-of-the-art result among open-source models.
+
+
+- Kimi-Dev-72B is optimized via large-scale reinforcement learning. It autonomously patches real repositories in Docker and gains rewards only when the entire test suite passes. This ensures correct and robust solutions, aligning with real-world development standards.
+
+
+- Kimi-Dev-72B is available for download and deployment on Hugging Face and GitHub. We welcome developers and researchers to explore its capabilities and contribute to development.
+
+
+<div align="center">
+  <img src="./assets/open_performance_white.png" alt="Kimi Logo" width="600" />
+  <p><b>Performance of Open-source Models on SWE-bench Verified.</b></p>
+
+</div>
+
+
+
+## Quick Start
+```
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model_name = "moonshotai/Kimi-Dev-72B"
+
+model = AutoModelForCausalLM.from_pretrained(
+    model_name,
+    torch_dtype="auto",
+    device_map="auto"
+)
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+
+prompt = "Give me a short introduction to large language model."
+messages = [
+    {"role": "system", "content": "You are a helpful assistant."},
+    {"role": "user", "content": prompt}
+]
+text = tokenizer.apply_chat_template(
+    messages,
+    tokenize=False,
+    add_generation_prompt=True
+)
+model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
+
+generated_ids = model.generate(
+    **model_inputs,
+    max_new_tokens=512
+)
+generated_ids = [
+    output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
+]
+
+response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
+
+```
+
+## Citation
+```
+@misc{kimi_dev_72b_2025,
+  title        = {Introducing Kimi-Dev: A Strong and Open-source Coding LLM for Issue Resolution},
+  author       = {{Kimi-Dev Team}},
+  year         = {2025},
+  month        = {June},
+  url          = {\url{https://www.moonshot.cn/Kimi-Dev}}
+}
+```

added_tokens.json

@@ -0,0 +1,24 @@
+{
+  "</tool_call>": 151658,
+  "<tool_call>": 151657,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}

chat_template.jinja

@@ -0,0 +1,54 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- messages[0]['content'] }}
+    {%- else %}
+        {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}
+    {%- endif %}
+    {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
+    {%- else %}
+        {{- '<|im_start|>system\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- for message in messages %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
+        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {{- '<|im_start|>' + message.role }}
+        {%- if message.content %}
+            {{- '\n' + message.content }}
+        {%- endif %}
+        {%- for tool_call in message.tool_calls %}
+            {%- if tool_call.function is defined %}
+                {%- set tool_call = tool_call.function %}
+            {%- endif %}
+            {{- '\n<tool_call>\n{"name": "' }}
+            {{- tool_call.name }}
+            {{- '", "arguments": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- '}\n</tool_call>' }}
+        {%- endfor %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- message.content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+{%- endif %}

config.json

@@ -0,0 +1,29 @@
+{
+  "architectures": [
+    "Qwen2ForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "eos_token_id": 151645,
+  "hidden_act": "silu",
+  "hidden_size": 8192,
+  "initializer_range": 0.02,
+  "intermediate_size": 29568,
+  "max_position_embeddings": 131072,
+  "max_window_layers": 70,
+  "model_type": "qwen2",
+  "num_attention_heads": 64,
+  "num_hidden_layers": 80,
+  "num_key_value_heads": 8,
+  "pad_token_id": 151654,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 1000000.0,
+  "sliding_window": 131072,
+  "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.52.4",
+  "unsloth_fixed": true,
+  "use_cache": true,
+  "use_sliding_window": false,
+  "vocab_size": 152064
+}

model-1-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e4592f902e7ada3b7e0056b4e0113eac5265598c7ef959b1cb2668d2f4182feb
+size 4246787560

model-10-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a45e37e35c7d6e3f0a0ccd4c7328a9b51dc8e3cad8301fa1f17ed8bc22ed9f4b
+size 1755370864

model-11-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cddfe09f2e79ddaf0416f42995bb13aad22bc7b54d9f77fc10d169e2236e2b54
+size 1755370880

model-12-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8e74e96e3e60a1b6082a1405259fd0d1d89580e85d9ec0e4f0ebf52b40577d4c
+size 1755370880

model-13-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:938e0ad95f55a63ec7ccdc39cb58478a85f447b0974bae3ae885325af9aae1ea
+size 1755370880

model-14-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dba8bcd64710e0ca3cb41049e12f04f23e0ae6ee3ad229feaaa2c894bdea42df
+size 1755370880

model-15-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c4a0651887428fbd8e24c683b52aecea76d80a06399705a14efa8478b2951fdb
+size 1755370880

model-16-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f146a35312dac85a9ad23aee839693927e0aa1df98c038014348b7d6ee04cba
+size 1755370880

model-17-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9647adbade32ef02c89f7952f3adb73327af54c10532915088f553486772e6ae
+size 1755370880

model-18-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7bcf67a422a4a0a72c528ba8e49d11a1636eb42659b25768cde583c26e2c139
+size 1755370880

model-19-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:575ff83b7c777738f08f7e8718fc25057b585e9b1156252f3aa2a10ea976a205
+size 1755370880

model-2-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59718f65ee5f416d7beb38cfa3346e5029d93f8a663f1c70c755172d5efc6056
+size 1755370864

model-20-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73c7c77c3e30356fcacb625622bfb8dc968eb90d4a7f9c5abaf3d315c687bd64
+size 1755370880

model-21-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea44e43f52991419b5cfc05266b33017617a24afa4f2194bf5379505cfc10d03
+size 1755370880

model-22-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e064dbb49a2eef590362278e046e6d4bdef09dc6e195f23251c2bb314486c2b8
+size 1755370880

model-23-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e6fbae0102f0bc257062a82b02545784e3c274aee9f5658f3309321f56f5c80
+size 1755370880

model-24-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32d027bdfc8383eb25f6f9cd5dbeb63985c0152cfbfd3238c9e206f50537a272
+size 1755370880

model-25-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:844f554c277f86baf41723a3b1ff0e64b10709765b117a919d7ce941606c6f37
+size 1755370880

model-26-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:67f2248937b1a551a76235504ba8d97aaa061c45d13c737daf0bce4f6efaf026
+size 1755370880

model-27-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d31fbe9412c82bf83d1123b9aca68426922fe0564855b273d732f9706d4e32cb
+size 1755370880

model-28-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4121f63b76be5022c10bf8bdb05027487d8228621d8d2a084900b0ae61b9ea26
+size 1755370880

model-29-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de83fb1be00a675cb1a93a8d535284fd0bd5bf93840b1ab373dfaddaca220693
+size 1755370880

model-3-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b036685395cf4560e9fcade41db6273012a49f0cfe2dd458ae12ef697c8dd3d
+size 1755370864

model-30-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e7fa7792a850261e44bda6f77d6deaa070f713d515c9314bf6551e481937f23e
+size 1755370880

model-31-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d3ca9105f404f9edd5c08e4ff1e651fbe1cdb65cd55e64bd4a632feda0c9baa
+size 1755370880

model-32-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:047c3b2f0de41a11d6a7312a6ccf6a2841fd4cd0c6dd567f0c2bd921dd479d4a
+size 1755370880

model-33-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2d2d9094e743dda124936d6cf8f96d0b039ebf7cca52fb12603a07806f7b04d8
+size 1755370880

model-34-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:832c05b5feb9b7542c666042759cc607ac5276babf0da7b91d9af1bfb0a8f7ab
+size 1755370880

model-35-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ac443cf8d6e29cd40537dbd3255f484035c9763ba2a507664612b231801a27ca
+size 1755370880

model-36-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ae4f2b5832f0a6748d7c4929247318fcfd34e0632c67404a701f1ec1454d865f
+size 1755370880

model-37-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc67daf899e27a453e69db50ca57b354f978847a14fe156a3b4eaebab1513a30
+size 1755370880

model-38-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ff5d5013e4d87cea45438dd9098d643a2d18be4e0f916abd5d410be7d97e8fa6
+size 1755370880

model-39-of-80.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f78e79f0910691c9adbb568c6f176b9fbc9ca48ff56506dab8b4a8c2e6c506e5
+size 1755370880