Text Generation
Transformers
Safetensors
Korean
English
qwen3
chimera
darwin
vidraft
korean
kmmlu
reasoning
conversational
text-generation-inference
Instructions to use FINAL-Bench/Darwin-4B-Chimera with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FINAL-Bench/Darwin-4B-Chimera with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="FINAL-Bench/Darwin-4B-Chimera") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("FINAL-Bench/Darwin-4B-Chimera") model = AutoModelForCausalLM.from_pretrained("FINAL-Bench/Darwin-4B-Chimera") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use FINAL-Bench/Darwin-4B-Chimera with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "FINAL-Bench/Darwin-4B-Chimera" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FINAL-Bench/Darwin-4B-Chimera", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/FINAL-Bench/Darwin-4B-Chimera
- SGLang
How to use FINAL-Bench/Darwin-4B-Chimera with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "FINAL-Bench/Darwin-4B-Chimera" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FINAL-Bench/Darwin-4B-Chimera", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "FINAL-Bench/Darwin-4B-Chimera" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FINAL-Bench/Darwin-4B-Chimera", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use FINAL-Bench/Darwin-4B-Chimera with Docker Model Runner:
docker model run hf.co/FINAL-Bench/Darwin-4B-Chimera
Card in English: lead with Chimera value/significance; remove base_model (pointed to private repo -> 401 for visitors)
Browse files
README.md
CHANGED
|
@@ -1,6 +1,5 @@
|
|
| 1 |
---
|
| 2 |
license: gemma
|
| 3 |
-
base_model: FINAL-Bench/Darwin-V9-Chimera-4B-SFT
|
| 4 |
tags:
|
| 5 |
- chimera
|
| 6 |
- darwin
|
|
@@ -17,49 +16,53 @@ library_name: transformers
|
|
| 17 |
|
| 18 |
# Darwin-4B-Chimera
|
| 19 |
|
| 20 |
-
**
|
| 21 |
|
| 22 |
-
|
| 23 |
|
| 24 |
---
|
| 25 |
|
| 26 |
-
## Chimera
|
| 27 |
|
| 28 |
-
|
| 29 |
|
| 30 |
-
|
| 31 |
-
- ๋จ์ผ ๋ถ๋ชจ๋ก๋ ๋๋ฌํ ์ ์๋ ์กฐํฉ์ ๋ง๋ญ๋๋ค โ ๊ฒฐ๊ณผ๋ฌผ์ ์ด๋ ํ ๋ถ๋ชจ๋ก๋ ํ์๋์ง ์์ต๋๋ค.
|
| 32 |
-
- **์ถ๊ฐ ์ฌ์ ํ์ต ์์ด** ์ธ๋๋ฅผ ์ด์ด๊ฐ๋๋ค.
|
| 33 |
|
| 34 |
-
|
|
|
|
| 35 |
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
## ์ฑ๋ฅ
|
| 39 |
|
| 40 |
-
|
|
|
|
| 41 |
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
| ๊ธฐ์ค์ (Chimera 4B) | 42.9% | โ |
|
| 45 |
-
| **Darwin-4B-Chimera (๋ณธ ๋ชจ๋ธ)** | **48.3%** | **+5.4%p** |
|
| 46 |
|
| 47 |
-
|
|
|
|
| 48 |
|
| 49 |
---
|
| 50 |
|
| 51 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
|
| 53 |
-
|
| 54 |
|
| 55 |
-
|
| 56 |
-
- **KMMLU 6๊ณผ๋ชฉ ํ์ ** ์์น์ด๋ฉฐ, ์ ๋๋ฉ์ธ ์ผ๋ฐํ๋ฅผ ๋ปํ์ง ์์ต๋๋ค.
|
| 57 |
-
- **4B ๊ท๋ชจ** ๋ชจ๋ธ์
๋๋ค. ํ๋๊ทธ์ญ(Darwin-398B ๋ฑ)๊ณผ ์ง์ ๋น๊ต ๋์์ด ์๋๋๋ค.
|
| 58 |
-
- **greedy ๋์ฝ๋ฉ** ๊ธฐ์ค์
๋๋ค. ๋์ฝ๋ฉยทํ๋กฌํํธ๊ฐ ๋ฐ๋๋ฉด ๊ฒฐ๊ณผ๊ฐ ๋ฌ๋ผ์ง ์ ์์ต๋๋ค.
|
| 59 |
|
| 60 |
---
|
| 61 |
|
| 62 |
-
##
|
| 63 |
|
| 64 |
```python
|
| 65 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
@@ -76,22 +79,22 @@ print(tok.decode(out[0][ids.shape[-1]:], skip_special_tokens=True))
|
|
| 76 |
|
| 77 |
---
|
| 78 |
|
| 79 |
-
##
|
| 80 |
|
| 81 |
-
|
| 82 |
|
| 83 |
-
|
| 84 |
|
| 85 |
-
|
| 86 |
|
| 87 |
---
|
| 88 |
|
| 89 |
-
##
|
| 90 |
|
| 91 |
-
- **Darwin
|
| 92 |
-
- **
|
| 93 |
-
- **
|
| 94 |
|
| 95 |
-
##
|
| 96 |
|
| 97 |
-
`gemma` โ
|
|
|
|
| 1 |
---
|
| 2 |
license: gemma
|
|
|
|
| 3 |
tags:
|
| 4 |
- chimera
|
| 5 |
- darwin
|
|
|
|
| 16 |
|
| 17 |
# Darwin-4B-Chimera
|
| 18 |
|
| 19 |
+
**A 4B Korean-reasoning model built with VIDRAFT's Chimera technology.**
|
| 20 |
|
| 21 |
+
Most models get better by getting bigger. This one got better by **combining** โ and then refining itself.
|
| 22 |
|
| 23 |
---
|
| 24 |
|
| 25 |
+
## Why Chimera matters
|
| 26 |
|
| 27 |
+
Merging models usually means losing something. Average two networks and you get a compromise: each parent's edge is blunted, and the child is worse than both at what each did best. That is why "model merging" has a reputation as a cheap trick.
|
| 28 |
|
| 29 |
+
Chimera is built on the opposite premise.
|
|
|
|
|
|
|
| 30 |
|
| 31 |
+
### 1. The parents survive intact
|
| 32 |
+
Chimera fuses components from models of **different families and different strengths** while preserving what each parent knew. Knowledge is carried over, not averaged away. What you merge in is what you keep.
|
| 33 |
|
| 34 |
+
### 2. The result cannot be reduced to any single parent
|
| 35 |
+
A Chimera individual is not "model A with a bit of B." It sits at a point in model space that **no parent reaches alone**, and it cannot be recovered from any one of them. That non-reducibility is the entire point โ it is what makes a lineage an asset rather than a re-skin.
|
|
|
|
| 36 |
|
| 37 |
+
### 3. No additional pretraining
|
| 38 |
+
A new generation is a **fusion plus an evaluation**, not a training run measured in GPU-months. Iteration collapses from months to days โ which means the space of viable combinations actually gets explored instead of theorized about.
|
| 39 |
|
| 40 |
+
### 4. It compounds
|
| 41 |
+
Chimera individuals become parents. Strengths accumulate across generations: parent โ child โ grandchild. Capability is **grown**, not purchased.
|
|
|
|
|
|
|
| 42 |
|
| 43 |
+
### 5. It answers the real constraint
|
| 44 |
+
Frontier capability is gated by capital: tens of thousands of GPUs, months of training, hundreds of millions of dollars. Chimera attacks that gate directly โ **structural evolution instead of brute-force scale**. It is how a small team competes on method rather than on budget.
|
| 45 |
|
| 46 |
---
|
| 47 |
|
| 48 |
+
## What that buys you at 4B
|
| 49 |
+
|
| 50 |
+
This model is a late-generation Chimera individual, refined further by VIDRAFT's own reinforcement fine-tuning pipeline.
|
| 51 |
+
|
| 52 |
+
**KMMLU ยท 6 subjects ยท 240 held-out items ยท greedy decoding**
|
| 53 |
+
|
| 54 |
+
| Model | KMMLU | ฮ |
|
| 55 |
+
|---|---|---|
|
| 56 |
+
| Chimera 4B baseline | 42.9% | โ |
|
| 57 |
+
| **Darwin-4B-Chimera** | **48.3%** | **+5.4pp** |
|
| 58 |
|
| 59 |
+
**+5.4pp on Korean knowledge reasoning with zero parameter growth** โ 4.02B before, 4.02B after. The gain came from what the model learned from itself, not from more weights. Same architecture, same size, same inference cost: strictly better.
|
| 60 |
|
| 61 |
+
That matters because 4B is the size that actually ships. It runs on a single consumer GPU, on-premise, inside an air-gapped network โ the places where frontier APIs cannot go.
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
---
|
| 64 |
|
| 65 |
+
## Usage
|
| 66 |
|
| 67 |
```python
|
| 68 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
|
| 79 |
|
| 80 |
---
|
| 81 |
|
| 82 |
+
## What is open, and what is not
|
| 83 |
|
| 84 |
+
The **weights are open** and the **numbers are stated with the exact evaluation setup**, so anyone can reproduce the result above rather than take our word for it.
|
| 85 |
|
| 86 |
+
The internal design of Chimera fusion and of the refinement pipeline โ component selection, data selection criteria, training configuration, routing โ is **VIDRAFT proprietary**.
|
| 87 |
|
| 88 |
+
> **Results are open. The recipe is not.**
|
| 89 |
|
| 90 |
---
|
| 91 |
|
| 92 |
+
## Links
|
| 93 |
|
| 94 |
+
- **Darwin family** โ https://huggingface.co/collections/FINAL-Bench/darwin-family
|
| 95 |
+
- **Method paper (evolutionary merging)** โ arXiv [2605.14386](https://arxiv.org/abs/2605.14386)
|
| 96 |
+
- **VIDRAFT** โ https://vidraft.net
|
| 97 |
|
| 98 |
+
## License
|
| 99 |
|
| 100 |
+
`gemma` โ the Chimera lineage includes Gemma-derived components, so the Gemma license applies. Review the [Gemma Terms of Use](https://ai.google.dev/gemma/terms) before use.
|