KobunFormer5-1-8B - GGUF

This model is a specialized fine-tune of the Qwen3 8B parameter model, converted to GGUF format using Unsloth. It is expertly trained to translate modern text (across various languages) into Classical Japanese (Kanbun-Kundoku style).

Model Architecture & Reasoning

KobunFormer5-1-8B employs a unique two-step reasoning approach to ensure high grammatical accuracy and appropriate historical nuances across multiple languages (Tested with Turkish at the moment). It utilizes a thought block to map the linguistic structure before generating the final text:

1. Pure Kanbun Generation: The model first processes the input and translates the semantic meaning into pure Kanbun, placing this inside a <think> ... </think> reasoning block.
2. Kundoku Output: It then bases its final Classical Japanese (Kobun) output directly on the Kanbun structure it just generated.

**Example Prompt & Output:**
**System Prompt:** `You are an expert translator specializing in converting texts into Classical Japanese Kanbun-Kundoku style`
**User Input:** `通義千問 çok güzel bir modeldir`
**Model Response:** ```text
<think>通義千問善模型也。</think>
通義千問こそ善き模型なれ。

Recommended Inference Settings

To get the most accurate structural generation and prevent the model from deviating from its Kanbun-to-Kobun pipeline, the following sampling parameters are highly recommended:

• Temperature: 0.7
• Top-P: 0.8
• Top-K: 20

Available Model Files

• qwen3-8b.Q8_0.gguf (8.71 GB - Q8_0 Quantization)

Example Usage

Using llama.cpp via CLI:

llama-cli -m qwen3-8b.Q8_0.gguf  --system-prompt "You are an expert translator specializing in converting texts into Classical Japanese Kanbun-Kundoku style" -p "通義千問 çok güzel bir modeldir" --temp 0.7 --top-p 0.8 --top-k 20

(Tested on OSX)

Personal Notes

Please note that this was an experimental model.

The model when I last tested was highly unstable (especially on rules like Kakari Musubi, which is hard to get from a Kanbun-> Kobun workflow because there is no standard way of Kakari Musubi in Kanbun Kundoku and its existence depends on the author), but when it answered correctly, it answered really well.