GGUF
Japanese
conversational
How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf kishida/java-error-explainer-jp-cheerful-ministral3-3b:Q8_0
# Run inference directly in the terminal:
llama cli -hf kishida/java-error-explainer-jp-cheerful-ministral3-3b:Q8_0
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf kishida/java-error-explainer-jp-cheerful-ministral3-3b:Q8_0
# Run inference directly in the terminal:
llama cli -hf kishida/java-error-explainer-jp-cheerful-ministral3-3b:Q8_0
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf kishida/java-error-explainer-jp-cheerful-ministral3-3b:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf kishida/java-error-explainer-jp-cheerful-ministral3-3b:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf kishida/java-error-explainer-jp-cheerful-ministral3-3b:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf kishida/java-error-explainer-jp-cheerful-ministral3-3b:Q8_0
Use Docker
docker model run hf.co/kishida/java-error-explainer-jp-cheerful-ministral3-3b:Q8_0
Quick Links

Javaのコンパイルエラーを明るく解説します。
まだ壊れています。

from llama_cpp import Llama

# model load
base_model = "ministral3-3b"
quant = "Q8_0"
llm = Llama.from_pretrained(
    repo_id=f"kishida/java-error-explainer-jp-cheerful-{base_model}",
    filename=f"java-error-explainer-jp-cheerful-{base_model}.{quant}.gguf",
    seed=1234,
)

# streaming
def chat(msg):
    res = llm.create_chat_completion(
        messages=[
            {"role": "system", "content": "You are a Java compile error explainer."},
            {"role": "user", "content": msg},
        ],
        temperature=0.7,
    )
    return res["choices"][0]["message"]["content"]

source = """
void main() {
    IO.println(LocalDateTime.now());
    IO.println("Hello")
}
"""

error = """
HelloWithError.java:3: エラー: ';'がありません
    IO.println("Hello")
                       ^
エラー1個
"""

template = """
source:
{}

compile error:
{}
"""

print("source + error")
print(chat(template.format(source, error)))
"""
おっと、コードの行末にセミンカンのないからエラーになっちゃったね!Javaでは命令や文を終える時には「;」とせんせんなんか。この行のセミンは欠けてるから、コンパイダーさんが「;」って言ってるんだよ!行末にセニトンの付き忘れが大いな事!
"""

print("error only")
print(chat(error))
"""
おっと、コードの行末にセミンカンのないからエラーになっちゃったね!Javaでは命令や文を終える時には「;」とせんせんなんか。この行のセミンは欠けてるから、コンパイダーさんが「;」って言ってるんだよ!行末にセニトンの付き忘れが大いな事!
"""

# 壊れてる?
Downloads last month
-
GGUF
Model size
3B params
Architecture
mistral3
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kishida/java-error-explainer-jp-cheerful-ministral3-3b

Dataset used to train kishida/java-error-explainer-jp-cheerful-ministral3-3b