README.md

---
license: apache-2.0
tags:
- greek
- fine-tuned
- causal-lm
- qwen
- qwen2
base_model: teolm30/fox1.3
inference:
  parameters:
    temperature: 0.7
    max_new_tokens: 256
widget:
- text: "Τι είναι η τεχνητή νοημοσύνη;"
- text: "Πες μου για την Ελλάδα"
- text: "Γράψε ένα ποίημα για τον ήλιο"
model_type: qwen2
---

# Fox 1.4 High Reasoning

A Greek fine-tuned version of [Fox 1.3](https://huggingface.co/teolm30/fox1.3), a Qwen2.5-1B-Instruct based model.

## Training

- **Method**: QLoRA (4-bit quantization)
- **Dataset**: Custom Greek conversation dataset (20 conversations)
- **Epochs**: 3
- **Loss**: 3.26 → 0.79
- **Hardware**: NVIDIA RTX 3050 (6GB VRAM)
- **LoRA rank**: 8, alpha: 16

## Usage

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("teolm30/fox1.4-high-reasoning", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("teolm30/fox1.4-high-reasoning", trust_remote_code=True)

messages = [{"role": "user", "content": "Τι είναι η τεχνητή νοημοσύνη;"}]
input_ids = tokenizer.apply_chat_template(messages, return_tensors="pt")
output = model.generate(input_ids, max_new_tokens=256)
print(tokenizer.decode(output[0]))
```

## Greek Language Support

Fine-tuned for Greek language — grammar, vocabulary, natural conversation, and technical topics in Greek.

## Previous Versions

- [Fox 1.3](https://huggingface.co/teolm30/fox1.3) — base model
- [Fox 1.0](https://huggingface.co/teolm30/fox1) — original model

## 🤖 Run with Ollama

```bash
ollama run hf.co/teolm30/fox1.4-high-reasoning
```