---
language:
- pt
license: mit
pipeline_tag: text-generation
tags:
- transformer
- pytorch
- portuguese
- clash-royale
- chatbot
- question-answering
- educational
---

# ClashAI-300k

**ClashAI-300k** is a lightweight Transformer language model with approximately **300,000 parameters**, designed to answer questions about **Clash Royale** in Portuguese.

This project was created as an educational experiment to demonstrate how a small language model can be trained from scratch using PyTorch, a custom tokenizer, and a handcrafted dataset.

## Features

- 🧠 Approximately **300K parameters**
- 🇧🇷 Portuguese language
- 🎮 Specialized in Clash Royale
- ⚡ Lightweight and fast inference
- 🔤 Custom BPE tokenizer
- 🔥 Built entirely with PyTorch
- 📚 Trained from scratch (no pretrained weights)

## Intended Use

ClashAI-300k is intended for:

- Answering Clash Royale questions
- Educational purposes
- Learning how Transformer models work
- Small AI experiments
- Running on low-end hardware

It is **not** intended to replace large language models or provide general-purpose knowledge.

## Model Details

| Property | Value |
|----------|-------|
| Model | Transformer Decoder |
| Parameters | ~300,000 |
| Framework | PyTorch |
| Tokenizer | Custom Byte Pair Encoding (BPE) |
| Language | Portuguese |
| Domain | Clash Royale |

## Training

The model was trained from scratch using a manually curated dataset containing hundreds of Clash Royale question-answer pairs.

Training includes:

- Custom tokenizer training
- Sequence-to-sequence language modeling
- Cross-entropy loss optimization
- Autoregressive text generation

## Example

**Input**

```
Como conseguir ouro?
```

**Output**

```
Você pode conseguir ouro vencendo batalhas, abrindo baús, participando de eventos e doando cartas ao clã.
```

---

**Input**

```
Como derrotar um Corredor?
```

**Output**

```
Use construções defensivas para desviar o Corredor e tropas de alto dano para eliminá-lo rapidamente.
```

## Limitations

ClashAI-300k is intentionally small.

Some limitations include:

- Limited world knowledge
- Specialized only in Clash Royale
- May generate incorrect or repetitive responses
- Performs best on questions similar to its training data

## Future Improvements

Planned improvements include:

- Larger training dataset
- Better sampling strategies
- Larger context window
- Improved architecture
- More gameplay knowledge
- Better generalization

## Disclaimer

This is an independent educational project.

Clash Royale is a trademark of Supercell. This project is not affiliated with, endorsed by, or sponsored by Supercell.

## License

MIT License