language:
- pt
license: mit
pipeline_tag: text-generation
tags:
- transformer
- pytorch
- portuguese
- clash-royale
- chatbot
- question-answering
- educational
ClashAI-300k
ClashAI-300k is a lightweight Transformer language model with approximately 300,000 parameters, designed to answer questions about Clash Royale in Portuguese.
This project was created as an educational experiment to demonstrate how a small language model can be trained from scratch using PyTorch, a custom tokenizer, and a handcrafted dataset.
Features
- 🧠 Approximately 300K parameters
- 🇧🇷 Portuguese language
- 🎮 Specialized in Clash Royale
- ⚡ Lightweight and fast inference
- 🔤 Custom BPE tokenizer
- 🔥 Built entirely with PyTorch
- 📚 Trained from scratch (no pretrained weights)
Intended Use
ClashAI-300k is intended for:
- Answering Clash Royale questions
- Educational purposes
- Learning how Transformer models work
- Small AI experiments
- Running on low-end hardware
It is not intended to replace large language models or provide general-purpose knowledge.
Model Details
| Property | Value |
|---|---|
| Model | Transformer Decoder |
| Parameters | ~300,000 |
| Framework | PyTorch |
| Tokenizer | Custom Byte Pair Encoding (BPE) |
| Language | Portuguese |
| Domain | Clash Royale |
Training
The model was trained from scratch using a manually curated dataset containing hundreds of Clash Royale question-answer pairs.
Training includes:
- Custom tokenizer training
- Sequence-to-sequence language modeling
- Cross-entropy loss optimization
- Autoregressive text generation
Example
Input
Como conseguir ouro?
Output
Você pode conseguir ouro vencendo batalhas, abrindo baús, participando de eventos e doando cartas ao clã.
Input
Como derrotar um Corredor?
Output
Use construções defensivas para desviar o Corredor e tropas de alto dano para eliminá-lo rapidamente.
Limitations
ClashAI-300k is intentionally small.
Some limitations include:
- Limited world knowledge
- Specialized only in Clash Royale
- May generate incorrect or repetitive responses
- Performs best on questions similar to its training data
Future Improvements
Planned improvements include:
- Larger training dataset
- Better sampling strategies
- Larger context window
- Improved architecture
- More gameplay knowledge
- Better generalization
Disclaimer
This is an independent educational project.
Clash Royale is a trademark of Supercell. This project is not affiliated with, endorsed by, or sponsored by Supercell.
License
MIT License