File size: 751 Bytes
44db50c 0b5d019 293ae03 44db50c 93f63e4 293ae03 44db50c 93f63e4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |
---
tags:
- pytorch
- transformer
- language-model
- turkish
- english
license: mit
---
# Mini Transformer Language Model
This is a small Transformer language model trained for demonstration purposes.
## Model Details
- **Model Type**: Transformer Decoder
- **Parameters**: ~6783K
- **Training**: Mini-batch training
- **Language**: English/Turkish mixed
- **Purpose**: Educational demonstration
## Usage
The model can be used for text generation and language modeling tasks. It's designed as a lightweight educational model.
## Training Data
Trained on a small subset of text data for quick demonstration.
## Limitations
This is a minimal model for educational purposes and may not perform well on complex tasks.
|