File size: 921 Bytes
bf1354e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 | ---
license: mit
language:
- en
---
<img src="banner.png" alt="AgGPT Banner" width="100%">
# AgGPT-13
## Heavy. Intelligent. Pro.
AgGPT-13 has been trained from the ground up to be a powerful and efficient language model, designed to handle a wide range of natural language processing tasks with ease. With its advanced architecture and cutting-edge training techniques, AgGPT-13 is capable of delivering high-quality results for applications such as text generation, summarization, translation, and more.
## Installation & Usage
```bash
pip install torch transformers safetensors
```
### Training
```bash
python train.py config/train_aggpt_char.py --device=cpu --compile=False --eval_iters=20 --log_interval=1 --block_size=64 --batch_size=16 --n_layer=10 --n_head=10 --n_embd=640 --max_iters=5000 --lr_decay_iters=2000 --dropout=0.2
```
### Testing
```bash
python sample.py --out_dir=out-aggpt --device=cpu
``` |