---
library_name: transformers
license: mit
datasets:
- starhopp3r/TinyChat
language:
- en
---

# APT-GPT

APT-GPT (Auto-PreTrain-GPT) is a LM trained using [Auto-PreTrain](https://flamefox.gattodev.tech/i3/apt/index.html).

## What is Auto-PreTrain?
Auto-PreTrain is a tool like AutoTrain, but instead of fine-tuning a LM you pre-train a LM with ZERO code!

![image](https://cdn-uploads.huggingface.co/production/uploads/6615494716917dfdc645c44e/NXCxEDJQ8kJKnqGbYp2vU.png)