File size: 1,219 Bytes
8718b81 e5fcecc 54c1be5 e5fcecc 54c1be5 8718b81 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 |
---
license: mit
datasets:
- Adolfo-GM/AggmLite
language:
- en
---
# AggmGPT
AggmGPT is a lightweight foundational AI language model developed by **Adolfo GM**, designed to generate human-like text using n-gram models combined with self-attention mechanisms. The project is licensed under the **MIT License**, making it open-source and free for modification and distribution.
## Features
- Implements **Self-Attention** and **Multi-Head Attention** for improved context understanding.
- Includes **positional encoding** to retain sequence structure.
- Features a **Feed-Forward Neural Network** to refine predictions.
- Tokenization and embedding functions for handling input text.
## Installation
Ensure you have Python installed on your system. You can download it from the [official website](https://www.python.org/downloads/).
## How It Works
AggmGPT processes text through:
1. **Tokenization & Embedding**
2. **Positional Encoding**
3. **Self-Attention & Multi-Head Attention**
4. **Feed-Forward Network**
5. **N-gram Models**
## License
This project is licensed under the **MIT License**. See the `LICENSE` file for details.
## Author
Created by **Adolfo GM**.
 |