Upload folder using huggingface_hub
Browse files- CONTRIBUTING.md +39 -0
- LICENSE +21 -0
- README.md +50 -15
CONTRIBUTING.md
ADDED
|
@@ -0,0 +1,39 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Contributing to Dexter
|
| 2 |
+
|
| 3 |
+
First off, thank you for considering contributing to Dexter! It's people like you that make Dexter such a great ecosystem for tinkering and fine-tuning Large Language Models.
|
| 4 |
+
|
| 5 |
+
## 🤝 How to Contribute
|
| 6 |
+
|
| 7 |
+
### 1. Code of Conduct
|
| 8 |
+
By participating in this project, you are expected to uphold our standard community guidelines. Be respectful, inclusive, and collaborative.
|
| 9 |
+
|
| 10 |
+
### 2. Issues & Bug Reports
|
| 11 |
+
- Check if the issue already exists.
|
| 12 |
+
- If it doesn't, create a new issue.
|
| 13 |
+
- Clearly describe the bug: what happened, what you expected to happen, and how to reproduce it.
|
| 14 |
+
|
| 15 |
+
### 3. Submitting Pull Requests
|
| 16 |
+
1. Fork the repository and create your branch from `main`.
|
| 17 |
+
2. If you've added code that should be tested, add tests.
|
| 18 |
+
3. If you've changed APIs or added new Labs, update the documentation in `labs/docs/`.
|
| 19 |
+
4. Ensure the test suite passes.
|
| 20 |
+
5. Make sure your code lints.
|
| 21 |
+
6. Issue that pull request!
|
| 22 |
+
|
| 23 |
+
## 🔬 Adding New Labs
|
| 24 |
+
If you want to contribute a new interactive notebook or AI research loop:
|
| 25 |
+
1. Place it inside the `labs/` directory.
|
| 26 |
+
2. Ensure it is **100% self-contained** (use `uv` or `pixi` for dependencies, avoid polluting global environments).
|
| 27 |
+
3. Create a dedicated `README.md` for it inside `labs/docs/<lab_name>/`.
|
| 28 |
+
4. Update the root `README.md` to link to your new lab.
|
| 29 |
+
|
| 30 |
+
## 🚀 Environment Standards
|
| 31 |
+
We strictly use:
|
| 32 |
+
- **[uv](https://docs.astral.sh/uv/)** for lightning-fast Python package management.
|
| 33 |
+
- **[Pixi](https://pixi.sh/)** for managing native dependencies and the **Mojo 🔥** compiler.
|
| 34 |
+
- **MAX** for inference deployment.
|
| 35 |
+
|
| 36 |
+
Please do not introduce `requirements.txt` or standard `pip` workflows into new labs. Stick to the modern ecosystem!
|
| 37 |
+
|
| 38 |
+
---
|
| 39 |
+
*Happy Tinkering!*
|
LICENSE
ADDED
|
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
MIT License
|
| 2 |
+
|
| 3 |
+
Copyright (c) 2026 lyffseba
|
| 4 |
+
|
| 5 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
| 6 |
+
of this software and associated documentation files (the "Software"), to deal
|
| 7 |
+
in the Software without restriction, including without limitation the rights
|
| 8 |
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
| 9 |
+
copies of the Software, and to permit persons to whom the Software is
|
| 10 |
+
furnished to do so, subject to the following conditions:
|
| 11 |
+
|
| 12 |
+
The above copyright notice and this permission notice shall be included in all
|
| 13 |
+
copies or substantial portions of the Software.
|
| 14 |
+
|
| 15 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
| 16 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 17 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
| 18 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
| 19 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
| 20 |
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
| 21 |
+
SOFTWARE.
|
README.md
CHANGED
|
@@ -1,24 +1,52 @@
|
|
| 1 |
-
|
| 2 |
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
|
| 5 |
## 🌟 The Best Platform: Modular Cloud
|
| 6 |
|
| 7 |
-
For cost-to-performance, **Modular Cloud** is currently the best platform. They have the fastest inference speeds for Gemma
|
|
|
|
|
|
|
|
|
|
| 8 |
|
| 9 |
---
|
| 10 |
|
| 11 |
## 🛠️ Getting Started on Modular Cloud
|
| 12 |
|
| 13 |
### 1. Account Setup
|
| 14 |
-
1. Go to [Modular Console](https://console.modular.com) and sign up.
|
| 15 |
-
2. Modular Cloud gives you a straight line from first API call to production endpoint.
|
| 16 |
-
|
| 17 |
-
---
|
| 18 |
|
| 19 |
-
##
|
| 20 |
|
| 21 |
-
Inside your environment, install the Modular CLI and MAX:
|
| 22 |
|
| 23 |
```bash
|
| 24 |
bash scripts/01_setup_inference.sh
|
|
@@ -30,14 +58,21 @@ Then start the MAX engine server:
|
|
| 30 |
bash scripts/02_start_server.sh
|
| 31 |
```
|
| 32 |
|
| 33 |
-
Now you can interact with the model via Python or using
|
| 34 |
|
| 35 |
---
|
| 36 |
|
| 37 |
## 🔬 Tinkering & Fine-Tuning Labs
|
| 38 |
|
| 39 |
-
Check the `labs/` directory for Jupyter Notebooks designed to let you play with the model.
|
| 40 |
-
|
| 41 |
-
- `labs/
|
| 42 |
-
- `labs/
|
| 43 |
-
- `labs/
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
<div align="center">
|
| 2 |
|
| 3 |
+
# 🚀 Dexter
|
| 4 |
+
|
| 5 |
+
**The Ultimate Ecosystem to Spin Up, Run, and Fine-Tune Large Language Models**
|
| 6 |
+
|
| 7 |
+
[](https://huggingface.co/lyffseba/dexter)
|
| 8 |
+
[](https://docs.modular.com/max/)
|
| 9 |
+
[](https://docs.modular.com/mojo/)
|
| 10 |
+
[](https://python.org)
|
| 11 |
+
|
| 12 |
+
</div>
|
| 13 |
+
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
> [!IMPORTANT]
|
| 17 |
+
> **Dexter** provides a straight line from your first API call to autonomous AI research loops and production endpoints. Designed for `Gemma-4-31B` and optimized for cheap, high-performance cloud GPUs.
|
| 18 |
+
|
| 19 |
+
## 🗂️ Ecosystem Structure
|
| 20 |
+
|
| 21 |
+
```text
|
| 22 |
+
dexter/
|
| 23 |
+
├── scripts/ # Deployment scripts for Inference (Modular MAX)
|
| 24 |
+
└── labs/ # Interactive Tinkering & Fine-Tuning Labs
|
| 25 |
+
├── docs/ # 📖 Dedicated documentation per lab
|
| 26 |
+
├── 00_getting_started.ipynb # 🟢 START HERE: Data, Tokenizers & Mojo setup
|
| 27 |
+
├── 01_inference_test.ipynb # 💬 API Prompting & Generation
|
| 28 |
+
├── 02_qlora_finetuning.ipynb # 🧠 QLoRA fine-tuning 31B models
|
| 29 |
+
└── autoresearch/ # 🤖 Autonomous AI Agent Research Loop (PyTorch -> Mojo port)
|
| 30 |
+
```
|
| 31 |
|
| 32 |
## 🌟 The Best Platform: Modular Cloud
|
| 33 |
|
| 34 |
+
For cost-to-performance, **[Modular Cloud](https://console.modular.com)** is currently the best platform. They have the fastest inference speeds for `Gemma-4` using **MAX**, their GenAI native modeling & serving framework, completely outperforming vLLM on both NVIDIA and AMD platforms.
|
| 35 |
+
|
| 36 |
+
> [!TIP]
|
| 37 |
+
> While Modular Cloud is ideal for inference and deployment, **RunPod** (RTX 3090/4090) remains the best value for bare-metal SSH access required for the autonomous PyTorch training labs.
|
| 38 |
|
| 39 |
---
|
| 40 |
|
| 41 |
## 🛠️ Getting Started on Modular Cloud
|
| 42 |
|
| 43 |
### 1. Account Setup
|
| 44 |
+
1. Go to the [Modular Console](https://console.modular.com) and sign up.
|
| 45 |
+
2. Modular Cloud gives you a straight line from the first API call to a production endpoint.
|
|
|
|
|
|
|
| 46 |
|
| 47 |
+
### 2. Running Gemma-4-31B (Inference)
|
| 48 |
|
| 49 |
+
Inside your cloud environment, install the Modular CLI and MAX framework:
|
| 50 |
|
| 51 |
```bash
|
| 52 |
bash scripts/01_setup_inference.sh
|
|
|
|
| 58 |
bash scripts/02_start_server.sh
|
| 59 |
```
|
| 60 |
|
| 61 |
+
Now you can interact with the model via Python or using any OpenAI-compatible UI!
|
| 62 |
|
| 63 |
---
|
| 64 |
|
| 65 |
## 🔬 Tinkering & Fine-Tuning Labs
|
| 66 |
|
| 67 |
+
Check the `labs/` directory for Jupyter Notebooks designed to let you play with the model locally and in the cloud.
|
| 68 |
+
|
| 69 |
+
- **[START HERE]** [`labs/00_getting_started.ipynb`](labs/00_getting_started.ipynb): An interactive, local introduction to AI data, tokenizers, and compiling Mojo. Start here to learn the fundamentals!
|
| 70 |
+
- [`labs/01_inference_test.ipynb`](labs/01_inference_test.ipynb): Test prompting and generating text against your MAX endpoint.
|
| 71 |
+
- [`labs/02_qlora_finetuning.ipynb`](labs/02_qlora_finetuning.ipynb): Learn how to fine-tune `Gemma-4-31B` on your own custom data using LoRA.
|
| 72 |
+
- [`labs/autoresearch/`](labs/autoresearch/): An autonomous AI agent loop that tweaks LLM architectures. Includes the ongoing project to port the framework from PyTorch to **Mojo 🔥 & MAX**.
|
| 73 |
+
|
| 74 |
+
---
|
| 75 |
+
|
| 76 |
+
<div align="center">
|
| 77 |
+
<i>Built with ❤️ by lyffseba and the autonomous swarm</i>
|
| 78 |
+
</div>
|