lyffseba commited on
Commit
cfcb442
·
verified ·
1 Parent(s): 094778b

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. CONTRIBUTING.md +39 -0
  2. LICENSE +21 -0
  3. README.md +50 -15
CONTRIBUTING.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Contributing to Dexter
2
+
3
+ First off, thank you for considering contributing to Dexter! It's people like you that make Dexter such a great ecosystem for tinkering and fine-tuning Large Language Models.
4
+
5
+ ## 🤝 How to Contribute
6
+
7
+ ### 1. Code of Conduct
8
+ By participating in this project, you are expected to uphold our standard community guidelines. Be respectful, inclusive, and collaborative.
9
+
10
+ ### 2. Issues & Bug Reports
11
+ - Check if the issue already exists.
12
+ - If it doesn't, create a new issue.
13
+ - Clearly describe the bug: what happened, what you expected to happen, and how to reproduce it.
14
+
15
+ ### 3. Submitting Pull Requests
16
+ 1. Fork the repository and create your branch from `main`.
17
+ 2. If you've added code that should be tested, add tests.
18
+ 3. If you've changed APIs or added new Labs, update the documentation in `labs/docs/`.
19
+ 4. Ensure the test suite passes.
20
+ 5. Make sure your code lints.
21
+ 6. Issue that pull request!
22
+
23
+ ## 🔬 Adding New Labs
24
+ If you want to contribute a new interactive notebook or AI research loop:
25
+ 1. Place it inside the `labs/` directory.
26
+ 2. Ensure it is **100% self-contained** (use `uv` or `pixi` for dependencies, avoid polluting global environments).
27
+ 3. Create a dedicated `README.md` for it inside `labs/docs/<lab_name>/`.
28
+ 4. Update the root `README.md` to link to your new lab.
29
+
30
+ ## 🚀 Environment Standards
31
+ We strictly use:
32
+ - **[uv](https://docs.astral.sh/uv/)** for lightning-fast Python package management.
33
+ - **[Pixi](https://pixi.sh/)** for managing native dependencies and the **Mojo 🔥** compiler.
34
+ - **MAX** for inference deployment.
35
+
36
+ Please do not introduce `requirements.txt` or standard `pip` workflows into new labs. Stick to the modern ecosystem!
37
+
38
+ ---
39
+ *Happy Tinkering!*
LICENSE ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) 2026 lyffseba
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
README.md CHANGED
@@ -1,24 +1,52 @@
1
- # Dexter 🚀
2
 
3
- This repository contains everything needed to spin up, run, and fine-tune Large Language Models (like `google/gemma-4-31B`) on cheap, high-performance cloud GPUs.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
 
5
  ## 🌟 The Best Platform: Modular Cloud
6
 
7
- For cost-to-performance, **Modular Cloud** is currently the best platform. They have the fastest inference speeds for Gemma 4 using MAX, their GenAI native modeling & serving framework, completely outperforming vLLM on both NVIDIA and AMD platforms.
 
 
 
8
 
9
  ---
10
 
11
  ## 🛠️ Getting Started on Modular Cloud
12
 
13
  ### 1. Account Setup
14
- 1. Go to [Modular Console](https://console.modular.com) and sign up.
15
- 2. Modular Cloud gives you a straight line from first API call to production endpoint.
16
-
17
- ---
18
 
19
- ## 🚀 Running Gemma-4-31B (Inference)
20
 
21
- Inside your environment, install the Modular CLI and MAX:
22
 
23
  ```bash
24
  bash scripts/01_setup_inference.sh
@@ -30,14 +58,21 @@ Then start the MAX engine server:
30
  bash scripts/02_start_server.sh
31
  ```
32
 
33
- Now you can interact with the model via Python or using a UI!
34
 
35
  ---
36
 
37
  ## 🔬 Tinkering & Fine-Tuning Labs
38
 
39
- Check the `labs/` directory for Jupyter Notebooks designed to let you play with the model.
40
- - **[START HERE]** `labs/00_getting_started.ipynb`: An interactive, local introduction to AI data, tokenizers, and compiling Mojo. Start here to learn the fundamentals!
41
- - `labs/01_inference_test.ipynb`: Test prompting and generating text.
42
- - `labs/02_qlora_finetuning.ipynb`: Learn how to fine-tune Gemma-4-31B on your own custom data using LoRA.
43
- - `labs/autoresearch/`: An autonomous AI agent loop that tweaks LLM architectures. Includes the ongoing project to port the framework to **Mojo & MAX**.
 
 
 
 
 
 
 
 
1
+ <div align="center">
2
 
3
+ # 🚀 Dexter
4
+
5
+ **The Ultimate Ecosystem to Spin Up, Run, and Fine-Tune Large Language Models**
6
+
7
+ [![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model_Repo-ffcc66.svg?style=for-the-badge)](https://huggingface.co/lyffseba/dexter)
8
+ [![Modular MAX](https://img.shields.io/badge/Powered_by-Modular_MAX-007FFF.svg?style=for-the-badge)](https://docs.modular.com/max/)
9
+ [![Mojo](https://img.shields.io/badge/Language-Mojo_%F0%9F%94%A5-FF4500.svg?style=for-the-badge)](https://docs.modular.com/mojo/)
10
+ [![Python](https://img.shields.io/badge/Language-Python-3776AB.svg?style=for-the-badge&logo=python&logoColor=white)](https://python.org)
11
+
12
+ </div>
13
+
14
+ ---
15
+
16
+ > [!IMPORTANT]
17
+ > **Dexter** provides a straight line from your first API call to autonomous AI research loops and production endpoints. Designed for `Gemma-4-31B` and optimized for cheap, high-performance cloud GPUs.
18
+
19
+ ## 🗂️ Ecosystem Structure
20
+
21
+ ```text
22
+ dexter/
23
+ ├── scripts/ # Deployment scripts for Inference (Modular MAX)
24
+ └── labs/ # Interactive Tinkering & Fine-Tuning Labs
25
+ ├── docs/ # 📖 Dedicated documentation per lab
26
+ ├── 00_getting_started.ipynb # 🟢 START HERE: Data, Tokenizers & Mojo setup
27
+ ├── 01_inference_test.ipynb # 💬 API Prompting & Generation
28
+ ├── 02_qlora_finetuning.ipynb # 🧠 QLoRA fine-tuning 31B models
29
+ └── autoresearch/ # 🤖 Autonomous AI Agent Research Loop (PyTorch -> Mojo port)
30
+ ```
31
 
32
  ## 🌟 The Best Platform: Modular Cloud
33
 
34
+ For cost-to-performance, **[Modular Cloud](https://console.modular.com)** is currently the best platform. They have the fastest inference speeds for `Gemma-4` using **MAX**, their GenAI native modeling & serving framework, completely outperforming vLLM on both NVIDIA and AMD platforms.
35
+
36
+ > [!TIP]
37
+ > While Modular Cloud is ideal for inference and deployment, **RunPod** (RTX 3090/4090) remains the best value for bare-metal SSH access required for the autonomous PyTorch training labs.
38
 
39
  ---
40
 
41
  ## 🛠️ Getting Started on Modular Cloud
42
 
43
  ### 1. Account Setup
44
+ 1. Go to the [Modular Console](https://console.modular.com) and sign up.
45
+ 2. Modular Cloud gives you a straight line from the first API call to a production endpoint.
 
 
46
 
47
+ ### 2. Running Gemma-4-31B (Inference)
48
 
49
+ Inside your cloud environment, install the Modular CLI and MAX framework:
50
 
51
  ```bash
52
  bash scripts/01_setup_inference.sh
 
58
  bash scripts/02_start_server.sh
59
  ```
60
 
61
+ Now you can interact with the model via Python or using any OpenAI-compatible UI!
62
 
63
  ---
64
 
65
  ## 🔬 Tinkering & Fine-Tuning Labs
66
 
67
+ Check the `labs/` directory for Jupyter Notebooks designed to let you play with the model locally and in the cloud.
68
+
69
+ - **[START HERE]** [`labs/00_getting_started.ipynb`](labs/00_getting_started.ipynb): An interactive, local introduction to AI data, tokenizers, and compiling Mojo. Start here to learn the fundamentals!
70
+ - [`labs/01_inference_test.ipynb`](labs/01_inference_test.ipynb): Test prompting and generating text against your MAX endpoint.
71
+ - [`labs/02_qlora_finetuning.ipynb`](labs/02_qlora_finetuning.ipynb): Learn how to fine-tune `Gemma-4-31B` on your own custom data using LoRA.
72
+ - [`labs/autoresearch/`](labs/autoresearch/): An autonomous AI agent loop that tweaks LLM architectures. Includes the ongoing project to port the framework from PyTorch to **Mojo 🔥 & MAX**.
73
+
74
+ ---
75
+
76
+ <div align="center">
77
+ <i>Built with ❤️ by lyffseba and the autonomous swarm</i>
78
+ </div>