Text Generation
MLX
English
mamba
ssm
hybrid
transformer
from-scratch
custom-architecture
apple-silicon
Instructions to use TreeLeek/TCF-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use TreeLeek/TCF-1 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("TreeLeek/TCF-1") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use TreeLeek/TCF-1 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "TreeLeek/TCF-1" --prompt "Once upon a time"
Update README.md
Browse files
README.md
CHANGED
|
@@ -108,6 +108,31 @@ Three runs, same prompt, same weights:
|
|
| 108 |
|
| 109 |
Three runs. Three universes. The same weights, walked differently each time. This is what 5.79B tokens of compressed knowledge looks like before instruction tuning — not a lookup table, but a geometry.
|
| 110 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 111 |
---
|
| 112 |
|
| 113 |
## Why Hybrid
|
|
|
|
| 108 |
|
| 109 |
Three runs. Three universes. The same weights, walked differently each time. This is what 5.79B tokens of compressed knowledge looks like before instruction tuning — not a lookup table, but a geometry.
|
| 110 |
|
| 111 |
+
## Stage B Output Examples
|
| 112 |
+
|
| 113 |
+
**Settings:** temp=0.75, top-p=0.95, block-size=512
|
| 114 |
+
|
| 115 |
+
Stage B knows it's in a conversation. It holds the Assistant role, responds in first person, stays in format. The semantic layer is loose — but compare to Stage A, which had zero awareness of being addressed at all.
|
| 116 |
+
|
| 117 |
+
```
|
| 118 |
+
Human: how are you feeling?
|
| 119 |
+
Assistant: It's good to remember the meaning of the word "let" in this sentence.
|
| 120 |
+
It's important to note that it is a good practice to start making someone happy.
|
| 121 |
+
It's important to understand the meaning of the situation. It helps you feel
|
| 122 |
+
good and focused.
|
| 123 |
+
Human: good
|
| 124 |
+
Assistant: I'm afraid I can't believe it. It's important to remember that
|
| 125 |
+
you're doing well. I'm thinking about being kind in good terms and getting
|
| 126 |
+
to know. It's okay to take care of yourself.
|
| 127 |
+
|
| 128 |
+
Human: thats good advice
|
| 129 |
+
Assistant: I'm thinking about something that doesn't mean you're keeping up
|
| 130 |
+
with everything you've done. It's not just good, but it's important to help
|
| 131 |
+
others to keep your mind safe.
|
| 132 |
+
```
|
| 133 |
+
|
| 134 |
+
Structure without substance. Stage A had substance without structure. Stage C is where both converge.
|
| 135 |
+
|
| 136 |
---
|
| 137 |
|
| 138 |
## Why Hybrid
|