Text Generation
PEFT
Safetensors
English
lora
control-theory
regularization
information-theory
llama
adapter
Instructions to use hunterbown/shannon-control-unit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use hunterbown/shannon-control-unit with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.2-1B") model = PeftModel.from_pretrained(base_model, "hunterbown/shannon-control-unit") - Notebooks
- Google Colab
- Kaggle
docs: publish clean model card (validation + control telemetry)
Browse files
README.md
CHANGED
|
@@ -71,10 +71,10 @@ Set your target information ratio \( S^* \), and our PI controller automatically
|
|
| 71 |
<summary><b>Training curves (details)</b></summary>
|
| 72 |
|
| 73 |
**DataBPT (bits/token)**
|
| 74 |
-
**
|
| 77 |
-
</b></summary>
|
| 72 |
|
| 73 |
**DataBPT (bits/token)**
|
| 74 |
+

|
| 75 |
|
| 76 |
**ParamBPT (bits/token)**
|
| 77 |
+

|
| 78 |
|
| 79 |
</details>
|
| 80 |
|