Instructions to use aoxo/kevin-token-compressor with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use aoxo/kevin-token-compressor with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Meta-Llama-3.1-8B-bnb-4bit") model = PeftModel.from_pretrained(base_model, "aoxo/kevin-token-compressor") - Notebooks
- Google Colab
- Kaggle
Upload 3 files
Browse files- .gitattributes +1 -0
- stats1.jpg +0 -0
- stats2.jpg +3 -0
- stats3.jpg +0 -0
.gitattributes
CHANGED
|
@@ -1,2 +1,3 @@
|
|
| 1 |
adapter_model.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 2 |
optimizer.pt filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 1 |
adapter_model.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 2 |
optimizer.pt filter=lfs diff=lfs merge=lfs -text
|
| 3 |
+
stats2.jpg filter=lfs diff=lfs merge=lfs -text
|
stats1.jpg
ADDED
|
stats2.jpg
ADDED
|
Git LFS Details
|
stats3.jpg
ADDED
|