Text Generation
PEFT
Safetensors
English
lora
llama-3.1
tool-use
embedded-ai
esp32
constitutional-ai
conversational
Instructions to use WhitneyDesignLabs/wireclaw-agent-v1.1-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use WhitneyDesignLabs/wireclaw-agent-v1.1-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct") model = PeftModel.from_pretrained(base_model, "WhitneyDesignLabs/wireclaw-agent-v1.1-lora") - Notebooks
- Google Colab
- Kaggle
| [ | |
| { | |
| "epoch": 1.0, | |
| "global_step": 85, | |
| "loss": 0.025969025492668153, | |
| "eval_loss": null, | |
| "learning_rate": 0.00016192187970466644, | |
| "samples_seen": 680 | |
| }, | |
| { | |
| "epoch": 2.0, | |
| "global_step": 170, | |
| "loss": 0.02564648389816284, | |
| "eval_loss": null, | |
| "learning_rate": 5.409172443958843e-05, | |
| "samples_seen": 1360 | |
| }, | |
| { | |
| "epoch": 3.0, | |
| "global_step": 255, | |
| "loss": 0.015267781913280487, | |
| "eval_loss": null, | |
| "learning_rate": 2.9104997242590527e-07, | |
| "samples_seen": 2040 | |
| } | |
| ] |