Text Generation
Transformers
Safetensors
PEFT
llama
causal-lm
text-generation-inference
4-bit precision
bitsandbytes
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("ubiodee/plutus_llm")
model = AutoModelForCausalLM.from_pretrained("ubiodee/plutus_llm")Quick Links
Fine-Tuned Llama-3-8B Model
This model is a fine-tuned version of NousResearch/Meta-Llama-3-8B using LoRA and 8-bit quantization.
Usage
To load the model:
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "ubiodee/Test_Plutus"
model = AutoModelForCausalLM.from_pretrained(model_name, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(model_name)
- Downloads last month
- 3
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ubiodee/plutus_llm")