Miguelpef/3d-prompt
Viewer • Updated • 300 • 21
How to use Miguelpef/bart-base-lora-3DPrompt with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-generation", model="Miguelpef/bart-base-lora-3DPrompt") # Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("Miguelpef/bart-base-lora-3DPrompt")
model = AutoModelForSeq2SeqLM.from_pretrained("Miguelpef/bart-base-lora-3DPrompt")How to use Miguelpef/bart-base-lora-3DPrompt with vLLM:
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Miguelpef/bart-base-lora-3DPrompt"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "Miguelpef/bart-base-lora-3DPrompt",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'docker model run hf.co/Miguelpef/bart-base-lora-3DPrompt
How to use Miguelpef/bart-base-lora-3DPrompt with SGLang:
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
--model-path "Miguelpef/bart-base-lora-3DPrompt" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "Miguelpef/bart-base-lora-3DPrompt",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'docker run --gpus all \
--shm-size 32g \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<secret>" \
--ipc=host \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server \
--model-path "Miguelpef/bart-base-lora-3DPrompt" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "Miguelpef/bart-base-lora-3DPrompt",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'How to use Miguelpef/bart-base-lora-3DPrompt with Docker Model Runner:
docker model run hf.co/Miguelpef/bart-base-lora-3DPrompt
Spanish version
The model is still in the training phase. This is not the final version and may contain artifacts and perform poorly in some cases.
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
from peft import PeftModel, PeftConfig
# Define the repository ID
repo_id = "Miguelpef/bart-base-lora-3DPrompt"
# Load the PEFT configuration from the Hub
peft_config = PeftConfig.from_pretrained(repo_id)
# Load the base model from the Hub
model = AutoModelForSeq2SeqLM.from_pretrained(peft_config.base_model_name_or_path)
# Load the tokenizer from the Hub
tokenizer = AutoTokenizer.from_pretrained(repo_id)
# Wrap the base model with PEFT
model = PeftModel.from_pretrained(model, repo_id)
# Now you can use the model for inference as before
def generar_prompt_desde_objeto(objeto):
prompt = objeto
inputs = tokenizer(prompt, return_tensors='pt').to(model.device)
outputs = model.generate(**inputs, max_length=100)
prompt_generado = tokenizer.decode(outputs[0], skip_special_tokens=True)
return prompt_generado
mi_objeto = "Mesa grande marrón" #Change this object
prompt_generado = generar_prompt_desde_objeto(mi_objeto)
print({prompt_generado})
Base model
facebook/bart-base