Text Generation
Transformers
Safetensors
English
llama
inference
text-generation-inference
4-bit precision
bitsandbytes
Hackping 2025 Model
This is a test model uploaded for Hackping 2025.
Usage
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("kaipybara/hackping-2025")
model = AutoModelForCausalLM.from_pretrained("kaipybara/hackping-2025")
input_text = "Hello, my name is"
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs)
print(tokenizer.decode(outputs[0]))
- Downloads last month
- 6
Model tree for kaipybara/hackping-2025
Base model
meta-llama/Llama-3.2-3B
Install from pip and serve model
# Install vLLM from pip: pip install vllm# Start the vLLM server: vllm serve "kaipybara/hackping-2025"# Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kaipybara/hackping-2025", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'