Text Generation
Transformers
Safetensors
llama
sequential-fine-tuning
lora
text-generation-inference
Instructions to use jnjj/Vvbvv with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jnjj/Vvbvv with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="jnjj/Vvbvv")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("jnjj/Vvbvv") model = AutoModelForCausalLM.from_pretrained("jnjj/Vvbvv", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use jnjj/Vvbvv with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "jnjj/Vvbvv" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jnjj/Vvbvv", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/jnjj/Vvbvv
- SGLang
How to use jnjj/Vvbvv with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "jnjj/Vvbvv" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jnjj/Vvbvv", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "jnjj/Vvbvv" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jnjj/Vvbvv", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use jnjj/Vvbvv with Docker Model Runner:
docker model run hf.co/jnjj/Vvbvv
Commit History
-
Step 5: tokenizer.json
Verified signaturebc73c4f -
Step 5: tokenizer.model
Verified signatureee3e6e4 -
Step 5: special_tokens_map.json
Verified signaturebd9bc9d -
Step 5: tokenizer_config.json
Verified signatureb705bd7 -
Step 5: README.md
Verified signaturee738c60 -
Step 4: tokenizer.json
Verified signaturedafbb77 -
Step 4: tokenizer.model
Verified signature0f9c497 -
Step 4: special_tokens_map.json
Verified signature8a21665 -
Step 4: tokenizer_config.json
Verified signature866ea68 -
Step 4: README.md
Verified signature708ba35 -
Step 3: tokenizer.json
Verified signature8495c50 -
Step 3: tokenizer.model
Verified signature39d5fe9 -
Step 3: special_tokens_map.json
Verified signaturef861409 -
Step 3: tokenizer_config.json
Verified signaturee885147 -
Step 3: README.md
Verified signaturec41bece -
Step 2: tokenizer.json
Verified signature8d37bca -
Step 2: tokenizer.model
Verified signature13c69a9 -
Step 2: special_tokens_map.json
Verified signature8e1dfd7 -
Step 2: tokenizer_config.json
Verified signatureb8a5c71 -
Step 2: README.md
Verified signaturefa9cbce -
Step 1: tokenizer.json
Verified signatureaa307a7 -
Step 1: tokenizer.model
Verified signature8dfe625 -
Step 1: special_tokens_map.json
Verified signaturee9936fd -
Step 1: tokenizer_config.json
Verified signaturef3d0fd0 -
Step 1: README.md
Verified signature1c187aa