Instructions to use MustEr/vgg_official with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use MustEr/vgg_official with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="MustEr/vgg_official")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("MustEr/vgg_official") model = AutoModelForCausalLM.from_pretrained("MustEr/vgg_official") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use MustEr/vgg_official with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "MustEr/vgg_official" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "MustEr/vgg_official", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/MustEr/vgg_official
- SGLang
How to use MustEr/vgg_official with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "MustEr/vgg_official" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "MustEr/vgg_official", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "MustEr/vgg_official" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "MustEr/vgg_official", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use MustEr/vgg_official with Docker Model Runner:
docker model run hf.co/MustEr/vgg_official
Commit History
fix model 98cedfd
Must Erhang commited on
TextGen f78ccea
Must Erhang commited on
TextGen 979a379
Must Erhang commited on
add configs tokenizer 1e33494
Must Erhang commited on
drop token e81d975
Must Erhang commited on
add config bc5afce
Must Erhang commited on
Merge branch 'main' of https://huggingface.co/MustEr/vgg_official efea7cf
Must Erhang commited on
transformer's model 8bfaf11
Must Erhang commited on
Update config.json e79f07c
Update config.json d5805c2
Update config.json 370f711
Create config.json ca2662c
Delete config.json 58f43c3
Update config.json 0a9f5f7
Create tokenizer_config.json 96515b9
Create tokenizer.json 033d05b
<calc> 5e19b1a
Must Erhang commited on
Create config.json c842f71
Update README.md 6e9dae8
Rename model.h5 to tf_model.h5 7e7e7b7
tensorflow model for your pleasure 2919185
Must Erhang commited on