Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Instructions to use ninagroot/GPT2-705-RUN1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ninagroot/GPT2-705-RUN1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ninagroot/GPT2-705-RUN1")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("ninagroot/GPT2-705-RUN1") model = AutoModelForCausalLM.from_pretrained("ninagroot/GPT2-705-RUN1") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use ninagroot/GPT2-705-RUN1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ninagroot/GPT2-705-RUN1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ninagroot/GPT2-705-RUN1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/ninagroot/GPT2-705-RUN1
- SGLang
How to use ninagroot/GPT2-705-RUN1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ninagroot/GPT2-705-RUN1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ninagroot/GPT2-705-RUN1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ninagroot/GPT2-705-RUN1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ninagroot/GPT2-705-RUN1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use ninagroot/GPT2-705-RUN1 with Docker Model Runner:
docker model run hf.co/ninagroot/GPT2-705-RUN1
Ctrl+K
- Apr05_14-54-56_gcn33.local.snellius.surf.nl
- Apr05_15-32-40_gcn33.local.snellius.surf.nl
- Apr05_15-45-27_gcn47.local.snellius.surf.nl
- Apr10_10-38-32_gcn8.local.snellius.surf.nl
- Apr10_10-47-27_gcn10.local.snellius.surf.nl
- Apr16_10-05-32_gcn71.local.snellius.surf.nl
- Apr16_10-21-59_gcn17.local.snellius.surf.nl
- Apr16_10-38-55_gcn68.local.snellius.surf.nl
- Apr16_10-46-06_gcn42.local.snellius.surf.nl
- Apr16_10-53-17_gcn9.local.snellius.surf.nl
- Apr16_10-58-57_gcn18.local.snellius.surf.nl
- Apr16_11-04-43_gcn13.local.snellius.surf.nl
- Apr16_11-14-38_gcn12.local.snellius.surf.nl
- Apr16_11-18-42_gcn13.local.snellius.surf.nl
- Apr16_11-25-58_gcn42.local.snellius.surf.nl
- Apr16_11-35-27_gcn17.local.snellius.surf.nl
- Apr16_11-42-43_gcn13.local.snellius.surf.nl
- Apr16_11-48-21_gcn20.local.snellius.surf.nl
- Apr16_13-14-39_gcn15.local.snellius.surf.nl
- Apr16_13-22-59_gcn24.local.snellius.surf.nl
- Apr16_13-30-19_gcn40.local.snellius.surf.nl
- Apr16_13-36-06_gcn62.local.snellius.surf.nl
- Apr16_13-43-24_gcn71.local.snellius.surf.nl
- Apr16_13-55-28_gcn38.local.snellius.surf.nl
- Apr16_14-02-54_gcn17.local.snellius.surf.nl
- Apr16_14-32-37_gcn33.local.snellius.surf.nl
- Apr17_10-08-09_gcn48.local.snellius.surf.nl
- Apr17_11-21-17_gcn40.local.snellius.surf.nl
- Apr17_11-29-53_gcn72.local.snellius.surf.nl
- Apr17_11-41-39_gcn42.local.snellius.surf.nl
- Apr17_12-24-48_gcn61.local.snellius.surf.nl
- Apr17_14-09-48_gcn20.local.snellius.surf.nl
- Apr17_14-30-23_gcn10.local.snellius.surf.nl
- Apr17_14-39-08_gcn53.local.snellius.surf.nl
- Mar04_16-57-23_gcn16.local.snellius.surf.nl
- Mar05_10-14-27_gcn61.local.snellius.surf.nl
- Mar05_11-09-36_gcn33.local.snellius.surf.nl
- Mar06_13-40-06_gcn43.local.snellius.surf.nl
- Mar06_14-05-07_gcn52.local.snellius.surf.nl
- Mar13_13-31-39_gcn35.local.snellius.surf.nl
- Mar13_13-51-16_gcn32.local.snellius.surf.nl
- Mar13_14-07-00_gcn31.local.snellius.surf.nl
- Mar13_14-11-08_gcn31.local.snellius.surf.nl
- Mar13_14-17-38_gcn31.local.snellius.surf.nl
- Mar13_14-37-34_gcn7.local.snellius.surf.nl
- Mar13_15-17-34_gcn28.local.snellius.surf.nl
- Mar14_09-45-51_gcn38.local.snellius.surf.nl
- Mar14_09-58-55_gcn34.local.snellius.surf.nl
- Mar14_10-33-50_gcn22.local.snellius.surf.nl
- Mar14_10-55-12_gcn39.local.snellius.surf.nl