Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Instructions to use ninagroot/GPT2-705-RUN1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ninagroot/GPT2-705-RUN1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ninagroot/GPT2-705-RUN1")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("ninagroot/GPT2-705-RUN1") model = AutoModelForCausalLM.from_pretrained("ninagroot/GPT2-705-RUN1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use ninagroot/GPT2-705-RUN1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ninagroot/GPT2-705-RUN1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ninagroot/GPT2-705-RUN1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/ninagroot/GPT2-705-RUN1
- SGLang
How to use ninagroot/GPT2-705-RUN1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ninagroot/GPT2-705-RUN1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ninagroot/GPT2-705-RUN1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ninagroot/GPT2-705-RUN1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ninagroot/GPT2-705-RUN1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use ninagroot/GPT2-705-RUN1 with Docker Model Runner:
docker model run hf.co/ninagroot/GPT2-705-RUN1
Ctrl+K
- Apr05_14-54-56_gcn33.local.snellius.surf.nl
- Apr05_15-32-40_gcn33.local.snellius.surf.nl
- Apr05_15-45-27_gcn47.local.snellius.surf.nl
- Apr10_10-38-32_gcn8.local.snellius.surf.nl
- Apr10_10-47-27_gcn10.local.snellius.surf.nl
- Apr16_10-05-32_gcn71.local.snellius.surf.nl
- Apr16_10-21-59_gcn17.local.snellius.surf.nl
- Mar04_16-57-23_gcn16.local.snellius.surf.nl
- Mar05_10-14-27_gcn61.local.snellius.surf.nl
- Mar05_11-09-36_gcn33.local.snellius.surf.nl
- Mar06_13-40-06_gcn43.local.snellius.surf.nl
- Mar06_14-05-07_gcn52.local.snellius.surf.nl
- Mar13_13-31-39_gcn35.local.snellius.surf.nl
- Mar13_13-51-16_gcn32.local.snellius.surf.nl
- Mar13_14-07-00_gcn31.local.snellius.surf.nl
- Mar13_14-11-08_gcn31.local.snellius.surf.nl
- Mar13_14-17-38_gcn31.local.snellius.surf.nl
- Mar13_14-37-34_gcn7.local.snellius.surf.nl
- Mar13_15-17-34_gcn28.local.snellius.surf.nl
- Mar14_09-45-51_gcn38.local.snellius.surf.nl
- Mar14_09-58-55_gcn34.local.snellius.surf.nl
- Mar14_10-33-50_gcn22.local.snellius.surf.nl
- Mar14_10-55-12_gcn39.local.snellius.surf.nl
- Mar14_11-09-29_gcn51.local.snellius.surf.nl
- Mar20_14-18-47_gcn20.local.snellius.surf.nl
- Mar20_14-24-36_gcn59.local.snellius.surf.nl
- Mar20_14-27-44_gcn33.local.snellius.surf.nl
- Mar20_16-04-43_gcn27.local.snellius.surf.nl
- Mar22_13-21-38_gcn31.local.snellius.surf.nl
- Mar25_10-44-37_gcn30.local.snellius.surf.nl
- Mar25_10-55-45_gcn23.local.snellius.surf.nl
- Mar25_11-01-21_gcn32.local.snellius.surf.nl