Instructions to use EricWesthoff/phi-1_5-finetuned-SQL with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use EricWesthoff/phi-1_5-finetuned-SQL with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="EricWesthoff/phi-1_5-finetuned-SQL", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("EricWesthoff/phi-1_5-finetuned-SQL", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use EricWesthoff/phi-1_5-finetuned-SQL with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "EricWesthoff/phi-1_5-finetuned-SQL" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "EricWesthoff/phi-1_5-finetuned-SQL", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/EricWesthoff/phi-1_5-finetuned-SQL
- SGLang
How to use EricWesthoff/phi-1_5-finetuned-SQL with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "EricWesthoff/phi-1_5-finetuned-SQL" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "EricWesthoff/phi-1_5-finetuned-SQL", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "EricWesthoff/phi-1_5-finetuned-SQL" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "EricWesthoff/phi-1_5-finetuned-SQL", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use EricWesthoff/phi-1_5-finetuned-SQL with Docker Model Runner:
docker model run hf.co/EricWesthoff/phi-1_5-finetuned-SQL
Commit History
-
Training in progress, step 66700
9388d19 -
Training in progress, step 66600
505ae49 -
Training in progress, step 66500
2e8193e -
Training in progress, step 66400
3da6614 -
Training in progress, step 66300
329e118 -
Training in progress, step 66200
6bfe84b -
Training in progress, step 66100
3536193 -
Training in progress, step 66000
50eb3d2 -
Training in progress, step 65900
04fd0e6 -
Training in progress, step 65800
044e07e -
Training in progress, step 65700
d798374 -
Training in progress, step 65600
e46bb05 -
Training in progress, step 65500
2157e30 -
Training in progress, step 65400
edd1508 -
Training in progress, step 65300
d6299c3 -
Training in progress, step 65200
8ca485d -
Training in progress, step 65100
1109177 -
Training in progress, step 65000
2e83b6c -
Training in progress, step 64900
81ee738 -
Training in progress, step 64800
57abfb2 -
Training in progress, step 64700
0b6afea -
Training in progress, step 64600
e306867 -
Training in progress, step 64500
8033be2 -
Training in progress, step 64400
85e3178 -
Training in progress, step 64300
c174382 -
Training in progress, step 64200
d617df0 -
Training in progress, step 64100
756e9c8 -
Training in progress, step 64000
e8697e2 -
Training in progress, step 63900
5dd4d14 -
Training in progress, step 63800
1f4cbe1 -
Training in progress, step 63700
2f1c375 -
Training in progress, step 63600
a211041 -
Training in progress, step 63500
072a26a -
Training in progress, step 63400
d461a58 -
Training in progress, step 63300
a68d1cc -
Training in progress, step 63200
e287544 -
Training in progress, step 63100
6c185ea -
Training in progress, step 63000
902f8b3 -
Training in progress, step 62900
63874fe -
Training in progress, step 62800
8a199d8 -
Training in progress, step 62700
46b49ea -
Training in progress, step 62600
d310bc1 -
Training in progress, step 62500
681c639 -
Training in progress, step 62400
442c497 -
Training in progress, step 62300
b3eb617 -
Training in progress, step 62200
8700504 -
Training in progress, step 62100
6bb6ccd -
Training in progress, step 62000
b92302b -
Training in progress, step 61900
bdfeff3 -
Training in progress, step 61800
561e686