Instructions to use KarthikeyaSKGP/know_sql with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use KarthikeyaSKGP/know_sql with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="KarthikeyaSKGP/know_sql", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("KarthikeyaSKGP/know_sql", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use KarthikeyaSKGP/know_sql with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "KarthikeyaSKGP/know_sql" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KarthikeyaSKGP/know_sql", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/KarthikeyaSKGP/know_sql
- SGLang
How to use KarthikeyaSKGP/know_sql with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "KarthikeyaSKGP/know_sql" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KarthikeyaSKGP/know_sql", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "KarthikeyaSKGP/know_sql" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KarthikeyaSKGP/know_sql", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use KarthikeyaSKGP/know_sql with Docker Model Runner:
docker model run hf.co/KarthikeyaSKGP/know_sql
Commit History
-
End of training
5baca00 -
Training in progress, epoch 0
5648707 -
End of training
885a2c5 -
Training in progress, epoch 0
26bdc81 -
End of training
2f480b6 -
Training in progress, epoch 0
5f20c6c
-
Training in progress, epoch 0
48f009c -
End of training
0eec1d1 -
Training in progress, epoch 0
9af3734 -
Upload MixFormerSequentialForCausalLM
071f8ca -
End of training
51d293b -
Training in progress, epoch 0
761c849 -
End of training
d9f66d0 -
Training in progress, epoch 0
c708df5 -
Upload MixFormerSequentialForCausalLM
fa190d7 -
End of training
0eb1cbe -
Training in progress, epoch 0
5871864 -
Upload MixFormerSequentialForCausalLM
5446777 -
End of training
3fd87d7 -
Training in progress, epoch 0
fd10dde -
Upload MixFormerSequentialForCausalLM
701863f -
End of training
1bbd2a6 -
Training in progress, epoch 0
c3495f4
-
End of training
7286873 -
Training in progress, epoch 0
6772b21
-
Upload MixFormerSequentialForCausalLM
8d4f0aa -
End of training
a73bb26 -
Training in progress, epoch 0
94dfa9f -
End of training
20068c4 -
Training in progress, epoch 0
7f71844 -
End of training
451fec2 -
Training in progress, epoch 0
c57cdd9 -
End of training
2c60b13 -
Training in progress, epoch 0
b5bc103 -
End of training
5a6e1ed -
Training in progress, epoch 0
6446c29 -
initial commit
1b2111d