Instructions to use supreme-lab/ai-in-the-loop with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use supreme-lab/ai-in-the-loop with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="supreme-lab/ai-in-the-loop")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("supreme-lab/ai-in-the-loop", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use supreme-lab/ai-in-the-loop with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "supreme-lab/ai-in-the-loop" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "supreme-lab/ai-in-the-loop", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/supreme-lab/ai-in-the-loop
- SGLang
How to use supreme-lab/ai-in-the-loop with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "supreme-lab/ai-in-the-loop" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "supreme-lab/ai-in-the-loop", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "supreme-lab/ai-in-the-loop" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "supreme-lab/ai-in-the-loop", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use supreme-lab/ai-in-the-loop with Docker Model Runner:
docker model run hf.co/supreme-lab/ai-in-the-loop
Commit History
Update README.md 1436dfb verified
Update the Readme with details 196c45c verified
Update README.md 02ad4be verified
Description added 0c18694 verified
transformer models are add 55cc4ac
ismail102 commited on
non dp models in federated learning setting are added af98f91
ismail102 commited on
fine-tuned models in federated learning settings 93f9fab
ismail102 commited on
Move tokenizers to LFS dd290af
ismail102 commited on
Track large model files with Git LFS 5636348
ismail102 commited on
three other models added into huggingface repo 139dbbf
ismail102 commited on
llama-guard multi task model added e36a521
ismail102 commited on