Instructions to use vll-ai-company/XOChat with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vll-ai-company/XOChat with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="vll-ai-company/XOChat")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("vll-ai-company/XOChat", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use vll-ai-company/XOChat with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "vll-ai-company/XOChat" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "vll-ai-company/XOChat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/vll-ai-company/XOChat
- SGLang
How to use vll-ai-company/XOChat with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "vll-ai-company/XOChat" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "vll-ai-company/XOChat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "vll-ai-company/XOChat" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "vll-ai-company/XOChat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use vll-ai-company/XOChat with Docker Model Runner:
docker model run hf.co/vll-ai-company/XOChat
XAI (XI)
Overview
XAI (XI) is an ambitious model developed by VLL's AI Company, designed to push the boundaries of what artificial intelligence can achieve. Our mission is to utilize AI to address global challenges and make the world a better place.
What We Do
At VLL's AI Company, we're not just limited to AI; we're dedicated to driving progress across various technological fronts. However, the success of XAI (XI) and our broader mission is not something we can achieve alone.
The Importance of Support
We face many challenges in our journey, and without your support and contribution, XAI (XI) cannot reach its full potential. Your involvement is crucial—together, we can make a meaningful impact. Without The Support, our vision for a better world through AI cannot become a reality.
Stay Connected
Let's power the world together—because we can't do it without you.