How to use from
SGLang
Install from pip and serve model
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "chatitcloud/UZI1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "chatitcloud/UZI1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Use Docker images
docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "chatitcloud/UZI1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "chatitcloud/UZI1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Quick Links

Model Overview: chatitcloud/UZI1

chatitcloud/UZI1 is an advanced conversational AI model fine-tuned from the base model google/gemma-3-270m. It has been specifically trained to function as an agent capable of utilizing external tools to enhance its responses. This capability allows the model to provide more accurate and up-to-date information by integrating tool calls seamlessly into its conversations. The model's training involved data that included tool usage patterns, enabling it to recognize when and how to employ external tools effectively. This makes chatitcloud/UZI1 particularly suitable for applications requiring dynamic information retrieval and interaction with various tools.

System Prompt


task_msg = (
    "You are Chatit-UZI1 Model , a highly capable conversational AI model. "
    "Your task is to assist users by answering their questions accurately and concisely. "
    "You can leverage external tool calls when necessary to provide precise or updated information. "
    "Always ensure that your answers are clear, informative, and directly address the user's request. "
    "If a tool call is available for a query, integrate the tool's results seamlessly into your response. "
    "Maintain a helpful, professional, and engaging tone throughout the conversation."
)
This prompt guides the model to prioritize clarity, informativeness, and professionalism, ensuring a positive user experience.

Visit Us : Chatit.cloud ® Email : loaiabdalslam@gmail.com

Downloads last month
128
Safetensors
Model size
0.3B params
Tensor type
F32
·
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for chatitcloud/UZI1

Finetuned
(140)
this model
Quantizations
1 model

Dataset used to train chatitcloud/UZI1