Instructions to use interfaceinde/qwen35-4b-interface-classifier-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use interfaceinde/qwen35-4b-interface-classifier-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
Use Docker
docker model run hf.co/interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use interfaceinde/qwen35-4b-interface-classifier-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "interfaceinde/qwen35-4b-interface-classifier-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "interfaceinde/qwen35-4b-interface-classifier-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
- Ollama
How to use interfaceinde/qwen35-4b-interface-classifier-GGUF with Ollama:
ollama run hf.co/interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
- Unsloth Desktop
- Pi
How to use interfaceinde/qwen35-4b-interface-classifier-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use interfaceinde/qwen35-4b-interface-classifier-GGUF with Docker Model Runner:
docker model run hf.co/interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
- Lemonade
How to use interfaceinde/qwen35-4b-interface-classifier-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.qwen35-4b-interface-classifier-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use interfaceinde/qwen35-4b-interface-classifier-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use interfaceinde/qwen35-4b-interface-classifier-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "interfaceinde/qwen35-4b-interface-classifier-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download response_schema.json from interfaceinde/qwen35-4b-interface-classifier-GGUF: direct link, hf CLI and curl.
- Browser
- Download file 6.3 kB
-
https://huggingface.co/interfaceinde/qwen35-4b-interface-classifier-GGUF/resolve/main/response_schema.json
- Command line
-
hf download hf://interfaceinde/qwen35-4b-interface-classifier-GGUF/response_schema.json
-
curl -L -o response_schema.json https://huggingface.co/interfaceinde/qwen35-4b-interface-classifier-GGUF/resolve/main/response_schema.json
6.3 kB
| { | |
| "type": "object", | |
| "properties": { | |
| "category": { | |
| "type": "string", | |
| "enum": [ | |
| "billing", | |
| "technical", | |
| "sales", | |
| "security", | |
| "hr", | |
| "other" | |
| ], | |
| "description": "๋ด๋น ๋ถ์ผ. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "is_spam": { | |
| "type": "boolean", | |
| "description": "์คํธ ์ฌ๋ถ. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "is_phishing": { | |
| "type": "boolean", | |
| "description": "ํผ์ฑ ์ฌ๋ถ. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "urgency": { | |
| "type": "integer", | |
| "enum": [ | |
| 0, | |
| 1, | |
| 2 | |
| ], | |
| "description": "๊ธด๊ธ๋. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "urgency_detail": { | |
| "type": "string", | |
| "enum": [ | |
| "U0", | |
| "U1", | |
| "U2", | |
| "U3", | |
| "U4" | |
| ], | |
| "description": "์์ธ ๊ธด๊ธ๋. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "needs_reply": { | |
| "type": "boolean", | |
| "description": "๋ต์ฅ ํ์. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "importance": { | |
| "type": "integer", | |
| "enum": [ | |
| 0, | |
| 1, | |
| 2, | |
| 3, | |
| 4 | |
| ], | |
| "description": "์ค์๋. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "sensitivity": { | |
| "type": "string", | |
| "enum": [ | |
| "public", | |
| "internal", | |
| "confidential", | |
| "personal", | |
| "restricted" | |
| ], | |
| "description": "๋ฏผ๊ฐ๋. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "contains_pii": { | |
| "type": "boolean", | |
| "description": "๊ฐ์ธ์ ๋ณด ํฌํจ. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "pii_type": { | |
| "type": "array", | |
| "items": { | |
| "type": "string", | |
| "enum": [ | |
| "name", | |
| "phone", | |
| "email", | |
| "address", | |
| "account", | |
| "birth_date", | |
| "identifier", | |
| "other" | |
| ] | |
| }, | |
| "uniqueItems": true, | |
| "description": "๊ฐ์ธ์ ๋ณด ์ ํ. ๋น ๊ฐ ๊ท์น: ๋์ ์์ผ๋ฉด []" | |
| }, | |
| "business_type": { | |
| "type": "array", | |
| "items": { | |
| "type": "string", | |
| "enum": [ | |
| "quotation", | |
| "contract", | |
| "purchase", | |
| "delivery", | |
| "payment", | |
| "meeting", | |
| "schedule", | |
| "customer_support", | |
| "maintenance", | |
| "report", | |
| "document_request", | |
| "internal_notice", | |
| "other" | |
| ] | |
| }, | |
| "uniqueItems": true, | |
| "description": "์ ๋ฌด ์ ํ. ๋น ๊ฐ ๊ท์น: ์ ๋ฌด ํ๋จ ๋ถ๊ฐ ์ other" | |
| }, | |
| "has_attachment": { | |
| "type": "boolean", | |
| "description": "์ฒจ๋ถํ์ผ ์กด์ฌ. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "attachment_type": { | |
| "type": "array", | |
| "items": { | |
| "type": "string", | |
| "enum": [ | |
| "pdf", | |
| "docx", | |
| "xlsx", | |
| "csv", | |
| "txt", | |
| "md", | |
| "image", | |
| "archive", | |
| "other" | |
| ] | |
| }, | |
| "uniqueItems": true, | |
| "description": "์ฒจ๋ถ ์ ํ. ๋น ๊ฐ ๊ท์น: ์ฒจ๋ถ ์์ผ๋ฉด []" | |
| }, | |
| "has_deadline": { | |
| "type": "boolean", | |
| "description": "๋ง๊ฐ์ผ ์กด์ฌ. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "deadline": { | |
| "type": [ | |
| "string", | |
| "null" | |
| ], | |
| "format": "date-time", | |
| "description": "๋ง๊ฐ์ผ. ๋น ๊ฐ ๊ท์น: ํ์ ๋ถ๊ฐ ์ null" | |
| }, | |
| "has_action_items": { | |
| "type": "boolean", | |
| "description": "์ ๋ฌด ์์ฒญ ์กด์ฌ. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "action_items": { | |
| "type": "array", | |
| "items": { | |
| "type": "object", | |
| "properties": { | |
| "action_id": { | |
| "type": "string", | |
| "minLength": 1 | |
| }, | |
| "task": { | |
| "type": "string", | |
| "minLength": 1 | |
| }, | |
| "assignee": { | |
| "type": [ | |
| "string", | |
| "null" | |
| ] | |
| }, | |
| "deadline": { | |
| "type": [ | |
| "string", | |
| "null" | |
| ], | |
| "format": "date-time" | |
| }, | |
| "dependency": { | |
| "type": [ | |
| "string", | |
| "null" | |
| ] | |
| }, | |
| "evidence": { | |
| "type": "object", | |
| "properties": { | |
| "start": { | |
| "type": "integer", | |
| "minimum": 0 | |
| }, | |
| "end": { | |
| "type": "integer", | |
| "minimum": 0 | |
| }, | |
| "text": { | |
| "type": "string", | |
| "minLength": 1 | |
| } | |
| }, | |
| "required": [ | |
| "start", | |
| "end", | |
| "text" | |
| ], | |
| "additionalProperties": false | |
| }, | |
| "requires_approval": { | |
| "type": "boolean" | |
| } | |
| }, | |
| "required": [ | |
| "action_id", | |
| "task", | |
| "assignee", | |
| "deadline", | |
| "dependency", | |
| "evidence", | |
| "requires_approval" | |
| ], | |
| "additionalProperties": false | |
| }, | |
| "description": "์ ๋ฌด ์์ฒญ ์ถ์ถ. ๋น ๊ฐ ๊ท์น: ์์ฒญ ์์ผ๋ฉด []" | |
| }, | |
| "requires_approval": { | |
| "type": "boolean", | |
| "description": "์น์ธ ํ์. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "requires_human_review": { | |
| "type": "boolean", | |
| "description": "์ฌ๋ ๊ฒํ ํ์. ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| }, | |
| "routing": { | |
| "type": "string", | |
| "enum": [ | |
| "local", | |
| "llm", | |
| "human_review", | |
| "blocked" | |
| ], | |
| "description": "์ ๋ฌด ๋ผ์ฐํ . ๋น ๊ฐ ๊ท์น: ๊ธ์ง" | |
| } | |
| }, | |
| "required": [ | |
| "category", | |
| "is_spam", | |
| "is_phishing", | |
| "urgency", | |
| "urgency_detail", | |
| "needs_reply", | |
| "importance", | |
| "sensitivity", | |
| "contains_pii", | |
| "pii_type", | |
| "business_type", | |
| "has_attachment", | |
| "attachment_type", | |
| "has_deadline", | |
| "deadline", | |
| "has_action_items", | |
| "action_items", | |
| "requires_approval", | |
| "requires_human_review", | |
| "routing" | |
| ], | |
| "additionalProperties": false | |
| } |