README / README.md
BradPowar's picture
Provider slug chosen: intelcs-ai-iaas (update code example)
cc3bd29 verified
|
Raw
History Blame Contribute Delete
2.24 kB
---
title: README
emoji: πŸ“‰
colorFrom: blue
colorTo: green
sdk: static
pinned: false
---
# IntelCS-AI
**Low-cost inference for open-weight models.** We serve open models on
efficient GPU capacity at some of the lowest per-token prices on the
platform β€” with no compromise on features.
## Why IntelCS-AI
- **Price-first**: open-weight models at floor prices β€” see the table below.
- **Full feature parity**: tool calling (function calling) and structured
output (`response_format: json_schema`) on every conversational model.
- **Long context**: up to 1M tokens of context on supported models.
- **Low latency**: time-to-first-token well under the 5 s provider budget
(measured ~0.9 s non-streaming).
- **Autoscaling fleet**: capacity scales out automatically with demand;
routing, metering, and billing run on edge infrastructure.
## Pricing
| Model | Input (per 1M tokens) | Output (per 1M tokens) | Context |
|---|---|---|---|
| `google/gemma-3-4b-it` | $0.05 | $0.10 | 131K |
Our lineup rotates as we add capacity β€” check back for new models.
## Usage
OpenAI-compatible, through the standard Hugging Face clients:
```python
from huggingface_hub import InferenceClient
client = InferenceClient(
model="google/gemma-3-4b-it",
provider="intelcs-ai-iaas",
)
# Chat with tool calling
response = client.chat.completions.create(
messages=[{"role": "user", "content": "What's the weather in Berlin?"}],
tools=[{
"type": "function",
"function": {
"name": "get_weather",
"parameters": {"type": "object", "properties": {"location": {"type": "string"}}},
},
}],
)
print(response.choices[0].message.tool_calls)
# Structured output
response = client.chat.completions.create(
messages=[{"role": "user", "content": "Extract the city: 'Flight to Berlin delayed'"}],
response_format={"type": "json_schema", "json_schema": {"name": "city", "schema": {
"type": "object", "properties": {"city": {"type": "string"}}, "required": ["city"],
}}},
)
print(response.choices[0].message.content) # {"city": "Berlin"}
```
Streaming (`stream=True`) is fully supported and metered per token.
## Resources
- **Website**: [intelcs.ai](https://intelcs.ai)