README / README.md
BradPowar's picture
Provider slug chosen: intelcs-ai-iaas (update code example)
cc3bd29 verified
|
Raw
History Blame Contribute Delete
2.24 kB
metadata
title: README
emoji: πŸ“‰
colorFrom: blue
colorTo: green
sdk: static
pinned: false

IntelCS-AI

Low-cost inference for open-weight models. We serve open models on efficient GPU capacity at some of the lowest per-token prices on the platform β€” with no compromise on features.

Why IntelCS-AI

  • Price-first: open-weight models at floor prices β€” see the table below.
  • Full feature parity: tool calling (function calling) and structured output (response_format: json_schema) on every conversational model.
  • Long context: up to 1M tokens of context on supported models.
  • Low latency: time-to-first-token well under the 5 s provider budget (measured ~0.9 s non-streaming).
  • Autoscaling fleet: capacity scales out automatically with demand; routing, metering, and billing run on edge infrastructure.

Pricing

Model Input (per 1M tokens) Output (per 1M tokens) Context
google/gemma-3-4b-it $0.05 $0.10 131K

Our lineup rotates as we add capacity β€” check back for new models.

Usage

OpenAI-compatible, through the standard Hugging Face clients:

from huggingface_hub import InferenceClient

client = InferenceClient(
    model="google/gemma-3-4b-it",
    provider="intelcs-ai-iaas",
)

# Chat with tool calling
response = client.chat.completions.create(
    messages=[{"role": "user", "content": "What's the weather in Berlin?"}],
    tools=[{
        "type": "function",
        "function": {
            "name": "get_weather",
            "parameters": {"type": "object", "properties": {"location": {"type": "string"}}},
        },
    }],
)
print(response.choices[0].message.tool_calls)

# Structured output
response = client.chat.completions.create(
    messages=[{"role": "user", "content": "Extract the city: 'Flight to Berlin delayed'"}],
    response_format={"type": "json_schema", "json_schema": {"name": "city", "schema": {
        "type": "object", "properties": {"city": {"type": "string"}}, "required": ["city"],
    }}},
)
print(response.choices[0].message.content)  # {"city": "Berlin"}

Streaming (stream=True) is fully supported and metered per token.

Resources