Thinking Machines

Reach the model through Hugging Face's OpenAI-compatible router. Set HF_TOKEN in your environment and use the thinkingmachines/Inkling:together model id.

Copyimport os
from openai import OpenAI

client = OpenAI(
    base_url="https://router.huggingface.co/v1",
    api_key=os.environ["HF_TOKEN"],
)

stream = client.chat.completions.create(
    model="thinkingmachines/Inkling:together",
    messages=[
        {
            "role": "user",
            "content": [
                {
                    "type": "text",
                    "text": "Describe this image in one sentence."
                },
                {
                    "type": "image_url",
                    "image_url": {
                        "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
                    }
                }
            ]
        }
    ],
    stream=True,
)

for chunk in stream:
    print(chunk.choices[0].delta.content, end="")

The :auto suffix routes to your preferred provider in settings; you can also use :cheapest or :fastest.