| --- |
| title: llama.cpp |
| emoji: 🐑 |
| colorFrom: red |
| colorTo: red |
| sdk: docker |
| pinned: false |
| --- |
| |
| # Bielik-7B-Instruct OpenAI Compatible API |
|
|
| This Space provides an OpenAI-compatible API for the **Bielik-7B-Instruct-v0.1** model using `llama-cpp-python`. |
|
|
| ## API Endpoint |
| The OpenAI compatible endpoint is available at: |
| `https://oki602960-bielik-api.hf.space/v1` |
|
|
| ## Usage Example |
| You can use it with the OpenAI Python client: |
|
|
| ```python |
| from openai import OpenAI |
| |
| client = OpenAI( |
| base_url="https://oki602960-bielik-api.hf.space/v1", |
| api_key="sk-no-key-required" |
| ) |
| |
| response = client.chat.completions.create( |
| model="bielik", |
| messages=[{"role": "user", "content": "Cześć, jak się masz?"}] |
| ) |
| |
| print(response.choices[0].message.content) |
| ``` |
|
|
| ## Model Information |
| - **Model**: Bielik-7B-Instruct-v0.1 |
| - **Format**: GGUF (Q2_K) |
| - **Engine**: llama-cpp-python |
