Instructions to use audarai/Audar-ASR-V1-Turbo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use audarai/Audar-ASR-V1-Turbo with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("automatic-speech-recognition", model="audarai/Audar-ASR-V1-Turbo", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("audarai/Audar-ASR-V1-Turbo", trust_remote_code=True)
model = AutoModelForMultimodalLM.from_pretrained("audarai/Audar-ASR-V1-Turbo", trust_remote_code=True, device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use audarai/Audar-ASR-V1-Turbo with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf audarai/Audar-ASR-V1-Turbo:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf audarai/Audar-ASR-V1-Turbo:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf audarai/Audar-ASR-V1-Turbo:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf audarai/Audar-ASR-V1-Turbo:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf audarai/Audar-ASR-V1-Turbo:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf audarai/Audar-ASR-V1-Turbo:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf audarai/Audar-ASR-V1-Turbo:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf audarai/Audar-ASR-V1-Turbo:Q4_K_M

Use Docker

docker model run hf.co/audarai/Audar-ASR-V1-Turbo:Q4_K_M

LM Studio
Jan
Ollama
How to use audarai/Audar-ASR-V1-Turbo with Ollama:
```
ollama run hf.co/audarai/Audar-ASR-V1-Turbo:Q4_K_M
```

Unsloth Studio

How to use audarai/Audar-ASR-V1-Turbo with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for audarai/Audar-ASR-V1-Turbo to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for audarai/Audar-ASR-V1-Turbo to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for audarai/Audar-ASR-V1-Turbo to start chatting

Docker Model Runner
How to use audarai/Audar-ASR-V1-Turbo with Docker Model Runner:
```
docker model run hf.co/audarai/Audar-ASR-V1-Turbo:Q4_K_M
```

Lemonade

How to use audarai/Audar-ASR-V1-Turbo with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull audarai/Audar-ASR-V1-Turbo:Q4_K_M

Run and chat with the model

lemonade run user.Audar-ASR-V1-Turbo-Q4_K_M

List all available models

lemonade list

Atomic Chat

Dragonhead commited on Jul 17

Commit

cabc19d

verified ·

1 Parent(s): ad522e1

Rebrand custom-code filenames to *_audar_asr.py (auto_map rewired; Qwen3-ASR arch identifiers + Apache-2.0 headers preserved)

Browse files

Files changed (5) hide show

vllm-w4a16/__init__.py +3 -3
vllm-w4a16/config.json +3 -3
vllm-w4a16/{configuration_qwen3_asr.py → configuration_audar_asr.py} +0 -0
vllm-w4a16/{modeling_qwen3_asr.py → modeling_audar_asr.py} +1 -1
vllm-w4a16/{processing_qwen3_asr.py → processing_audar_asr.py} +0 -0

vllm-w4a16/__init__.py CHANGED Viewed

@@ -13,6 +13,6 @@
 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 # See the License for the specific language governing permissions and
 # limitations under the License.
-from .configuration_qwen3_asr import Qwen3ASRConfig
-from .modeling_qwen3_asr import Qwen3ASRForConditionalGeneration
-from .processing_qwen3_asr import Qwen3ASRProcessor

 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 # See the License for the specific language governing permissions and
 # limitations under the License.
+from .configuration_audar_asr import Qwen3ASRConfig
+from .modeling_audar_asr import Qwen3ASRForConditionalGeneration
+from .processing_audar_asr import Qwen3ASRProcessor

vllm-w4a16/config.json CHANGED Viewed

@@ -3,9 +3,9 @@
     "Qwen3ASRForConditionalGeneration"
   ],
   "auto_map": {
-    "AutoConfig": "configuration_qwen3_asr.Qwen3ASRConfig",
-    "AutoModel": "modeling_qwen3_asr.Qwen3ASRForConditionalGeneration",
-    "AutoModelForCausalLM": "modeling_qwen3_asr.Qwen3ASRForConditionalGeneration"
   },
   "dtype": "bfloat16",
   "eos_token_id": 151645,

     "Qwen3ASRForConditionalGeneration"
   ],
   "auto_map": {
+    "AutoConfig": "configuration_audar_asr.Qwen3ASRConfig",
+    "AutoModel": "modeling_audar_asr.Qwen3ASRForConditionalGeneration",
+    "AutoModelForCausalLM": "modeling_audar_asr.Qwen3ASRForConditionalGeneration"
   },
   "dtype": "bfloat16",
   "eos_token_id": 151645,

vllm-w4a16/{configuration_qwen3_asr.py → configuration_audar_asr.py} RENAMED Viewed

File without changes

vllm-w4a16/{modeling_qwen3_asr.py → modeling_audar_asr.py} RENAMED Viewed

@@ -40,7 +40,7 @@ from transformers.utils import auto_docstring, can_return_tuple
 from transformers.utils.deprecation import deprecate_kwarg
 from transformers.utils.generic import TransformersKwargs, check_model_inputs
-from .configuration_qwen3_asr import (
     Qwen3ASRAudioEncoderConfig,
     Qwen3ASRConfig,
     Qwen3ASRThinkerConfig,

 from transformers.utils.deprecation import deprecate_kwarg
 from transformers.utils.generic import TransformersKwargs, check_model_inputs
+from .configuration_audar_asr import (
     Qwen3ASRAudioEncoderConfig,
     Qwen3ASRConfig,
     Qwen3ASRThinkerConfig,

vllm-w4a16/{processing_qwen3_asr.py → processing_audar_asr.py} RENAMED Viewed

File without changes