Audio-Text-to-Text
Transformers
Safetensors
English
qwen2_audio
text2text-generation
audio
speech
audio-llm
paralinguistic
pclm
dpo
voxparadox
Instructions to use IHP-Lab/Qwen2-Audio_PCLM_DPO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use IHP-Lab/Qwen2-Audio_PCLM_DPO with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForSeq2SeqLM processor = AutoProcessor.from_pretrained("IHP-Lab/Qwen2-Audio_PCLM_DPO") model = AutoModelForSeq2SeqLM.from_pretrained("IHP-Lab/Qwen2-Audio_PCLM_DPO") - Notebooks
- Google Colab
- Kaggle
File size: 719 Bytes
11a7e82 | 1 2 3 4 | {
"chat_template": "{% set audio_count = namespace(value=0) %}{% for message in messages %}{% if loop.first and message['role'] != 'system' %}<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n{% endif %}<|im_start|>{{ message['role'] }}\n{% if message['content'] is string %}{{ message['content'] }}<|im_end|>\n{% else %}{% for content in message['content'] %}{% if 'audio' in content or 'audio_url' in content %}{% set audio_count.value = audio_count.value + 1 %}Audio {{ audio_count.value }}: <|audio_bos|><|AUDIO|><|audio_eos|>\n{% elif 'text' in content %}{{ content['text'] }}{% endif %}{% endfor %}<|im_end|>\n{% endif %}{% endfor %}{% if add_generation_prompt %}<|im_start|>assistant\n{% endif %}"
}
|