DuplexOmni / README.md
heyunchao's picture
Duplicate from MuyeHuang/DuplexOmni
f1eff7c
|
Raw
History Blame Contribute Delete
1.73 kB
---
license: apache-2.0
tags:
- duplexomni
- speech
- multimodal
---
# DuplexOmni
## Model Description
This repository provides the **DuplexOmni model weights**. Both the **Thinker** and **Talker** components are included in the released checkpoint.
For source code and deployment details, see the [DuplexOmni repository](https://github.com/MuyeHuang/DuplexOmni/tree/main).
## Known Issues
This model is still under active optimization and may exhibit the following issues:
- Unexpected silence during generation.
- Suboptimal speech quality or speech performance in certain cases.
## Hardware Recommendation
For low-latency deployment, we recommend using at least **8 NVIDIA H20 GPUs**. This recommendation reflects the current optimization level and may change as inference performance improves.
## Warm-up Requirement
The model should be warmed up after deployment. Without warm-up, the first response packet can have significantly higher latency.
---
# DuplexOmni
## 模型说明
本仓库提供 **DuplexOmni 模型权重**,其中同时包含 **Thinker****Talker** 两个组件。
源码及部署相关信息请参考 [DuplexOmni 仓库](https://github.com/MuyeHuang/DuplexOmni/tree/main)。
## 已知问题
该模型目前仍在持续优化中,可能存在以下问题:
- 生成过程中出现意料之外的沉默。
- 部分情况下语音质量或语音表现不佳。
## 硬件建议
为获得较低的推理延迟,建议至少使用 **8 张 NVIDIA H20 GPU** 进行部署。该建议基于当前的优化水平,后续可能会随着推理性能优化而调整。
## 预热要求
模型部署并挂载后需要进行预热;否则,首个响应包的延迟可能会明显偏高。