|
Download README.md from HY-2012/FlowHigh.AXERA: direct link, hf CLI and curl.
- Browser
- Download file 9.99 kB
-
https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/README.md
- Command line
-
hf download hf://HY-2012/FlowHigh.AXERA/README.md
-
curl -L -o README.md https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/README.md
9.99 kB
| library_name: axera | |
| pipeline_tag: audio-to-audio | |
| base_model: kiriyamaX/FLowHigh_indep_adaptive_400k | |
| language: | |
| - en | |
| - zh | |
| tags: | |
| - axera | |
| - ax650 | |
| - npu3 | |
| - flowhigh | |
| - speech-super-resolution | |
| - audio-super-resolution | |
| - bandwidth-extension | |
| - real-time | |
| - python | |
| # FlowHigh.AXERA | |
| **8/16 kHz 语音 → 48 kHz 超分 · AX650 NPU3 · Python RTF 0.24(20–60 s 音频)· 2 个 axmodel 共 58 MB · 不做降噪** | |
|   [](https://github.com/ZY-2012/FlowHigh.AXERA) | |
| - GitHub: https://github.com/ZY-2012/FlowHigh.AXERA | |
| - 上游: https://github.com/jjunak-yun/FLowHigh_code | |
| > **AX650 板端实测说明**:AudioSR、LavaSR、FlowHigh 均已在 AX650N / NPU3 板端跑通。综合效果和速度最好的是 **LavaSR**:C++ 全链路 RTF ≈ 0.061(约 16× 实时),支持 8–48 kHz → 48 kHz 和降噪。**推荐优先使用 LavaSR。** | |
| ## 目录 | |
| - 快速开始 | |
| - 结果 | |
| - 推理速度 | |
| - 数据来源 | |
| - License | |
| ## 快速开始(AX650 板端) | |
| 从 HuggingFace 下载 `models/`、`assets/`、`python/`、`samples/`,在包根目录运行: | |
| ```bash | |
| bash run_ax650.sh samples/listen/8k/OSR_us_000_0010_input_8k.wav output.wav | |
| ``` | |
| 输入支持 8 kHz / 16 kHz,输出固定 48 kHz。默认 1-step flow、`std=1e-4`;不做降噪。 | |
| 模型为 `FLowHigh_indep_adaptive_400k`(481,490,826 bytes,Flow 35.4M + BigVGAN 14.0M 参数)。AX650 侧拆成 Flow 38 MB + BigVGAN 20 MB 两个 U16/S8 axmodel;38 MB 是 S8 权重后的正常大小。 | |
| ## 结果 | |
| ### 8 kHz 输入(Open Speech / Samplelib) | |
| #### English | |
| **OSR_us_000_0010** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_us_000_0010_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0010_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_us_000_0010_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0010_output_48k_spec.png" width="360"> | | |
| **OSR_us_000_0013** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_us_000_0013_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0013_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_us_000_0013_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0013_output_48k_spec.png" width="360"> | | |
| **OSR_us_000_0057** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_us_000_0057_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0057_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_us_000_0057_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0057_output_48k_spec.png" width="360"> | | |
| **OSR_us_000_0059** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_us_000_0059_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0059_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_us_000_0059_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0059_output_48k_spec.png" width="360"> | | |
| #### Chinese | |
| **OSR_cn_000_0072** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_cn_000_0072_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0072_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_cn_000_0072_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0072_output_48k_spec.png" width="360"> | | |
| **OSR_cn_000_0073** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_cn_000_0073_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0073_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_cn_000_0073_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0073_output_48k_spec.png" width="360"> | | |
| **OSR_cn_000_0074** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_cn_000_0074_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0074_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_cn_000_0074_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0074_output_48k_spec.png" width="360"> | | |
| **OSR_cn_000_0075** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_cn_000_0075_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0075_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_cn_000_0075_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0075_output_48k_spec.png" width="360"> | | |
| #### Samplelib(1 分钟,频谱图为前 10 s) | |
| **samplelib_speech_1m** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/samplelib_speech_1m_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/samplelib_speech_1m_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/samplelib_speech_1m_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/samplelib_speech_1m_output_48k_spec.png" width="360"> | | |
| ### 16 kHz 参照(人声) | |
| 同一批人声降采样到 16 kHz 后输入;8k 行为 8 kHz 输入,16k 行为 16 kHz 输入。 | |
| **speech_2** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/speech_2_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/speech_2_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/speech_2_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/speech_2_output_8k_48k_spec.png" width="360"> | | |
| | 16k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/16k/speech_2_input_16k.wav"></audio><br><img src="samples/listen/spectrograms/speech_2_input_16k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from16k/speech_2_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/speech_2_output_16k_48k_spec.png" width="360"> | | |
| **speech_3** | |
| | 版本 | 输入 | FlowHigh 输出 | | |
| |---|---|---| | |
| | 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/speech_3_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/speech_3_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/speech_3_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/speech_3_output_8k_48k_spec.png" width="360"> | | |
| | 16k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/16k/speech_3_input_16k.wav"></audio><br><img src="samples/listen/spectrograms/speech_3_input_16k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from16k/speech_3_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/speech_3_output_16k_48k_spec.png" width="360"> | | |
| ## 推理速度:RTF | |
| | 链路 | Python RTF | | |
| |---|---:| | |
| | 8/16 kHz → 48 kHz | **0.24** | | |
| 20–60 s 音频,1-step flow,BigVGAN 1 s 分块、0.2 s overlap。5 s 短音频因分块/启动开销会略高;C++ 运行时尚未提供。 | |
| ## 数据来源 | |
| - Open Speech Repository(English / Chinese 8k):http://voiptroubleshooter.com/open_speech/index.html | |
| - Samplelib speech 1m:https://samplelib.com/mp3/sample-speech-1m.mp3 | |
| - 16 kHz 参照:公开人声样例经 48k->16k 降采样。 | |
| ## License | |
| MIT;FLowHigh 与 BigVGAN 均为 MIT。模型 checkpoint 来自上游/公开镜像,仓库不重复分发训练权重。 | |