Update README.md

README.md

@@ -1,5 +1,5 @@
 ---
-license: apache-2.0
+license: mit
 base_model:
 - google/videoprism-large-f8r288
 - google/t5gemma-l-l-ul2-it
@@ -10,7 +10,6 @@ tags:
 - video2audio
 ---
 <h1 align="center">PrismAudio</h1>
-
 <p align="center">
   <img src="https://img.shields.io/badge/ICLR 2026-Main Conference-blue.svg" alt="ICLR 2026"/>
 </p>
@@ -37,100 +36,70 @@ tags:
   </a>
 </p>
 
-<p align="center">
-  If you find this project useful,<br>
-  a star ⭐ on GitHub would be greatly appreciated!
-</p>
-
-
 ---
 
-**PrismAudio** is the first framework to integrate Reinforcement Learning into Video-to-Audio (V2A) generation with specialized Chain-of-Thought (CoT) planning. Building upon [ThinkSound](https://arxiv.org/pdf/2506.21448)'s pioneering CoT-based V2A framework, PrismAudio further decomposes monolithic reasoning into four specialized CoT modules (Semantic, Temporal, Aesthetic, and Spatial), each paired with targeted reward functions, enabling multi-dimensional RL optimization that jointly improves reasoning across all perceptual dimensions.
-
----
-
-## 📰 News
-
-- **2026.03.22** &nbsp; 🔥 We have released **PrismAudio**, our next-generation video-to-audio generation model! Model weights are available on [Hugging Face](https://huggingface.co/FunAudioLLM/PrismAudio) and [ModelScope](https://www.modelscope.cn/models/iic/PrismAudio). For more details, please refer to the [`prismaudio`](https://github.com/liuhuadai/ThinkSound/tree/prismaudio) branch!
-- **2026.01.26** 🎉 PrismAudio has been accepted to the **ICLR 2026 Main Conference**!
-- **2025.11.25** 🔥 [PrismAudio Online Demo](http://prismaudio-project.github.io/) is live!
-- **2025.11.25** 🔥 [PrismAudio paper](https://arxiv.org/pdf/2511.18833) released on arXiv!
-- **2025.09.19** 🎉 ThinkSound has been accepted to the **NeurIPS 2025 Main Conference**!
-- **2025.09.01** AudioCoT dataset is now open-sourced on [Hugging Face](https://huggingface.co/datasets/liuhuadai/AudioCoT)!
-- **2025.07.17** 🧠 Finetuning enabled: training and finetuning code is now publicly available!
-- **2025.07.15** 📦 Simplified installation with Windows `.bat` scripts for one-click setup!
-- **2025.07.08** 🔧 Major update: model lightweighted, optimized memory and GPU usage, supports large-scale high-throughput audio generation!
-- **2025.07.01** Online demo on [Hugging Face Spaces](https://huggingface.co/spaces/FunAudioLLM/ThinkSound) and [ModelScope](https://modelscope.cn/studios/iic/ThinkSound)!
-- **2025.07.01** Released inference scripts and web interface!
-- **2025.06** [ThinkSound paper](https://arxiv.org/pdf/2506.21448) released on arXiv!
-- **2025.06** [Online Demo](http://thinksound-project.github.io/) is live!
-
----
-
-## ⚡ Quick Start
-
-For detailed training and inference code, please refer to [ThinkSound (prismaudio branch)](https://github.com/FunAudioLLM/ThinkSound/tree/prismaudio).
-
+**PrismAudio** is the first framework to integrate reinforcement learning into video-to-audio (V2A) generation, equipped with a dedicated Chain-of-Thought (CoT) planning mechanism. Building on the pioneering CoT-based V2A framework of ThinkSound, PrismAudio further decomposes single-step reasoning into four specialized CoT modules — **semantic**, **temporal**, **aesthetic**, and **spatial** — each with targeted reward functions, enabling multi-dimensional RL optimization that simultaneously improves reasoning across all perceptual dimensions.
 ---
 
-## 🚀 Features
+## Quick Start
 
-- **V2A SOTA**: Achieves state-of-the-art results across all four perceptual dimensions on both VGGSound and AudioCanvas benchmarks.
-- **Decomposed CoT Reasoning**: Four specialized CoT modules (Semantic, Temporal, Aesthetic, Spatial) each providing focused, interpretable reasoning for its corresponding perceptual dimension.
-- **Multi-dimensional RL**: Fast-GRPO enables efficient multi-dimensional reward optimization without compromising generation quality.
-- **New Benchmark AudioCanvas**: A rigorous V2A benchmark with 300 single-event classes and 501 multi-event samples covering diverse and challenging scenarios.
-- **Efficient**: 518M parameters with faster inference than prior SOTAs.
+For full training and inference details, please refer to the [ThinkSound `prismaudio` branch](https://github.com/FunAudioLLM/ThinkSound/tree/prismaudio).
+```bash
+git clone -b prismaudio https://github.com/liuhuadai/ThinkSound.git
+cd ThinkSound
 
----
-
-## ✨ Method Overview
+conda create -n prismaudio python=3.10
+conda activate prismaudio
+chmod +x scripts/PrismAudio/setup/build_env.sh
+./scripts/PrismAudio/setup/build_env.sh
 
-PrismAudio consists of three main components:
-
-1. **CoT-Aware Audio Foundation Model**: Built on a Multimodal Diffusion Transformer with flow matching, enhanced with VideoPrism for video understanding and T5-Gemma for structured CoT text encoding.
-2. **Decomposed Multi-Dimensional CoT Reasoning**: Four specialized CoT modules — Semantic, Temporal, Aesthetic, and Spatial — each providing targeted reasoning for its corresponding perceptual dimension.
-3. **Fast-GRPO Multi-Dimensional RL Framework**: A hybrid ODE-SDE sampling strategy that dramatically reduces training overhead while enabling multi-dimensional reward optimization across all perceptual dimensions.
+# Download pretrained weights to ckpts/
+# From Hugging Face:  https://huggingface.co/FunAudioLLM/PrismAudio
+# From ModelScope:    https://www.modelscope.cn/models/iic/PrismAudio
+git lfs install
+git clone https://huggingface.co/FunAudioLLM/PrismAudio ckpts
+```
 
 ---
 
-## 📄 License
 
-This project is released under the Apache 2.0 License.
+## License
 
-> **Note:**
-> The code, models, and dataset are **for research and educational purposes only**.
-> **Commercial use is NOT permitted.**
-> For commercial licensing, please contact the authors.
+This project is released under the [MIT License](https://opensource.org/licenses/MIT).
 
-**📦 Third-Party Components**
-
-- **Stable Audio Open VAE** (by Stability AI): Licensed under the [Stability AI Community License](./third_party/LICENSE_StabilityAI.md). **Commercial use and redistribution require prior permission from Stability AI.**
-- 📘 **All other code and models** are released under the Apache License 2.0.
+> **Note:** The code, model weights, and datasets are intended for **research and educational purposes only**. Commercial use is not permitted without explicit authorization from the authors.
 
 ---
 
-## Acknowledgements
-
-Many thanks to:
 
-- **stable-audio-tools** (by Stability AI): For providing an easy-to-use framework for audio generation, as well as the VAE module and weights.
+## Citation
 
----
+If you find PrismAudio useful in your research, please consider citing our papers:
 
-## 📖 Citation
-
-If you find PrismAudio useful in your research or work, please cite our paper:
 
 ```bibtex
+@misc{liu2025thinksoundchainofthoughtreasoningmultimodal,
+      title={ThinkSound: Chain-of-Thought Reasoning in Multimodal Large Language Models for Audio Generation and Editing}, 
+      author={Huadai Liu and Jialei Wang and Kaicheng Luo and Wen Wang and Qian Chen and Zhou Zhao and Wei Xue},
+      year={2025},
+      eprint={2506.21448},
+      archivePrefix={arXiv},
+      primaryClass={eess.AS},
+      url={https://arxiv.org/abs/2506.21448}, 
+}
+
 @misc{liu2025prismaudiodecomposedchainofthoughtsmultidimensional,
-    title={PrismAudio: Decomposed Chain-of-Thoughts and Multi-dimensional Rewards for Video-to-Audio Generation}, 
-    author={Huadai Liu and Kaicheng Luo and Wen Wang and Qian Chen and Peiwen Sun and Rongjie Huang and Xiangang Li and Jieping Ye and Wei Xue},
-    year={2025},
-    eprint={2511.18833},
-    archivePrefix={arXiv},
-    primaryClass={cs.SD},
-    url={https://arxiv.org/abs/2511.18833}, 
+        title={PrismAudio: Decomposed Chain-of-Thoughts and Multi-dimensional Rewards for Video-to-Audio Generation}, 
+        author={Huadai Liu and Kaicheng Luo and Wen Wang and Qian Chen and Peiwen Sun and Rongjie Huang and Xiangang Li and Jieping Ye and Wei Xue},
+        year={2025},
+        eprint={2511.18833},
+        archivePrefix={arXiv},
+        primaryClass={cs.SD},
+        url={https://arxiv.org/abs/2511.18833}, 
 }
 ```
-📬 Contact
-✨ Feel free to open an issue or contact us via email (huadai.liu@connect.ust.hk) if you have any questions or suggestions!
+
+---
+## Contact
+
+If you have any questions or suggestions, feel free to [open an issue](https://github.com/liuhuadai/ThinkSound/issues) or reach out via email: [huadai.liu@connect.ust.hk](mailto:huadai.liu@connect.ust.hk)