Duplicate from TEN-framework/TEN_Turn_Detection

Co-authored-by: zhaorenjie <zrj619@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,37 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+*.json filter=lfs diff=lfs merge=lfs -text
+*.txt filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,155 @@
+---
+pipeline_tag: text-generation
+tags:
+- turn detection
+- conversational
+- natural language understanding
+license: apache-2.0
+---
+# **TEN Turn Detection**
+
+***Turn detection for full-duplex dialogue communication***
+
+
+## Introduction
+
+**TEN Turn Detection** is an advanced intelligent turn detection model designed specifically for natural and dynamic communication between humans and AI agents. This technology addresses one of the most challenging aspects of human-AI conversation: detecting natural turn-taking cues and enabling contextually-aware interruptions. TEN incorporates deep semantic understanding of conversation context and linguistic patterns to create more natural dialogue with AI.
+<div align="center">
+  <img src="images/turn_detection.svg" alt="TEN Turn Detection SVG Diagram" width="800"/>
+</div>
+
+**TEN Turn Detection** categorizes user's text into three key states:
+
+**finished**: A finished utterance where the user has expressed a complete thought and expects a response. Example: "Hey there I was wondering can you help me with my order"
+
+**wait**: An wait utterance where the user has explicitly instructed the AI not to speak. Example: "Shut up"
+
+**unfinished**: A clearly unfinished utterance where the user has momentarily paused but intends to continue speaking. Example: "Hello I have a question about"
+
+These three classification states allow the TEN system to create natural conversation dynamics by intelligently managing turn-taking, reducing awkward interruptions while maintaining conversation flow.
+
+TEN Turn Detection utilizes a multi-layered approach based on the transformer-based language model（Qwen2.5-7B） for semantic analysis.
+
+## Key Features
+
+- **Context-Aware Turn Management**
+TEN Turn Detection analyzes linguistic patterns and semantic context to accurately identify turn completion points. This capability enables intelligent interruption handling, allowing the system to determine when interruptions are contextually appropriate while maintaining natural conversation flow across various dialogue scenarios.
+
+- **Multilingual Turn Detection Support**
+TEN Turn Detection provides comprehensive support for both English and Chinese languages. It is engineered to accurately identify turn-taking cues and completion signals across multilingual conversations.
+
+- **Superior Performance**
+Compared with multiple open-source solutions, TEN achieves superior performance across all metrics on our publicly available test dataset.
+
+## Prepared Dataset
+We have open-sourced the TEN-Turn-Detection TestSet, a bilingual (Chinese and English) collection of conversational inputs specifically designed to evaluate turn detection capabilities in AI dialogue systems. The dataset consists of three distinct components:
+
+*wait.txt*: Contains expressions requesting conversation pauses or termination
+
+*unfinished.txt*: Features incomplete dialogue inputs with truncated utterances
+
+*finished.txt*: Provides complete conversational inputs across multiple domains
+
+
+## Detection Performance
+
+We conducted comprehensive evaluations comparing several open-source models for turn detection using our test dataset:
+
+<div align="center">
+
+
+| LANGUAGE | MODEL | FINISHED<br>ACCURACY | UNFINISHED<br>ACCURACY | WAIT<br>ACCURACY |
+|:--------:|:-----:|:--------------------:|:----------------------:|:----------------:|
+| English  | Model A | 59.74% | 86.46% | N/A |
+| English  | Model B | 71.61% | 96.88% | N/A |
+| English  | **TEN Turn Detection** | **90.64%** | **98.44%** | **91%** |
+
+
+
+
+| LANGUAGE | MODEL | FINISHED<br>ACCURACY | UNFINISHED<br>ACCURACY | WAIT<br>ACCURACY |
+|:--------:|:-----:|:--------------------:|:----------------------:|:----------------:|
+| Chinese  | Model B | 74.63% | 88.89% | N/A |
+| Chinese  | **TEN Turn Detection** | **98.90%** | **92.74%** | **92%** |
+
+
+</div>
+
+> **Notes:** 
+> 1. Model A doesn't support Chinese language processing
+> 2. Neither Model A nor Model B support the "WAIT" state detection
+
+## Quick Start
+
+TEN Turn Detection is also available on github [TEN-framework/ten-turn-detection](https://github.com/TEN-framework/ten-turn-detection)
+
+### Installation
+
+```
+pip install "transformers>=4.45.0"
+pip install "torch>=2.0.0"
+```
+
+### Model Weights
+
+The TEN Turn Detection model is available on HuggingFace
+
+### Inference
+
+```python
+from transformers import AutoTokenizer, AutoModelForCausalLM
+import torch
+
+# Load model and tokenizer
+model_id = 'TEN-framework/TEN_Turn_Detection'
+model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True, torch_dtype=torch.bfloat16)
+tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
+
+# Move model to GPU
+model = model.cuda()
+model.eval()
+
+# Function for inference
+def analyze_text(text, system_prompt=""):
+    inf_messages = [{"role":"system", "content":system_prompt}] + [{"role":"user", "content":text}]
+    input_ids = tokenizer.apply_chat_template(
+        inf_messages, 
+        add_generation_prompt=True, 
+        return_tensors="pt"
+    ).cuda()
+    
+    with torch.no_grad():
+        outputs = model.generate(
+            input_ids, 
+            max_new_tokens=1, 
+            do_sample=True, 
+            top_p=0.1, 
+            temperature=0.1, 
+            pad_token_id=tokenizer.eos_token_id
+        )
+        
+    response = outputs[0][input_ids.shape[-1]:]
+    return tokenizer.decode(response, skip_special_tokens=True)
+
+# Example usage
+text = "Hello I have a question about"
+result = analyze_text(text)
+print(f"Input: '{text}'")
+print(f"Turn Detection Result: '{result}'")
+```
+
+## Citation
+If you use TEN Turn Detection in your research or applications, please cite:
+
+```
+@misc{TEN_Turn_Detection,
+author = {TEN Team},
+title = {TEN Turn Detection: Turn detection for full-duplex dialogue communication 
+
+},
+year = {2025},
+url = {https://github.com/TEN-framework/ten-turn-detection},
+}
+```
+## License 
+This project is Apache 2.0 licensed.

added_tokens.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:58b54bbe36fc752f79a24a271ef66a0a0830054b4dfad94bde757d851968060b
+size 605

config.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6aaefde58686ea3e34bcc715f6a5aa6f0d051aeeb6be1dd42941d99c33d2e254
+size 693

generation_config.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c5df43ff9c1194f0e3a5d81c3f1356d9745b7a7592d281bbc416c6c0ba92922
+size 248

merges.txt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5
+size 1671853

model-00001-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:93f2d70a82c10fb934a32fddfdc2e3e43b563754775329ec8b91d0700eeebc34
+size 4877660776

model-00002-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bddfa438eb53fbd10a57ce87bb040600168e114ea8639842e0426aaaf3e34c72
+size 4932751008

model-00003-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20130a8e36107fe3d40f0ad004bdc4ca317cc307fc2fc7f4fbc6add3bd6e0296
+size 4330865200

model-00004-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b1e8c52badc20cc238b97982a29e9668c2689d9dc97c51778e929e12cc9cdbe
+size 1089994880

model.safetensors.index.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:998a078123ffc97763690de7f2a677eb89168af5eaf8a5e12e6bc24d18e25bdb
+size 27752

special_tokens_map.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd
+size 613

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
+size 11421896

tokenizer_config.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8a5e6a9efdf4606caa92aab4ea9d2b36ce2af1148b00a6db7af33eacfddb98e2
+size 7363

vocab.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
+size 2776833