Add library_name, pipeline_tag, and links to paper and code
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,17 +1,21 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
| 2 |
language: en
|
| 3 |
license: apache-2.0
|
| 4 |
tags:
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
---
|
| 11 |
|
| 12 |
# OmniSapiens SFT
|
| 13 |
|
| 14 |
-
Fine-tuned [Qwen2.5-Omni-7B](https://huggingface.co/Qwen/Qwen2.5-Omni-7B) for human behavior understanding.
|
|
|
|
|
|
|
| 15 |
|
| 16 |
## Benchmark
|
| 17 |
Evaluated on [keentomato/human_behavior_atlas](https://huggingface.co/datasets/keentomato/human_behavior_atlas).
|
|
@@ -99,4 +103,4 @@ with torch.no_grad():
|
|
| 99 |
|
| 100 |
answer = processor.decode(generated[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True)
|
| 101 |
print(answer)
|
| 102 |
-
```
|
|
|
|
| 1 |
---
|
| 2 |
+
datasets:
|
| 3 |
+
- keentomato/human_behavior_atlas
|
| 4 |
language: en
|
| 5 |
license: apache-2.0
|
| 6 |
tags:
|
| 7 |
+
- human-behavior
|
| 8 |
+
- multimodal
|
| 9 |
+
- qwen2.5-omni
|
| 10 |
+
pipeline_tag: any-to-any
|
| 11 |
+
library_name: transformers
|
| 12 |
---
|
| 13 |
|
| 14 |
# OmniSapiens SFT
|
| 15 |
|
| 16 |
+
Fine-tuned [Qwen2.5-Omni-7B](https://huggingface.co/Qwen/Qwen2.5-Omni-7B) for human behavior understanding. This model was introduced in the paper [OmniSapiens: A Foundation Model for Social Behavior Processing via Heterogeneity-Aware Relative Policy Optimization](https://huggingface.co/papers/2602.10635).
|
| 17 |
+
|
| 18 |
+
**Official Code:** [https://github.com/MIT-MI/human_behavior_atlas](https://github.com/MIT-MI/human_behavior_atlas)
|
| 19 |
|
| 20 |
## Benchmark
|
| 21 |
Evaluated on [keentomato/human_behavior_atlas](https://huggingface.co/datasets/keentomato/human_behavior_atlas).
|
|
|
|
| 103 |
|
| 104 |
answer = processor.decode(generated[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True)
|
| 105 |
print(answer)
|
| 106 |
+
```
|