Spaces:
Running
Running
Yang Chung
commited on
Commit
Β·
97b35c5
1
Parent(s):
796d7d6
Update with illicit numbers
Browse files- README.md +7 -7
- index.html +11 -11
README.md
CHANGED
|
@@ -28,8 +28,8 @@ Comprehensive evaluation datasets for testing AI model safety mechanisms
|
|
| 28 |
|
| 29 |
| Metric | Value |
|
| 30 |
|--------|-------|
|
| 31 |
-
| **Total Conversations** |
|
| 32 |
-
| **Total Turns** |
|
| 33 |
| **Dataset Types** | 3 complementary methodologies |
|
| 34 |
| **Sample Data Available** | 150 conversations |
|
| 35 |
|
|
@@ -38,25 +38,25 @@ Comprehensive evaluation datasets for testing AI model safety mechanisms
|
|
| 38 |
| Dataset | Conversations | Turns | Avg Turns/Conv | Focus |
|
| 39 |
|---------|--------------|-------|----------------|--------|
|
| 40 |
| **Psychology multi-turn** | 207+ | 2,128+ | 10.3 | Psychology harmfulness such as self-harm, psychosis, anthropomorphism, etc. |
|
| 41 |
-
| **Illicit (bioweapon) multi-turn** |
|
| 42 |
-
| **Illicit (chemical, general) multi-turn** |
|
| 43 |
|
| 44 |
## π Access Datasets on Hugging Face
|
| 45 |
|
| 46 |
### Psychology Multi-turn Conversations
|
| 47 |
-
Psychology
|
| 48 |
**Sample:** 50 conversations, 390 turns
|
| 49 |
|
| 50 |
π **[View Dataset](https://huggingface.co/datasets/GoJulyAI/multi-turn-conversations)**
|
| 51 |
|
| 52 |
### Illicit (bioweapon) Multi-turn Conversations
|
| 53 |
-
|
| 54 |
**Sample:** 50 conversations, 449 turns
|
| 55 |
|
| 56 |
π **[View Dataset](https://huggingface.co/datasets/GoJulyAI/multi-turn-bio-transformed-synth-conversations-v1)**
|
| 57 |
|
| 58 |
### Illicit (chemical, general) Multi-turn Conversations
|
| 59 |
-
|
| 60 |
**Sample:** 50 conversations, 459 turns
|
| 61 |
|
| 62 |
π **[View Dataset](https://huggingface.co/datasets/GoJulyAI/multi-turn-bio-transformed-synth-conversations-v2)**
|
|
|
|
| 28 |
|
| 29 |
| Metric | Value |
|
| 30 |
|--------|-------|
|
| 31 |
+
| **Total Conversations** | 979+ |
|
| 32 |
+
| **Total Turns** | 7,706+ |
|
| 33 |
| **Dataset Types** | 3 complementary methodologies |
|
| 34 |
| **Sample Data Available** | 150 conversations |
|
| 35 |
|
|
|
|
| 38 |
| Dataset | Conversations | Turns | Avg Turns/Conv | Focus |
|
| 39 |
|---------|--------------|-------|----------------|--------|
|
| 40 |
| **Psychology multi-turn** | 207+ | 2,128+ | 10.3 | Psychology harmfulness such as self-harm, psychosis, anthropomorphism, etc. |
|
| 41 |
+
| **Illicit (bioweapon) multi-turn** | 102+ | 1,038+ | 10.2 | Bio-safety harmfulness such as bioweapons, pathogens, etc. |
|
| 42 |
+
| **Illicit (chemical, general) multi-turn** | 670+ | 4,540+ | 6.8 | Non-bio safety harmfulness such as chemical weapons, cyber threats, etc. |
|
| 43 |
|
| 44 |
## π Access Datasets on Hugging Face
|
| 45 |
|
| 46 |
### Psychology Multi-turn Conversations
|
| 47 |
+
Psychology harmfulness such as self-harm, psychosis, anthropomorphism, etc.
|
| 48 |
**Sample:** 50 conversations, 390 turns
|
| 49 |
|
| 50 |
π **[View Dataset](https://huggingface.co/datasets/GoJulyAI/multi-turn-conversations)**
|
| 51 |
|
| 52 |
### Illicit (bioweapon) Multi-turn Conversations
|
| 53 |
+
Bio-safety harmfulness such as bioweapons, pathogens, etc.
|
| 54 |
**Sample:** 50 conversations, 449 turns
|
| 55 |
|
| 56 |
π **[View Dataset](https://huggingface.co/datasets/GoJulyAI/multi-turn-bio-transformed-synth-conversations-v1)**
|
| 57 |
|
| 58 |
### Illicit (chemical, general) Multi-turn Conversations
|
| 59 |
+
Non-bio safety harmfulness such as chemical weapons, cyber threats, etc.
|
| 60 |
**Sample:** 50 conversations, 459 turns
|
| 61 |
|
| 62 |
π **[View Dataset](https://huggingface.co/datasets/GoJulyAI/multi-turn-bio-transformed-synth-conversations-v2)**
|
index.html
CHANGED
|
@@ -243,12 +243,12 @@
|
|
| 243 |
<div class="stats-grid">
|
| 244 |
<div class="stat-card">
|
| 245 |
<h4>Total Conversations</h4>
|
| 246 |
-
<div class="number">
|
| 247 |
<div class="label">Across all datasets</div>
|
| 248 |
</div>
|
| 249 |
<div class="stat-card">
|
| 250 |
<h4>Total Turns</h4>
|
| 251 |
-
<div class="number">
|
| 252 |
<div class="label">Multi-turn interactions</div>
|
| 253 |
</div>
|
| 254 |
<div class="stat-card">
|
|
@@ -287,16 +287,16 @@
|
|
| 287 |
</tr>
|
| 288 |
<tr>
|
| 289 |
<td><strong>Illicit (bioweapon) multi-turn</strong></td>
|
| 290 |
-
<td>
|
| 291 |
-
<td>
|
| 292 |
-
<td>
|
| 293 |
<td>Bio-safety harmfulness such as bioweapons, pathogens, etc.</td>
|
| 294 |
</tr>
|
| 295 |
<tr>
|
| 296 |
<td><strong>Illicit (chemical, general) multi-turn</strong></td>
|
| 297 |
-
<td>
|
| 298 |
-
<td>
|
| 299 |
-
<td>6.
|
| 300 |
<td>Non-bio safety harmfulness such as chemical weapons, cyber threats, etc.</td>
|
| 301 |
</tr>
|
| 302 |
</tbody>
|
|
@@ -309,19 +309,19 @@
|
|
| 309 |
<div class="dataset-links">
|
| 310 |
<div class="dataset-card">
|
| 311 |
<h4>Psychology Multi-turn Conversations</h4>
|
| 312 |
-
<p>Psychology
|
| 313 |
<strong>Sample:</strong> 50 conversations, 390 turns</p>
|
| 314 |
<a href="https://huggingface.co/datasets/GoJulyAI/multi-turn-conversations" class="btn" target="_blank">View Dataset β</a>
|
| 315 |
</div>
|
| 316 |
<div class="dataset-card">
|
| 317 |
<h4>Illicit (bioweapon) Multi-turn Conversations</h4>
|
| 318 |
-
<p>
|
| 319 |
<strong>Sample:</strong> 50 conversations, 449 turns</p>
|
| 320 |
<a href="https://huggingface.co/datasets/GoJulyAI/multi-turn-bio-transformed-synth-conversations-v1" class="btn" target="_blank">View Dataset β</a>
|
| 321 |
</div>
|
| 322 |
<div class="dataset-card">
|
| 323 |
<h4>Illicit (chemical, general) Multi-turn Conversations</h4>
|
| 324 |
-
<p>
|
| 325 |
<strong>Sample:</strong> 50 conversations, 459 turns</p>
|
| 326 |
<a href="https://huggingface.co/datasets/GoJulyAI/multi-turn-bio-transformed-synth-conversations-v2" class="btn" target="_blank">View Dataset β</a>
|
| 327 |
</div>
|
|
|
|
| 243 |
<div class="stats-grid">
|
| 244 |
<div class="stat-card">
|
| 245 |
<h4>Total Conversations</h4>
|
| 246 |
+
<div class="number">979+</div>
|
| 247 |
<div class="label">Across all datasets</div>
|
| 248 |
</div>
|
| 249 |
<div class="stat-card">
|
| 250 |
<h4>Total Turns</h4>
|
| 251 |
+
<div class="number">7,706+</div>
|
| 252 |
<div class="label">Multi-turn interactions</div>
|
| 253 |
</div>
|
| 254 |
<div class="stat-card">
|
|
|
|
| 287 |
</tr>
|
| 288 |
<tr>
|
| 289 |
<td><strong>Illicit (bioweapon) multi-turn</strong></td>
|
| 290 |
+
<td>102+</td>
|
| 291 |
+
<td>1038+</td>
|
| 292 |
+
<td>10.2</td>
|
| 293 |
<td>Bio-safety harmfulness such as bioweapons, pathogens, etc.</td>
|
| 294 |
</tr>
|
| 295 |
<tr>
|
| 296 |
<td><strong>Illicit (chemical, general) multi-turn</strong></td>
|
| 297 |
+
<td>670+</td>
|
| 298 |
+
<td>4540+</td>
|
| 299 |
+
<td>6.8</td>
|
| 300 |
<td>Non-bio safety harmfulness such as chemical weapons, cyber threats, etc.</td>
|
| 301 |
</tr>
|
| 302 |
</tbody>
|
|
|
|
| 309 |
<div class="dataset-links">
|
| 310 |
<div class="dataset-card">
|
| 311 |
<h4>Psychology Multi-turn Conversations</h4>
|
| 312 |
+
<p>Psychology harmfulness such as self-harm, psychosis, anthropomorphism, etc.<br>
|
| 313 |
<strong>Sample:</strong> 50 conversations, 390 turns</p>
|
| 314 |
<a href="https://huggingface.co/datasets/GoJulyAI/multi-turn-conversations" class="btn" target="_blank">View Dataset β</a>
|
| 315 |
</div>
|
| 316 |
<div class="dataset-card">
|
| 317 |
<h4>Illicit (bioweapon) Multi-turn Conversations</h4>
|
| 318 |
+
<p>Bio-safety harmfulness such as bioweapons, pathogens, etc.<br>
|
| 319 |
<strong>Sample:</strong> 50 conversations, 449 turns</p>
|
| 320 |
<a href="https://huggingface.co/datasets/GoJulyAI/multi-turn-bio-transformed-synth-conversations-v1" class="btn" target="_blank">View Dataset β</a>
|
| 321 |
</div>
|
| 322 |
<div class="dataset-card">
|
| 323 |
<h4>Illicit (chemical, general) Multi-turn Conversations</h4>
|
| 324 |
+
<p>Non-bio safety harmfulness such as chemical weapons, cyber threats, etc.<br>
|
| 325 |
<strong>Sample:</strong> 50 conversations, 459 turns</p>
|
| 326 |
<a href="https://huggingface.co/datasets/GoJulyAI/multi-turn-bio-transformed-synth-conversations-v2" class="btn" target="_blank">View Dataset β</a>
|
| 327 |
</div>
|