Update README.md
Browse files
README.md
CHANGED
|
@@ -9,5 +9,81 @@ tags:
|
|
| 9 |
- materials
|
| 10 |
---
|
| 11 |
# BatterySciBERT-uncased for Battery Abstract Multi-label Classification
|
| 12 |
-
This model is a fine-tuned version
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
- materials
|
| 10 |
---
|
| 11 |
# BatterySciBERT-uncased for Battery Abstract Multi-label Classification
|
| 12 |
+
This new model is a fine-tuned version
|
| 13 |
+
of the [BatterySciBERT-uncased model](https://huggingface.co/batterydata/batteryscibert-uncased) on a few-sample dataset
|
| 14 |
+
of 1140
|
| 15 |
+
abstract of paper.
|
| 16 |
+
This model is uncased.
|
| 17 |
+
|
| 18 |
+
## Hyperparameters
|
| 19 |
+
|
| 20 |
+
```
|
| 21 |
+
batch_size = 4
|
| 22 |
+
n_epochs = 16
|
| 23 |
+
base_LM_model = "batteryscibert-uncased"
|
| 24 |
+
learning_rate = 3e-5
|
| 25 |
+
```
|
| 26 |
+
|
| 27 |
+
## Performance
|
| 28 |
+
|
| 29 |
+
```
|
| 30 |
+
"Validation Micro F1-score": 94.54,
|
| 31 |
+
"Test Micro F1-score": 93.42,
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
### Details on the test set
|
| 35 |
+
|
| 36 |
+
|
| 37 |
+
<table border="2" valign="center">
|
| 38 |
+
<tbody>
|
| 39 |
+
<tr>
|
| 40 |
+
<th colspan="2" align="left">Predicted Label</th>
|
| 41 |
+
<th align="center">Precision</th>
|
| 42 |
+
<th align="center">Recall</th>
|
| 43 |
+
<th align="center">F1 score</th>
|
| 44 |
+
</tr>
|
| 45 |
+
<tr>
|
| 46 |
+
<td colspan="2"><i>Coating</i></td>
|
| 47 |
+
<td align="center">95.83%</td>
|
| 48 |
+
<td align="center">76.67%</td>
|
| 49 |
+
<td align="center">85.19%</td>
|
| 50 |
+
</tr>
|
| 51 |
+
<tr>
|
| 52 |
+
<td colspan="2"><i>Computation</i></td>
|
| 53 |
+
<td align="center">86.96%</td>
|
| 54 |
+
<td align="center">90.90%</td>
|
| 55 |
+
<td align="center">88.89%</td>
|
| 56 |
+
</tr>
|
| 57 |
+
<tr>
|
| 58 |
+
<td colspan="2"><i>Doping</i></td>
|
| 59 |
+
<td align="center">96.30%</td>
|
| 60 |
+
<td align="center">100%</td>
|
| 61 |
+
<td align="center">98.11%</td>
|
| 62 |
+
</tr>
|
| 63 |
+
<tr>
|
| 64 |
+
<td colspan="2"><i>Experiment</i></td>
|
| 65 |
+
<td align="center">98.02%</td>
|
| 66 |
+
<td align="center">93.40%</td>
|
| 67 |
+
<td align="center">95.65%</td>
|
| 68 |
+
</tr>
|
| 69 |
+
<tr>
|
| 70 |
+
<td colspan="2"><i>Sodium layered oxide cathode</i></td>
|
| 71 |
+
<td align="center">93.75%</td>
|
| 72 |
+
<td align="center">91.84%</td>
|
| 73 |
+
<td align="center">92.78%</td>
|
| 74 |
+
</tr>
|
| 75 |
+
<tr>
|
| 76 |
+
<td rowspan="2"><i>Aggregate Metric</i></td>
|
| 77 |
+
<td><i>Micro average</i></td>
|
| 78 |
+
<td align="center"><b>95.51%</b></td>
|
| 79 |
+
<td align="center"><b>91.42%</b></td>
|
| 80 |
+
<td align="center"><b>93.42%</b></td>
|
| 81 |
+
</tr>
|
| 82 |
+
<tr>
|
| 83 |
+
<td><i>Macro average</i></td>
|
| 84 |
+
<td align="center">94.17%</td>
|
| 85 |
+
<td align="center">90.56%</td>
|
| 86 |
+
<td align="center">92.12%</td>
|
| 87 |
+
</tr>
|
| 88 |
+
</tbody>
|
| 89 |
+
</table>
|