cleanup
Browse files- .gitignore +1 -0
- .idea/.gitignore +0 -10
- readme.md → README.md +5 -2
.gitignore
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
.idea
|
.idea/.gitignore
DELETED
|
@@ -1,10 +0,0 @@
|
|
| 1 |
-
# Default ignored files
|
| 2 |
-
/shelf/
|
| 3 |
-
/workspace.xml
|
| 4 |
-
# Editor-based HTTP Client requests
|
| 5 |
-
/httpRequests/
|
| 6 |
-
# Datasource local storage ignored files
|
| 7 |
-
/dataSources/
|
| 8 |
-
/dataSources.local.xml
|
| 9 |
-
|
| 10 |
-
.idea
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
readme.md → README.md
RENAMED
|
@@ -1,6 +1,7 @@
|
|
| 1 |
# Material SciBERT (TPU)
|
| 2 |
|
| 3 |
Goal: Improving language understanding in materials science
|
|
|
|
| 4 |
**Work in progress**
|
| 5 |
|
| 6 |
## Related work
|
|
@@ -18,7 +19,6 @@ Goal: Improving language understanding in materials science
|
|
| 18 |
- MatBERT (CEDER): BERT, from scratch, 2M documents on materials science (~60M paragraphs) https://github.com/lbnlp/MatBERT
|
| 19 |
- BatteryBERT (Cole): BERT, mixed from scratch and with predefined weights https://github.com/ShuHuang/batterybert/
|
| 20 |
|
| 21 |
-
|
| 22 |
### Results
|
| 23 |
|
| 24 |
Results obtained via 10-fold cross-validation, using DeLFT (https://github.com/kermitt2/delft)
|
|
@@ -43,9 +43,12 @@ Results obtained via 10-fold cross-validation, using DeLFT (https://github.com/k
|
|
| 43 |
| MatBERT (Ceder) | 85.08% | 89.93% | 87.44% |
|
| 44 |
| BatteryScibert-cased | 85.02% | 89.30% | 87.11% |
|
| 45 |
| BatteryScibert-cased | 81.09% | 84.14% | 82.59% |
|
| 46 |
-
|
| 47 |
|
| 48 |
## References
|
| 49 |
|
| 50 |
This work was supported by Google, through the researchers program https://cloud.google.com/edu/researchers
|
| 51 |
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# Material SciBERT (TPU)
|
| 2 |
|
| 3 |
Goal: Improving language understanding in materials science
|
| 4 |
+
|
| 5 |
**Work in progress**
|
| 6 |
|
| 7 |
## Related work
|
|
|
|
| 19 |
- MatBERT (CEDER): BERT, from scratch, 2M documents on materials science (~60M paragraphs) https://github.com/lbnlp/MatBERT
|
| 20 |
- BatteryBERT (Cole): BERT, mixed from scratch and with predefined weights https://github.com/ShuHuang/batterybert/
|
| 21 |
|
|
|
|
| 22 |
### Results
|
| 23 |
|
| 24 |
Results obtained via 10-fold cross-validation, using DeLFT (https://github.com/kermitt2/delft)
|
|
|
|
| 43 |
| MatBERT (Ceder) | 85.08% | 89.93% | 87.44% |
|
| 44 |
| BatteryScibert-cased | 85.02% | 89.30% | 87.11% |
|
| 45 |
| BatteryScibert-cased | 81.09% | 84.14% | 82.59% |
|
| 46 |
+
|
| 47 |
|
| 48 |
## References
|
| 49 |
|
| 50 |
This work was supported by Google, through the researchers program https://cloud.google.com/edu/researchers
|
| 51 |
|
| 52 |
+
## Acknowledgements
|
| 53 |
+
|
| 54 |
+
TBA
|