Text Classification
Transformers
Safetensors
English
bert
ignorance-classification
knowledge-gap
epilepsy
biomedical
text-embeddings-inference
Instructions to use hunter-lab/sentence-level-ignorance-classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use hunter-lab/sentence-level-ignorance-classifier with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="hunter-lab/sentence-level-ignorance-classifier")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("hunter-lab/sentence-level-ignorance-classifier") model = AutoModelForSequenceClassification.from_pretrained("hunter-lab/sentence-level-ignorance-classifier", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -31,12 +31,12 @@ This model is a binary classifier that determines whether a sentence is a statem
|
|
| 31 |
- This model consists of a linear classification head on top of BioMedBERT, which is a BERT-based encoder (110 million parameters, 12 layers, 768 hidden).
|
| 32 |
- All layers besides 10, 11, and 12, the pooler, and classificaton head were frozen to reduce overfitting on the small training set.
|
| 33 |
|
| 34 |
-
- **Developed by:**
|
| 35 |
-
- **Funded by
|
| 36 |
-
- **Model type:**
|
| 37 |
-
- **Language(s) (NLP):**
|
| 38 |
-
- **License:**
|
| 39 |
-
- **Finetuned from model
|
| 40 |
|
| 41 |
### Model Sources [optional]
|
| 42 |
|
|
@@ -54,12 +54,7 @@ This model is a binary classifier that determines whether a sentence is a statem
|
|
| 54 |
A statement of ignorance, or knowledge gap statement, is a piece of text indicating a lack of knoweldge on some subject.
|
| 55 |
In the field of biomedical research, knowledge gap statements often indicate unanswered questions, which can be useful for researchers
|
| 56 |
looking for new topics of study. We built this sentence-level binary classifier so that researchers could parse through biomedical papers
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
in PubMed research papers.
|
| 61 |
-
|
| 62 |
-
[More Information Needed]
|
| 63 |
|
| 64 |
### Downstream Use [optional]
|
| 65 |
|
|
@@ -77,7 +72,10 @@ in PubMed research papers.
|
|
| 77 |
|
| 78 |
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
| 79 |
|
| 80 |
-
|
|
|
|
|
|
|
|
|
|
| 81 |
|
| 82 |
### Recommendations
|
| 83 |
|
|
@@ -89,7 +87,18 @@ Users (both direct and downstream) should be made aware of the risks, biases and
|
|
| 89 |
|
| 90 |
Use the code below to get started with the model.
|
| 91 |
|
| 92 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 93 |
|
| 94 |
## Training Details
|
| 95 |
|
|
|
|
| 31 |
- This model consists of a linear classification head on top of BioMedBERT, which is a BERT-based encoder (110 million parameters, 12 layers, 768 hidden).
|
| 32 |
- All layers besides 10, 11, and 12, the pooler, and classificaton head were frozen to reduce overfitting on the small training set.
|
| 33 |
|
| 34 |
+
- **Developed by:** Nathan Gelfand, Darya Shlyk
|
| 35 |
+
- **Funded by:** Larry Hunter
|
| 36 |
+
- **Model type:** Supervised fine-tune of a transformer-encoder for text classification
|
| 37 |
+
- **Language(s) (NLP):** English
|
| 38 |
+
- **License:** MIT
|
| 39 |
+
- **Finetuned from model:** microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract
|
| 40 |
|
| 41 |
### Model Sources [optional]
|
| 42 |
|
|
|
|
| 54 |
A statement of ignorance, or knowledge gap statement, is a piece of text indicating a lack of knoweldge on some subject.
|
| 55 |
In the field of biomedical research, knowledge gap statements often indicate unanswered questions, which can be useful for researchers
|
| 56 |
looking for new topics of study. We built this sentence-level binary classifier so that researchers could parse through biomedical papers
|
| 57 |
+
to identify research directives.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
|
| 59 |
### Downstream Use [optional]
|
| 60 |
|
|
|
|
| 72 |
|
| 73 |
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
| 74 |
|
| 75 |
+
This model was trained on a dataset of 937 annotated statements from articles about monogenic epilepsies. Due to the small dataset size, it is possible that
|
| 76 |
+
the classifier will perform better on statements related to monogenic epilepsies.
|
| 77 |
+
|
| 78 |
+
The statements
|
| 79 |
|
| 80 |
### Recommendations
|
| 81 |
|
|
|
|
| 87 |
|
| 88 |
Use the code below to get started with the model.
|
| 89 |
|
| 90 |
+
```python
|
| 91 |
+
!pip install transformers
|
| 92 |
+
from transformers import pipeline
|
| 93 |
+
|
| 94 |
+
classifier = pipeline("text-classification",model="hunter-lab/sentence-level-ignorance-classifier")
|
| 95 |
+
|
| 96 |
+
sentence = "Consequently, there is a pressing need to enhance basic mechanistic and clinical studies, with a focus on individual differences, to advance the exploration of BCAAs in treating neurological disorders and to provide more robust evidence supporting their clinical applications."
|
| 97 |
+
|
| 98 |
+
result = classifier(sentence)
|
| 99 |
+
|
| 100 |
+
print(result)
|
| 101 |
+
```
|
| 102 |
|
| 103 |
## Training Details
|
| 104 |
|