Feature Extraction
Transformers
English
retrieval
reasoning
embedding
BRIGHT
information-retrieval
Eval Results (legacy)
Instructions to use ForwardAILabs/MRE-T1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ForwardAILabs/MRE-T1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="ForwardAILabs/MRE-T1")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ForwardAILabs/MRE-T1", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -93,14 +93,14 @@ MRE-T1 achieves state-of-the-art single-model performance on the [BRIGHT benchma
|
|
| 93 |
|
| 94 |
| Task | MRE-T1 |
|
| 95 |
|------|--------|
|
| 96 |
-
| Biology |
|
| 97 |
-
| Earth Science |
|
| 98 |
-
| Economics |
|
| 99 |
-
| Psychology |
|
| 100 |
-
| Robotics |
|
| 101 |
-
| StackOverflow |
|
| 102 |
-
| Sustainable Living |
|
| 103 |
-
| Pony |
|
| 104 |
| **Average** | **35.1** |
|
| 105 |
|
| 106 |
### Comparison with Other Models (Short, Single Model Only)
|
|
|
|
| 93 |
|
| 94 |
| Task | MRE-T1 |
|
| 95 |
|------|--------|
|
| 96 |
+
| Biology | 46.5 |
|
| 97 |
+
| Earth Science | 46 |
|
| 98 |
+
| Economics | 34.5 |
|
| 99 |
+
| Psychology | 52.7 |
|
| 100 |
+
| Robotics | 27.7 |
|
| 101 |
+
| StackOverflow | 22.2 |
|
| 102 |
+
| Sustainable Living | 45.2 |
|
| 103 |
+
| Pony | 6.3 |
|
| 104 |
| **Average** | **35.1** |
|
| 105 |
|
| 106 |
### Comparison with Other Models (Short, Single Model Only)
|