Instructions to use Lutech-AI/I-SPIn with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Lutech-AI/I-SPIn with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import ISPIn model = ISPIn.from_pretrained("Lutech-AI/I-SPIn", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
dd7e27e
1
Parent(s): 7f4132e
Update README.md
Browse files
README.md
CHANGED
|
@@ -170,8 +170,23 @@ model = ISPIn.from_pretrained('[your/path]/I-SPIn')
|
|
| 170 |
```
|
| 171 |
|
| 172 |
## Full model architecture
|
| 173 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 174 |
|
| 175 |
|
| 176 |
## Evaluation results
|
| 177 |
#TODO
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 170 |
```
|
| 171 |
|
| 172 |
## Full model architecture
|
| 173 |
+
ISPIn(
|
| 174 |
+
(encoder): XLMRobertaModel(...) # same architecture as [paraphrase-multilingual-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-multilingual-mpnet-base-v2)
|
| 175 |
+
(layers): ModuleList(
|
| 176 |
+
(0): Linear(in_features=1536, out_features=1024, bias=True)
|
| 177 |
+
(1): Linear(in_features=1024, out_features=512, bias=True)
|
| 178 |
+
(2): Linear(in_features=512, out_features=256, bias=True)
|
| 179 |
+
(3): Linear(in_features=256, out_features=128, bias=True)
|
| 180 |
+
(4): Linear(in_features=128, out_features=64, bias=True)
|
| 181 |
+
(5): Linear(in_features=64, out_features=3, bias=True)
|
| 182 |
+
)
|
| 183 |
+
(activation): GELU()
|
| 184 |
+
)
|
| 185 |
|
| 186 |
|
| 187 |
## Evaluation results
|
| 188 |
#TODO
|
| 189 |
+
|
| 190 |
+
## Next steps
|
| 191 |
+
1. Create an open library called ISPIn that lets the user to run directly the model without adding any additional code to a project.
|
| 192 |
+
2. ...
|