Transformers
PyTorch
I-SPIn
Lutech-admin commited on
Commit
dd7e27e
·
1 Parent(s): 7f4132e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -170,8 +170,23 @@ model = ISPIn.from_pretrained('[your/path]/I-SPIn')
170
  ```
171
 
172
  ## Full model architecture
173
- #TODO
 
 
 
 
 
 
 
 
 
 
 
174
 
175
 
176
  ## Evaluation results
177
  #TODO
 
 
 
 
 
170
  ```
171
 
172
  ## Full model architecture
173
+ ISPIn(
174
+ (encoder): XLMRobertaModel(...) # same architecture as [paraphrase-multilingual-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-multilingual-mpnet-base-v2)
175
+ (layers): ModuleList(
176
+ (0): Linear(in_features=1536, out_features=1024, bias=True)
177
+ (1): Linear(in_features=1024, out_features=512, bias=True)
178
+ (2): Linear(in_features=512, out_features=256, bias=True)
179
+ (3): Linear(in_features=256, out_features=128, bias=True)
180
+ (4): Linear(in_features=128, out_features=64, bias=True)
181
+ (5): Linear(in_features=64, out_features=3, bias=True)
182
+ )
183
+ (activation): GELU()
184
+ )
185
 
186
 
187
  ## Evaluation results
188
  #TODO
189
+
190
+ ## Next steps
191
+ 1. Create an open library called ISPIn that lets the user to run directly the model without adding any additional code to a project.
192
+ 2. ...