Update README.md
Browse files
README.md
CHANGED
|
@@ -31,6 +31,10 @@ mask = inputs['attention_mask']
|
|
| 31 |
embeddings = ((full_embeddings * mask.unsqueeze(-1)).sum(1) / mask.sum(-1).unsqueeze(-1))
|
| 32 |
```
|
| 33 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
---
|
| 36 |
license: mit
|
|
|
|
| 31 |
embeddings = ((full_embeddings * mask.unsqueeze(-1)).sum(1) / mask.sum(-1).unsqueeze(-1))
|
| 32 |
```
|
| 33 |
|
| 34 |
+
## Decoder
|
| 35 |
+
|
| 36 |
+
There is also a [decoder model](https://huggingface.co/entropy/roberta_zinc_decoder) trained to reconstruct
|
| 37 |
+
inputs from embeddings
|
| 38 |
|
| 39 |
---
|
| 40 |
license: mit
|