entropy commited on
Commit
83317ab
·
verified ·
1 Parent(s): 9700d2e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -3
README.md CHANGED
@@ -1,3 +1,9 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
1
+ # Roberta Zinc Compression Head
2
+
3
+ This model is trained to compress embeddings generated by the [roberta_zinc_480m](https://huggingface.co/entropy/roberta_zinc_480m) model from the native size of 768 to compressed sizes 512, 256, 128, 64, and 32.
4
+
5
+ The compressed embeddings are trained to maintain cosine similarity computed using the native embeddings.
6
+
7
+ ---
8
+ license: mit
9
+ ---