Spaces:
Runtime error
Runtime error
Trent
commited on
Commit
·
0d51b77
1
Parent(s):
6b6585e
Update pagination
Browse files
app.py
CHANGED
|
@@ -9,7 +9,7 @@ from backend.utils import load_gender_data
|
|
| 9 |
st.title('Demo using Flax-Sentence-Tranformers')
|
| 10 |
|
| 11 |
st.sidebar.title('Tasks')
|
| 12 |
-
menu = st.sidebar.radio("", options=["Sentence Similarity", "Asymmetric QA", "Search / Cluster",
|
| 13 |
"Gender Bias Evaluation"], index=0)
|
| 14 |
|
| 15 |
st.markdown('''
|
|
@@ -23,23 +23,28 @@ In addition, we trained [20 models](https://huggingface.co/flax-sentence-embeddi
|
|
| 23 |
We also uploaded [8 datasets](https://huggingface.co/flax-sentence-embeddings) specialized for Question Answering, Sentence-Similiarity and Gender Evaluation.
|
| 24 |
You can view our models and datasets [here](https://huggingface.co/flax-sentence-embeddings).
|
| 25 |
|
| 26 |
-
|
| 27 |
-
|-----------|---------------------------------------|-------|-------|-------|
|
| 28 |
-
| paraphrase-mpnet-base-v2 (previous SOTA) | 67.97 | 47.79 | 49.03 | 72.36 |
|
| 29 |
-
| all_datasets_v3_roberta-large (400k steps) | **70.22** | 50.12 | 52.18 | 75.28 |
|
| 30 |
|
|
|
|
|
|
|
| 31 |
## Contributions
|
| 32 |
-
|
| 33 |
-
- **20
|
| 34 |
- **8 Datasets** from Stackexchange and StackOverflow, PAWS, Gender Evaluation uploaded to HuggingFace Hub.
|
| 35 |
- **Achieve SOTA** on multiple general purpose Sentence Similarity evaluation tasks by utilizing large TPU memory to maximize
|
| 36 |
customized Contrastive Loss. [Full Evaluation here](https://docs.google.com/spreadsheets/d/1vXJrIg38cEaKjOG5y4I4PQwAQFUmCkohbViJ9zj_Emg/edit#gid=1809754143).
|
| 37 |
- **Gender Bias demonstration** that explores inherent bias in general purpose datasets.
|
| 38 |
- **Search / Clustering demonstration** that showcases real-world use-cases for Sentence Embeddings.
|
| 39 |
|
| 40 |
-
|
| 41 |
|
| 42 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
st.header('Sentence Similarity')
|
| 44 |
st.markdown('''
|
| 45 |
**Instructions**: You can compare the similarity of the main text with other texts of your choice. In the background,
|
|
|
|
| 9 |
st.title('Demo using Flax-Sentence-Tranformers')
|
| 10 |
|
| 11 |
st.sidebar.title('Tasks')
|
| 12 |
+
menu = st.sidebar.radio("", options=["Contributions & Evaluation", "Sentence Similarity", "Asymmetric QA", "Search / Cluster",
|
| 13 |
"Gender Bias Evaluation"], index=0)
|
| 14 |
|
| 15 |
st.markdown('''
|
|
|
|
| 23 |
We also uploaded [8 datasets](https://huggingface.co/flax-sentence-embeddings) specialized for Question Answering, Sentence-Similiarity and Gender Evaluation.
|
| 24 |
You can view our models and datasets [here](https://huggingface.co/flax-sentence-embeddings).
|
| 25 |
|
| 26 |
+
''')
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
+
if menu == "Contributions & Evaluation":
|
| 29 |
+
st.markdown('''
|
| 30 |
## Contributions
|
| 31 |
+
|
| 32 |
+
- **20 Sentence Embedding models** that can be utilized for Sentence Simliarity / Asymmetric QA / Search & Clustering.
|
| 33 |
- **8 Datasets** from Stackexchange and StackOverflow, PAWS, Gender Evaluation uploaded to HuggingFace Hub.
|
| 34 |
- **Achieve SOTA** on multiple general purpose Sentence Similarity evaluation tasks by utilizing large TPU memory to maximize
|
| 35 |
customized Contrastive Loss. [Full Evaluation here](https://docs.google.com/spreadsheets/d/1vXJrIg38cEaKjOG5y4I4PQwAQFUmCkohbViJ9zj_Emg/edit#gid=1809754143).
|
| 36 |
- **Gender Bias demonstration** that explores inherent bias in general purpose datasets.
|
| 37 |
- **Search / Clustering demonstration** that showcases real-world use-cases for Sentence Embeddings.
|
| 38 |
|
| 39 |
+
## Model Evaluations
|
| 40 |
|
| 41 |
+
| Model | [FullEvaluation](https://docs.google.com/spreadsheets/d/1vXJrIg38cEaKjOG5y4I4PQwAQFUmCkohbViJ9zj_Emg/edit#gid=1809754143) Average | 20Newsgroups Clustering | StackOverflow DupQuestions | Twitter SemEval2015 |
|
| 42 |
+
|-----------|---------------------------------------|-------|-------|-------|
|
| 43 |
+
| paraphrase-mpnet-base-v2 (previous SOTA) | 67.97 | 47.79 | 49.03 | 72.36 |
|
| 44 |
+
| all_datasets_v3_roberta-large (400k steps) | **70.22** | 50.12 | 52.18 | 75.28 |
|
| 45 |
+
| all_datasets_v3_mpnet-base (440k steps) | **70.01** | 50.22 | 52.24 | 76.27 |
|
| 46 |
+
''')
|
| 47 |
+
elif menu == "Sentence Similarity":
|
| 48 |
st.header('Sentence Similarity')
|
| 49 |
st.markdown('''
|
| 50 |
**Instructions**: You can compare the similarity of the main text with other texts of your choice. In the background,
|