Update README.md
Browse files
README.md
CHANGED
|
@@ -105,19 +105,25 @@ Evaluation to come.
|
|
| 105 |
|
| 106 |
**A:** In terms of flexibility, this model is better. Performance wise, in most of the experiments this model is also better.
|
| 107 |
|
|
|
|
| 108 |
**Q: What is the difference between V3 and V3b?**
|
| 109 |
-
A
|
|
|
|
| 110 |
If you want peak performance and do not worry too much about recent developments, take this one (V3b).
|
|
|
|
| 111 |
If you are fine with sacrificing a few points on benchmarks and want the model to know what happened from 2020 on (elections, covid, other cultural events etc.), I'd suggest you use [German_Semantic_V3](https://huggingface.co/aari1995/German_Semantic_V3).
|
| 112 |
|
|
|
|
| 113 |
**Q: How does the model perform vs. multilingual models?**
|
| 114 |
|
| 115 |
**A:** There are really great multilingual models that will be very useful for many use-cases. This model shines with its cultural knowledge and knowledge about German people and behaviour.
|
| 116 |
|
|
|
|
| 117 |
**Q: What is the trade-off when reducing the embedding size?**
|
| 118 |
|
| 119 |
**A:** Broadly speaking, when going from 1024 to 512 dimensions, there is very little trade-off (1 percent). When going down to 64 dimensions, you may face a decrease of up to 3 percent.
|
| 120 |
|
|
|
|
| 121 |
## Up next:
|
| 122 |
German_Semantic_V3_Instruct: Guiding your embeddings towards self-selected aspects
|
| 123 |
|
|
|
|
| 105 |
|
| 106 |
**A:** In terms of flexibility, this model is better. Performance wise, in most of the experiments this model is also better.
|
| 107 |
|
| 108 |
+
|
| 109 |
**Q: What is the difference between V3 and V3b?**
|
| 110 |
+
**A:** V3 is slightly worse on benchmarks, while V3b has a knowledge cutoff by 2020, so it really depends on your use-case what model to use.
|
| 111 |
+
|
| 112 |
If you want peak performance and do not worry too much about recent developments, take this one (V3b).
|
| 113 |
+
|
| 114 |
If you are fine with sacrificing a few points on benchmarks and want the model to know what happened from 2020 on (elections, covid, other cultural events etc.), I'd suggest you use [German_Semantic_V3](https://huggingface.co/aari1995/German_Semantic_V3).
|
| 115 |
|
| 116 |
+
|
| 117 |
**Q: How does the model perform vs. multilingual models?**
|
| 118 |
|
| 119 |
**A:** There are really great multilingual models that will be very useful for many use-cases. This model shines with its cultural knowledge and knowledge about German people and behaviour.
|
| 120 |
|
| 121 |
+
|
| 122 |
**Q: What is the trade-off when reducing the embedding size?**
|
| 123 |
|
| 124 |
**A:** Broadly speaking, when going from 1024 to 512 dimensions, there is very little trade-off (1 percent). When going down to 64 dimensions, you may face a decrease of up to 3 percent.
|
| 125 |
|
| 126 |
+
|
| 127 |
## Up next:
|
| 128 |
German_Semantic_V3_Instruct: Guiding your embeddings towards self-selected aspects
|
| 129 |
|