Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -20,7 +20,7 @@ There are two models that we developed:
|
|
| 20 |
RoSBERTa is based on [ai-forever/ru-en-RoSBERTa](https://huggingface.co/ai-forever/ru-en-RoSBERTa) with multiple heads for downstream tasks:
|
| 21 |
- **Backbone**: Fully unfrozen, with the **NER head** fine-tuned for location recognition.
|
| 22 |
- **Allocator head**: Trained to determine whether or not a message contains the actual location of the user.
|
| 23 |
-
- **
|
| 24 |
|
| 25 |
### [rubert-tiny-separater](https://huggingface.co/poc-embeddings/rubert-tiny-separater)
|
| 26 |
Rubert is based on [sergeyzh/rubert-tiny-turbo](https://huggingface.co/sergeyzh/rubert-tiny-turbo) with a linear layer on top. The whole model was trained for classifying message types from Telegram marketplaces.
|
|
|
|
| 20 |
RoSBERTa is based on [ai-forever/ru-en-RoSBERTa](https://huggingface.co/ai-forever/ru-en-RoSBERTa) with multiple heads for downstream tasks:
|
| 21 |
- **Backbone**: Fully unfrozen, with the **NER head** fine-tuned for location recognition.
|
| 22 |
- **Allocator head**: Trained to determine whether or not a message contains the actual location of the user.
|
| 23 |
+
- **Tags head with 1 layer of adapter**: Trained to mark messages with different categories describing the message's context, such as tools, medicine, clothing, and more.
|
| 24 |
|
| 25 |
### [rubert-tiny-separater](https://huggingface.co/poc-embeddings/rubert-tiny-separater)
|
| 26 |
Rubert is based on [sergeyzh/rubert-tiny-turbo](https://huggingface.co/sergeyzh/rubert-tiny-turbo) with a linear layer on top. The whole model was trained for classifying message types from Telegram marketplaces.
|