poperskop commited on
Commit
58da1ea
·
verified ·
1 Parent(s): 3e9fed7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ There are two models that we developed:
20
  RoSBERTa is based on [ai-forever/ru-en-RoSBERTa](https://huggingface.co/ai-forever/ru-en-RoSBERTa) with multiple heads for downstream tasks:
21
  - **Backbone**: Fully unfrozen, with the **NER head** fine-tuned for location recognition.
22
  - **Allocator head**: Trained to determine whether or not a message contains the actual location of the user.
23
- - **Adapter and tags head**: Trained to mark messages with different categories describing the message's context, such as tools, medicine, clothing, and more.
24
 
25
  ### [rubert-tiny-separater](https://huggingface.co/poc-embeddings/rubert-tiny-separater)
26
  Rubert is based on [sergeyzh/rubert-tiny-turbo](https://huggingface.co/sergeyzh/rubert-tiny-turbo) with a linear layer on top. The whole model was trained for classifying message types from Telegram marketplaces.
 
20
  RoSBERTa is based on [ai-forever/ru-en-RoSBERTa](https://huggingface.co/ai-forever/ru-en-RoSBERTa) with multiple heads for downstream tasks:
21
  - **Backbone**: Fully unfrozen, with the **NER head** fine-tuned for location recognition.
22
  - **Allocator head**: Trained to determine whether or not a message contains the actual location of the user.
23
+ - **Tags head with 1 layer of adapter**: Trained to mark messages with different categories describing the message's context, such as tools, medicine, clothing, and more.
24
 
25
  ### [rubert-tiny-separater](https://huggingface.co/poc-embeddings/rubert-tiny-separater)
26
  Rubert is based on [sergeyzh/rubert-tiny-turbo](https://huggingface.co/sergeyzh/rubert-tiny-turbo) with a linear layer on top. The whole model was trained for classifying message types from Telegram marketplaces.