shuaifan commited on
Commit
c4ce727
·
1 Parent(s): 3dbf226

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -1,5 +1,18 @@
1
  # SentiWSP
2
  ## For paper: Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis
 
 
 
 
3
 
 
 
 
 
 
 
 
 
 
4
 
5
 
 
1
  # SentiWSP
2
  ## For paper: Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis
3
+ We propose **SentiWSP**, a novel **Senti**ment-aware pre-trained language model with combined **W**ord-level and **S**entence-level **P**re-training tasks.
4
+ The word level pre-training task detects replaced sentiment words, via a generator-discriminator framework, to enhance the PLM's knowledge about sentiment words.
5
+ The sentence level pre-training task further strengthens the discriminator via a contrastive learning framework, with similar sentences as negative samples, to encode sentiments in a sentence.
6
+ Extensive experimental results show that SentiWSP achieves new state-of-the-art performance on various sentence-level and aspect-level sentiment classification benchmarks.
7
 
8
+ ## Load our model
9
+ =You can also load our model in huggingface ([https://huggingface.co/shuaifan/SentiWSP](https://huggingface.co/shuaifan/SentiWSP)):
10
+ ```python
11
+ import torch
12
+ from transformers import ElectraForSequenceClassion, ElectraTokenizer
13
+
14
+ model = ElectraForSequenceClassification.from_pretrained("shuaifan/SentiWSP")
15
+ tokenizer = ElectraTokenizer.from_pretrained("shuaifan/SentiWSP")
16
+ ```
17
 
18