Update README.md

README.md

@@ -1 +1,17 @@
-hello
+# PrivBERT 
+
+PrivBERT is a privacy policy language model. We pre-trained PrivBERT on ~1 million privacy policies starting from the pretrained Roberta model. 
+
+## Usage
+
+from transformers import AutoTokenizer, AutoModel
+tokenizer = AutoTokenizer.from_pretrained("mukund/privbert")
+model = AutoModel.from_pretrained("model_name")
+
+## License 
+
+If you use this dataset in research, you must cite the below paper.
+
+Mukund Srinath, Shomir Wilson and C. Lee Giles. Privacy at Scale: Introducing the PrivaSeer Corpus of Web Privacy Policies. In Proc. ACL 2021.
+
+For research, teaching, and scholarship purposes, the model is available under a CC BY-NC-SA license. Please contact us for any requests regarding commercial use.