Update README.md

README.md

@@ -1,14 +1,24 @@
 ---
 language:
 - en
+license: llama2
+datasets:
+- EleutherAI/pile
+- Open-Orca/OpenOrca
+- GAIR/lima
+- WizardLM/WizardLM_evol_instruct_V2_196k
+metrics:
+- accuracy
+library_name: fairseq
+pipeline_tag: text-generation
 ---
 
-# Adapt Large Language Models to Domains
+# Adapt (Large) Language Models to Domains
 This repo contains the domain-specific chat model developed from LLaMA-2-Chat-7B, using the method in our paper [Adapting Large Language Models via Reading Comprehension](https://huggingface.co/papers/2309.09530).
 
 We explore **continued pre-training on domain-specific corpora** for large language models. While this approach enriches LLMs with domain knowledge, it significantly hurts their prompting ability for question answering. Inspired by human learning via reading comprehension, we propose a simple method to **transform large-scale pre-training corpora into reading comprehension texts**, consistently improving prompting performance across tasks in biomedicine, finance, and law domains. **Our 7B model competes with much larger domain-specific models like BloombergGPT-50B**. 
 
-### 🤗 We are currently working hard on developing models across different domains, scales and architectures! please stay tuned! 🤗
+### 🤗 We are currently working hard on developing models across different domains, scales and architectures! Please stay tuned! 🤗
 
 **************************** **Updates** ****************************
 * 12/8: Released our [chat models](https://huggingface.co/AdaptLLM/finance-chat) developed from LLaMA-2-Chat-7B.
@@ -68,4 +78,4 @@ If you find our work helpful, please cite us:
   volume       = {abs/2309.09530},
   year         = {2023}
 }
-```
+```