Update README.md

README.md

@@ -12,7 +12,9 @@ tags:
 
 # PB - a llama lora 7b
 
-This lora was trained on 250k post and response pairs from 43 different fincial, investing, and crypto subreddits. It is not an instruct model, it is designed to generate a reply to a reddit text post. It was an experiment in fine tuning for specific tasks. Use it responsibly. 
+This lora was trained on 250k post and response pairs from 43 different fincial, investing, and crypto subreddits. It is not an instruct model, it is designed to generate a reply to a reddit text post. It was an experiment in fine tuning for specific tasks. 
+
+**Use it responsibly. 
 
 * Training code will be released soon.
 * Dataset and tools for building the dataset will be released soon.
@@ -37,6 +39,26 @@ This lora was trained on 250k post and response pairs from 43 different fincial,
 | lora_dropout   | 0.05     |
 | lora_target_modules | ["q_proj", "v_proj"] | 
 
+### Training Dataset
+
+- 250000 post and top comment pairs from 43 finacial, investing and crypto subreddits. Only text posts were selected for this version. And the highest scoring comment and posts counts were selected from each subreddit after normalization. All data is pre 2023. 
+
+| subreddit             ┆ count ┆ mean_combined_score ┆ max_combined_score ┆ min_combined_score |
+| ---                   ┆ ---   ┆ ---                 ┆ ---                ┆ ---                |
+| str                   ┆ u32   ┆ f64                 ┆ f64                ┆ f64                |
+|-----------------------|-------|---------------------|--------------------|--------------------|
+| Superstonk            ┆ 30273 ┆ 0.088001            ┆ 1.635084           ┆ 0.01521            |
+| personalfinance       ┆ 16312 ┆ 0.074437            ┆ 1.177334           ┆ 0.015211           |
+| investing             ┆ 13568 ┆ 0.072706            ┆ 1.238456           ┆ 0.015209           |
+| fatFIRE               ┆ 11856 ┆ 0.096088            ┆ 1.287826           ┆ 0.015216           |
+| …                     ┆ …     ┆ …                   ┆ …                  ┆ …                  |
+| Wallstreetbetsnew     ┆ 346   ┆ 0.06797             ┆ 2.0                ┆ 0.01525            |
+| CryptoCurrencyTrading ┆ 194   ┆ 0.127064            ┆ 1.525351           ┆ 0.016771           |
+| crypto_currency       ┆ 186   ┆ 0.694596            ┆ 1.101901           ┆ 0.026738           |
+| StocksAndTrading      ┆ 93    ┆ 0.184637            ┆ 1.704545           ┆ 0.019066           |
+
+* to be released soon along with code to recreate it
+
 
 ## Usage