Update README.md

README.md

@@ -67,7 +67,7 @@ r = pipe(
     messages,
     max_length=4096, 
     do_sample=False,     
-    eos_token_id=tokenizer.vocab['<end_of_turn>']
+    eos_token_id=[tokenizer.vocab['<end_of_turn>'], tokenizer.eos_token_id],
 )
 ```
 
@@ -77,17 +77,20 @@ r = pipe(
 
 ### Training Data
 
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+The model has been on a proprietary dataset of ~1.35M examples consisting of
+ * High quality swedish instruct data
+   * Single turn
+   * Multi-turn
+ * High quality swe <-> eng translations
 
-[More Information Needed]
 
 ### Training Procedure
+For training we used hugginface Accelerate and TRL.
 
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
 
 #### Preprocessing [optional]
 
-[More Information Needed]
+For efficiency, we packed all the examples into 8K context windows, reducing the number examples to ~12% of their original count. 
 
 
 #### Training Hyperparameters