IBB-University
/

ghadeer_question_answer

Text Generation

text-generation-inference

Model card Files Files and versions

GhadeerALbadani commited on Dec 28, 2023

Commit

2ccbe9d

·

1 Parent(s): bdd8e93

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -38,8 +38,10 @@ generation_pipeline = pipeline("text-generation",model=model,tokenizer=tokenizer
 generation_pipeline(text,
     pad_token_id=tokenizer.eos_token_id,
     num_beams=10,
-    max_length=200,
     top_p=0.9,
     repetition_penalty = 3.0,
     no_repeat_ngram_size = 3)[0]['generated_text']
 ```

 generation_pipeline(text,
     pad_token_id=tokenizer.eos_token_id,
     num_beams=10,
+    max_length=512,
+    penalty_alpha=0.6,
     top_p=0.9,
+    top_k=4,
     repetition_penalty = 3.0,
     no_repeat_ngram_size = 3)[0]['generated_text']
 ```