Fix handler - remove no_repeat_ngram_size parameter that may not be supported by inference endpoints 72a8810 verified 0chanly commited on 11 days ago
Update generation parameters to match local chatbot (max_tokens=180, repetition_penalty=1.2, top_p=0.9, top_k=50) 6eea562 verified 0chanly commited on 12 days ago