Commit History

  1. Add SmolLM2-135M TaiwanChat

    0d642b7

  1. default to gemma-3-4b

    88a6a62
  2. model repo_id typo fix

    89372fa
  3. enable web search by default

    6235e63
  4. remove tinyllama which has bad response quality

    a22cf42
  5. make streaming response

    5ea073d
  6. apply history flatten before it goint to prompt

    ef361b0
  7. better management on system prompt

    5f6306a
  8. usue chat pipeline instead of model and tokenizer individually

    ac8e9cc
  9. bugfix to padding-related issues

    f248fec
  10. add attention mask

    b6b3940
  11. Clean model description

    4731160
  12. pin torch to 2.4.0

    4c6b4c5
  13. enable zerogpu with decorator

    c5b2897
  14. Apply ZeroGPU

    d181b45
  15. switch to gradio version for stability reason

    a703203

  1. add taiwan tinyllama

    794ee70
  2. Improve responsiveness by asynchronously retrieving web search context⁠

    acda3f1
  3. add llama 3.2 taiwan 3b

    b1544e2
  4. add minicpm3 4b

    f5c0811
  5. increase xt length to max

    629495e
  6. remove all moe

    fafc8cb
  7. remove qwen 1.5 moe

    6735035
  8. adjust title style

    e9559bd
  9. use another version of qwen 1.5 moe

    96e60d6
  10. add Qwen1.5-MoE

    e17afaf
  11. Qwen2.5-MOE-6x1.5B

    5eca666
  12. remove under 3b models

    617be26
  13. Add model caching

    d33dfcd
  14. UI/UX Improvement

    eb215ff
  15. reset timeout timer once a new token is generated

    35943b1

  1. open web search settgins to user

    c9fd924
  2. add 2 more models

    f7a541f
  3. apply new settings on duckduck search

    d9421eb
  4. tune llama paramters

    20484f3
  5. increase max_chars_per_result to 600

    1155897
  6. increase max results to 6 for better web search

    0c2fe1d
  7. increase ctx lenght to 2k

    9ba47d1
  8. increase timeout to 5min

    71d28c5
  9. Code simplification

    248f5a7
  10. Enable speculattive decoding

    a7fdfe6
  11. fix role disorder error in history

    06a162a
  12. Add internet search feature

    4e60755
  13. fix reasonning model's thought process display

    9d3ca6c
  14. bugfix

    4522453
  15. fix for multi-turn conv.

    6c77ec7
  16. bugfix for think tag handling

    14564aa
  17. support reasoning tag

    5db22d5
  18. add missing part of app.py

    afa19a3
  19. add 4 new models

    d554072