Commit History

  1. :gem: [Feature] MessageStreamer: Support stop sequence and auto removal

    4ba2ca6
  2. :zap: [Enhance] Update available models description

    c769be6
  3. :zap: [Enhance] Support provide api_key with os env HF_TOKEN

    bc384a3
  4. :gem: [Feature] Support call hf api with api_key via HTTP Bearer

    2da6968

  1. :gem: [Feature] Support no-stream mode with dict response

    d2b20f2

  1. :boom: [Fix] Suppress ping message by increasing ping interval

    489b65b

  1. :pencil: [Doc] Readme for features, and comments for references

    e820e51
  2. :zap: [Enhance] Cleaner logger output

    b96cef7
  3. :zap: [Enhance] New models: mistral-7b and openchat-3.5

    e916990
  4. :zap: [Enhance] OSLogger: Re-wrap for better syntax check, and move stream log to debug

    047008b
  5. :pencil: [Comment] References of requests params

    395ee29
  6. :zap: [Enhance] Default models and max_new_tokens

    6aa8b86

  1. :zap: [Enhance] API: Ensure temperature to be positive

    3dfcb72
  2. :gem: [Feature] New ArgParser: Specify server ip, port and running mode

    e28221f
  3. :boom: [Fix] Module apis not found

    937bc45
  4. :gem: [Feature] New Github Actions: Sync to huggingface hub spaces

    b1de8a0
  5. :pencil: [Doc] Readme: Features, deployment, api usage examples, and huggingface space configs

    a16695d
  6. :gem: [Feature] New examples: chat with openai and post

    f3b1386
  7. :gem: [Feature] Enable Docker deployment, and add requirements

    5a836c3
  8. :gem: [Feature] New ChatAPIApp: Enable fastapi for openai format api call

    3a09006
  9. :gem: [Feature] New MessageOutputer: Support Openai Stream format

    eb3e513
  10. :gem: [Feature] New MessageStreamer: Enable requests inference api with requests

    9f341cc
  11. :gem: [Feature] New enver: set_envs()

    9bc229a
  12. :gem: [Feature] New MessageComposer: Merge and split messages in mixtral-instruct format

    9e62d8e
  13. :gem: [Feature] New enver and logger system

    5b642ff