Optimize inference performance: add continuous-batching, NO_WARMUP support, improve thread/batch recommendations 392efee 0xarchit commited on May 19
Add LangSearch web search tool for small model knowledge augmentation c459436 0xarchit commited on May 19