Upload README.md
Browse files
README.md
CHANGED
|
@@ -63,7 +63,7 @@ It is supported by:
|
|
| 63 |
|
| 64 |
- [Text Generation Webui](https://github.com/oobabooga/text-generation-webui) - using Loader: AutoAWQ
|
| 65 |
- [vLLM](https://github.com/vllm-project/vllm) - Llama and Mistral models only
|
| 66 |
-
- [
|
| 67 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) - for use from Python code
|
| 68 |
|
| 69 |
<!-- description end -->
|
|
@@ -326,7 +326,7 @@ The files provided are tested to work with:
|
|
| 326 |
|
| 327 |
- [text-generation-webui](https://github.com/oobabooga/text-generation-webui) using `Loader: AutoAWQ`.
|
| 328 |
- [vLLM](https://github.com/vllm-project/vllm) version 0.2.0 and later.
|
| 329 |
-
- [
|
| 330 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) version 0.1.1 and later.
|
| 331 |
|
| 332 |
<!-- README_AWQ.md-compatibility end -->
|
|
|
|
| 63 |
|
| 64 |
- [Text Generation Webui](https://github.com/oobabooga/text-generation-webui) - using Loader: AutoAWQ
|
| 65 |
- [vLLM](https://github.com/vllm-project/vllm) - Llama and Mistral models only
|
| 66 |
+
- [Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference)
|
| 67 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) - for use from Python code
|
| 68 |
|
| 69 |
<!-- description end -->
|
|
|
|
| 326 |
|
| 327 |
- [text-generation-webui](https://github.com/oobabooga/text-generation-webui) using `Loader: AutoAWQ`.
|
| 328 |
- [vLLM](https://github.com/vllm-project/vllm) version 0.2.0 and later.
|
| 329 |
+
- [Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference) version 1.1.0 and later.
|
| 330 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) version 0.1.1 and later.
|
| 331 |
|
| 332 |
<!-- README_AWQ.md-compatibility end -->
|