Update README.md
Browse files
README.md
CHANGED
|
@@ -234,7 +234,7 @@ tags:
|
|
| 234 |
<pre><code>huggingface-cli download ArtusDev/ilgee_Binary-Think-RM-8B-EXL3 --revision "5.0bpw_H6" --local-dir ./ilgee_Binary-Think-RM-8B-EXL3-5.0bpw_H6</code></pre>
|
| 235 |
</div>
|
| 236 |
</details>
|
| 237 |
-
<p>EXL3 quants can be run with any inference client that supports
|
| 238 |
</div>
|
| 239 |
|
| 240 |
<div class="card-dark">
|
|
|
|
| 234 |
<pre><code>huggingface-cli download ArtusDev/ilgee_Binary-Think-RM-8B-EXL3 --revision "5.0bpw_H6" --local-dir ./ilgee_Binary-Think-RM-8B-EXL3-5.0bpw_H6</code></pre>
|
| 235 |
</div>
|
| 236 |
</details>
|
| 237 |
+
<p>EXL3 quants can be run with any inference client that supports EXL3, such as <a href="https://github.com/theroyallab/tabbyapi" target="_blank"><b>TabbyAPI</b></a>. Refer to <a href="https://github.com/theroyallab/tabbyAPI/wiki/01.-Getting-Started" target="_blank">documentation</a> for set up instructions.</p>
|
| 238 |
</div>
|
| 239 |
|
| 240 |
<div class="card-dark">
|