update inference guide
Browse files
README.md
CHANGED
|
@@ -23,11 +23,10 @@ Check out other fine-tuned function calling models [here](https://trelis.com/fun
|
|
| 23 |
|
| 24 |
## Quick Server Setup
|
| 25 |
Runpod one click TGI template [here](https://runpod.io/console/deploy?template=h20vae7szq&ref=jmfkcdio).
|
|
|
|
| 26 |
|
| 27 |
Runpod Affiliate [Link](https://runpod.io?ref=jmfkcdio) (helps support the Trelis channel).
|
| 28 |
|
| 29 |
-
README STILL TO BE UPDATED BELOW HERE!!!
|
| 30 |
-
|
| 31 |
## Inference Scripts
|
| 32 |
See below for sample prompt format.
|
| 33 |
|
|
|
|
| 23 |
|
| 24 |
## Quick Server Setup
|
| 25 |
Runpod one click TGI template [here](https://runpod.io/console/deploy?template=h20vae7szq&ref=jmfkcdio).
|
| 26 |
+
- See this [YouTube Video](https://www.youtube.com/watch?v=hHn_cV5WUDI) for guidance on inference with this model.
|
| 27 |
|
| 28 |
Runpod Affiliate [Link](https://runpod.io?ref=jmfkcdio) (helps support the Trelis channel).
|
| 29 |
|
|
|
|
|
|
|
| 30 |
## Inference Scripts
|
| 31 |
See below for sample prompt format.
|
| 32 |
|