Commit
·
8c953f6
1
Parent(s):
a15fc34
Nov 19th 2023 updates
Browse files
README.md
CHANGED
|
@@ -6,21 +6,24 @@ colorTo: green
|
|
| 6 |
sdk: static
|
| 7 |
pinned: true
|
| 8 |
tags:
|
| 9 |
-
-
|
| 10 |
-
-
|
| 11 |
- mistral
|
| 12 |
- deepseek
|
| 13 |
-
-
|
| 14 |
-
-
|
| 15 |
-
-
|
| 16 |
-
-
|
| 17 |
-
- fine-tuning
|
| 18 |
-
- scripts
|
| 19 |
- fine-tuning
|
| 20 |
---
|
| 21 |
-
*last updated Nov
|
| 22 |
## About
|
| 23 |
-
Trelis Research provides
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
|
| 25 |
## ADVANCED Fine-tuning Scripts
|
| 26 |
|
|
@@ -30,17 +33,14 @@ Trelis Research provides tools and tutorials for training, using and deploying l
|
|
| 30 |
1. Q&A Dataset Preparation + Cleaning Scripts
|
| 31 |
1. Scripts to create and use Embeddings
|
| 32 |
1. Quantization Scripts
|
| 33 |
-
|
| 34 |
-
## Function-calling Models and Datasets
|
| 35 |
-
- [Llama 2 and Mistral models fine-tuned for function calling, 7B, 13B, 70B, CodeLlama 34B](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling-v2)
|
| 36 |
-
- [Dataset to fine-tune models for function calling](https://huggingface.co/datasets/Trelis/function_calling_extended)
|
| 37 |
|
| 38 |
## LLM Server Setup
|
| 39 |
-
- Server and inference
|
| 40 |
- Inference for function calling.
|
| 41 |
- [Video: Run Llama 2 on AWS](https://youtu.be/Ror2xOOA-VE)
|
| 42 |
- [Video: Deploy a Llama API in 5 clicks](https://youtu.be/dJ69gY0qRbg)
|
| 43 |
-
- [
|
| 44 |
|
| 45 |
## One-click LLM API/Server Templates
|
| 46 |
- [Runpod affiliate link](https://tinyurl.com/yjxbdc9w)
|
|
|
|
| 6 |
sdk: static
|
| 7 |
pinned: true
|
| 8 |
tags:
|
| 9 |
+
- function calling
|
| 10 |
+
- long context
|
| 11 |
- mistral
|
| 12 |
- deepseek
|
| 13 |
+
- yi
|
| 14 |
+
- code-llama
|
| 15 |
+
- quantization
|
| 16 |
+
- SFT
|
|
|
|
|
|
|
| 17 |
- fine-tuning
|
| 18 |
---
|
| 19 |
+
*last updated Nov 19th 2023*
|
| 20 |
## About
|
| 21 |
+
Trelis Research provides specialised fine-tuned models AND fine-tuning scripts.
|
| 22 |
+
|
| 23 |
+
## Function-calling Models and Datasets
|
| 24 |
+
- [Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Yi, Deepseek, Llama and more](https://trelis.com/function-calling/)
|
| 25 |
+
- [Dataset to fine-tune models for function calling](https://huggingface.co/datasets/Trelis/function_calling_extended)
|
| 26 |
+
- [Scripts to fine-tune models for function calling and structured responses](https://trelis.com/function-calling/)
|
| 27 |
|
| 28 |
## ADVANCED Fine-tuning Scripts
|
| 29 |
|
|
|
|
| 33 |
1. Q&A Dataset Preparation + Cleaning Scripts
|
| 34 |
1. Scripts to create and use Embeddings
|
| 35 |
1. Quantization Scripts
|
| 36 |
+
1. Chat fine-tuning Scripts
|
|
|
|
|
|
|
|
|
|
| 37 |
|
| 38 |
## LLM Server Setup
|
| 39 |
+
- Server setup and inference guide for open source models.
|
| 40 |
- Inference for function calling.
|
| 41 |
- [Video: Run Llama 2 on AWS](https://youtu.be/Ror2xOOA-VE)
|
| 42 |
- [Video: Deploy a Llama API in 5 clicks](https://youtu.be/dJ69gY0qRbg)
|
| 43 |
+
- [Learn more here](https://trelis.com/enterprise-server-api-and-inference-guide/)
|
| 44 |
|
| 45 |
## One-click LLM API/Server Templates
|
| 46 |
- [Runpod affiliate link](https://tinyurl.com/yjxbdc9w)
|