Instructions to use assignarc/TLF-7B-LLM-01 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use assignarc/TLF-7B-LLM-01 with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Updated AccountName to AssignArc
Browse files
README.md
CHANGED
|
@@ -59,7 +59,7 @@ To achieve the intended structured output, use the following prompt format:
|
|
| 59 |
|
| 60 |
```python
|
| 61 |
import mlx_lm
|
| 62 |
-
model, tokenizer = mlx_lm.load("
|
| 63 |
|
| 64 |
prompt = "Provide a comprehensive morphological breakdown for: 'Abacus'"
|
| 65 |
# Use Sarvam/Llama template logic here
|
|
@@ -74,7 +74,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
| 74 |
from peft import PeftModel
|
| 75 |
|
| 76 |
base_model = AutoModelForCausalLM.from_pretrained("sarvamai/sarvam-1")
|
| 77 |
-
model = PeftModel.from_pretrained(base_model, "
|
| 78 |
tokenizer = AutoTokenizer.from_pretrained("sarvamai/sarvam-1")
|
| 79 |
|
| 80 |
inputs = tokenizer(prompt, return_tensors="pt")
|
|
|
|
| 59 |
|
| 60 |
```python
|
| 61 |
import mlx_lm
|
| 62 |
+
model, tokenizer = mlx_lm.load("assignarc/TLF-7B-LLM-01")
|
| 63 |
|
| 64 |
prompt = "Provide a comprehensive morphological breakdown for: 'Abacus'"
|
| 65 |
# Use Sarvam/Llama template logic here
|
|
|
|
| 74 |
from peft import PeftModel
|
| 75 |
|
| 76 |
base_model = AutoModelForCausalLM.from_pretrained("sarvamai/sarvam-1")
|
| 77 |
+
model = PeftModel.from_pretrained(base_model, "assignarc/TLF-7B-LLM-01")
|
| 78 |
tokenizer = AutoTokenizer.from_pretrained("sarvamai/sarvam-1")
|
| 79 |
|
| 80 |
inputs = tokenizer(prompt, return_tensors="pt")
|