Instructions to use prem-research/Funcdex-0.6B-jira_gmail with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use prem-research/Funcdex-0.6B-jira_gmail with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("prem-research/Funcdex-0.6B-jira_gmail", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README with model card for jira_gmail
Browse files
README.md
CHANGED
|
@@ -579,6 +579,10 @@ response = tokenizer.decode(output[0][input_tokens['input_ids'].shape[1]:], skip
|
|
| 579 |
print("Response:", response)
|
| 580 |
```
|
| 581 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 582 |
For best results, provide detailed system-prompt to steer the tool-use behaviour.
|
| 583 |
|
| 584 |
# License
|
|
|
|
| 579 |
print("Response:", response)
|
| 580 |
```
|
| 581 |
|
| 582 |
+
## Deployment with vLLM
|
| 583 |
+
|
| 584 |
+
`vllm serve ojus1/Qwen3-0.6B-Instruct --enable-lora --lora-modules prem-research/Funcdex-0.6B=prem-research/Funcdex-0.6B-jira_gmail --enable-auto-tool-choice --tool-call-parser hermes`
|
| 585 |
+
|
| 586 |
For best results, provide detailed system-prompt to steer the tool-use behaviour.
|
| 587 |
|
| 588 |
# License
|