Update README with model card for googledrive
Browse files
README.md
CHANGED
|
@@ -567,6 +567,10 @@ response = tokenizer.decode(output[0][input_tokens['input_ids'].shape[1]:], skip
|
|
| 567 |
print("Response:", response)
|
| 568 |
```
|
| 569 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 570 |
For best results, provide detailed system-prompt to steer the tool-use behaviour.
|
| 571 |
|
| 572 |
# License
|
|
|
|
| 567 |
print("Response:", response)
|
| 568 |
```
|
| 569 |
|
| 570 |
+
## Deployment with vLLM
|
| 571 |
+
|
| 572 |
+
`vllm serve ojus1/Qwen3-0.6B-Instruct --enable-lora --lora-modules prem-research/Funcdex-0.6B=prem-research/Funcdex-0.6B-googledrive --enable-auto-tool-choice --tool-call-parser hermes`
|
| 573 |
+
|
| 574 |
For best results, provide detailed system-prompt to steer the tool-use behaviour.
|
| 575 |
|
| 576 |
# License
|