Update README with model card for gmail
Browse files
README.md
CHANGED
|
@@ -469,6 +469,12 @@ The code used to generate the dataset can be found [here](https://github.com/pre
|
|
| 469 |
</table>
|
| 470 |
|
| 471 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 472 |
## Inference
|
| 473 |
|
| 474 |
- Given a conversation, we extract all tuples `(context_messages, function_calls)` and use it to generate predictions. We ignore the `content` field and only evaluate `function_calls` generated by an LLM.
|
|
|
|
| 469 |
</table>
|
| 470 |
|
| 471 |
|
| 472 |
+
|
| 473 |
+
## Deployment with vLLM
|
| 474 |
+
|
| 475 |
+
`vllm serve ojus1/Qwen3-0.6B-Instruct --enable-lora --lora-modules prem-research/Funcdex-0.6B=prem-research/Funcdex-0.6B-gmail --enable-auto-tool-choice --tool-call-parser hermes`
|
| 476 |
+
|
| 477 |
+
|
| 478 |
## Inference
|
| 479 |
|
| 480 |
- Given a conversation, we extract all tuples `(context_messages, function_calls)` and use it to generate predictions. We ignore the `content` field and only evaluate `function_calls` generated by an LLM.
|