ojus1 commited on
Commit
a720b89
·
verified ·
1 Parent(s): 1cf5de8

Update README with model card for gmail

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -469,6 +469,12 @@ The code used to generate the dataset can be found [here](https://github.com/pre
469
  </table>
470
 
471
 
 
 
 
 
 
 
472
  ## Inference
473
 
474
  - Given a conversation, we extract all tuples `(context_messages, function_calls)` and use it to generate predictions. We ignore the `content` field and only evaluate `function_calls` generated by an LLM.
 
469
  </table>
470
 
471
 
472
+
473
+ ## Deployment with vLLM
474
+
475
+ `vllm serve ojus1/Qwen3-0.6B-Instruct --enable-lora --lora-modules prem-research/Funcdex-0.6B=prem-research/Funcdex-0.6B-gmail --enable-auto-tool-choice --tool-call-parser hermes`
476
+
477
+
478
  ## Inference
479
 
480
  - Given a conversation, we extract all tuples `(context_messages, function_calls)` and use it to generate predictions. We ignore the `content` field and only evaluate `function_calls` generated by an LLM.