Inquiry About the Checkpoint for Local Deployment
#1
by
ZebangCheng
- opened
Hello, your work is truly inspiring and has provided us with a lot of insights. We would like to test its performance by deploying it locally.
In your code, we noticed the following line:
last_model_checkpoint = "" # Please replace it with the path to checkpoint
Could you kindly let us know where we can download the last_model_checkpoint mentioned here?
Thank you in advance for your help!
You can set the huggingface repo as the model checkpoint and add the use_hf argument in the engine init like below:
last_model_checkpoint = "zhifeixie/Audio-Reasoner"
engine = PtEngine(last_model_checkpoint, max_batch_size=64, model_type = model, use_hf=True)