Cost to host this model
#5
by bigrocks918 - opened
I am very curious about how much it would cost to host this model.
I found this is an efficient choice when it comes to self-hosted ai models, but really want to know about the spec of the server required to host this model.
The tests were run on A100. I guess, it won't perform on a laptop.