Spaces:

fhueni
/

on-device-vs-cloud-llm-inference

Running

App Files Files Community

on-device-vs-cloud-llm-inference / src /services

6.51 kB

6 contributors

History: 16 commits

Philip Kehl

fix: added error catch in request manager, adjusted cloud service getModelName method and inserted a console log for the no_think add-on

1d85bd9 3 months ago

cloudService.js

2.63 kB

fix: added error catch in request manager, adjusted cloud service getModelName method and inserted a console log for the no_think add-on 3 months ago
onDeviceService.js

3.88 kB

feat: changed maxTokens for cloud and on-device from 500 to 50 3 months ago