Hugging Face's logo

Spaces:
fhueni
/
on-device-vs-cloud-llm-inference
Running

App Files Community
1
on-device-vs-cloud-llm-inference / src /services /cloudService.js

Commit History

fix: added error catch in request manager, adjusted cloud service getModelName method and inserted a console log for the no_think add-on
1d85bd9

Philip Kehl commited on

feat: changed maxTokens for cloud and on-device from 500 to 50
63f3bed

Philip Kehl commited on

feat: disable thinking for qwen model
578c052

Philip Kehl commited on

chore: added comments
752ec01

Philip Kehl commited on

feat: added stripping method for thinking tokens, increased maxNewTokens to 500, set enableThinking to false in onDeviceService
60c1285

Philip Kehl commited on

feat: implement OpenRouter as cloud model provider, optimize UI, fix some issues
7b5fcf7

fhueni commited on

feat: setup base code structure for pipeline with todos
3ea6625

fhueni commited on