Hugging Face's logo

Spaces:
fhueni
/
on-device-vs-cloud-llm-inference
Running

App Files Community
1
on-device-vs-cloud-llm-inference / src /services

Commit History

fix: added error catch in request manager, adjusted cloud service getModelName method and inserted a console log for the no_think add-on
1d85bd9

Philip Kehl commited on

feat: changed maxTokens for cloud and on-device from 500 to 50
63f3bed

Philip Kehl commited on

feat: disable thinking for qwen model
578c052

Philip Kehl commited on

chore: added comments
752ec01

Philip Kehl commited on

feat: added stripping method for thinking tokens, increased maxNewTokens to 500, set enableThinking to false in onDeviceService
60c1285

Philip Kehl commited on

feat: add granit models and finish model selection
e779f87

fhueni commited on

feat: add option to specify model quantization in on device model selection
3a27a81

fhueni commited on

feat: added additional models
241aff9

fhueni commited on

fix: correct shown device stats and add message template to on device service
714c7da

fhueni commited on

feat: implement CSV download and converted logs to a table
0726d27

fhueni commited on

feat: optimize console logging and fix import of transfromer.js library
296be2c

fhueni commited on

feat: implement OpenRouter as cloud model provider, optimize UI, fix some issues
7b5fcf7

fhueni commited on

feat: model download progress bar and added metrics f1WordLevel, Rouge1, TotalTokens, TokensPerSecond
048bfac

Philip Kehl commited on

feat: add on device model parameter and logging outputs
3b0c247

fhueni commited on

xenova transformers implemented
e1a3c89

Philip Kehl commited on

feat: setup base code structure for pipeline with todos
3ea6625

fhueni commited on