Hugging Face's logo

Spaces:
fhueni
/
on-device-vs-cloud-llm-inference
Running

App Files Community
1
on-device-vs-cloud-llm-inference / src /services /onDeviceService.js

Commit History

feat: changed maxTokens for cloud and on-device from 500 to 50
72519d5

Philip Kehl commited on

feat: disable thinking for qwen model
b9991b1

Philip Kehl commited on

feat: added stripping method for thinking tokens, increased maxNewTokens to 500, set enableThinking to false in onDeviceService
e05ac95

Philip Kehl commited on

feat: add granit models and finish model selection
1d22bd8

fhueni commited on

feat: add option to specify model quantization in on device model selection
383a122

fhueni commited on

feat: added additional models
7f224da

fhueni commited on

fix: correct shown device stats and add message template to on device service
8b3b676

fhueni commited on

feat: implement CSV download and converted logs to a table
d720b4b

fhueni commited on

feat: optimize console logging and fix import of transfromer.js library
7a38188

fhueni commited on

feat: implement OpenRouter as cloud model provider, optimize UI, fix some issues
9674cf0

fhueni commited on

feat: model download progress bar and added metrics f1WordLevel, Rouge1, TotalTokens, TokensPerSecond
b1ed689

Philip Kehl commited on

feat: add on device model parameter and logging outputs
6ac6471

fhueni commited on

xenova transformers implemented
f8c42c9

Philip Kehl commited on

feat: setup base code structure for pipeline with todos
bfaf968

fhueni commited on