GPU-Mart / index.html

Commit History

Use greedy decoding: do_sample sampling path fails on fp16 logits in transformers.js 3.8.1; remove temp instrumentation
d6c22f2
verified

VickyRDP commited on

Instrument adapter (temporary): expose generator + wrapper call counter
faae2b5
verified

VickyRDP commited on

Adapter v3: learn expected KV dtypes via try/flip/retry (session metadata unavailable in CDN ORT build)
7434dde
verified

VickyRDP commited on

Add KV dtype adapter: align KV-cache feed dtypes with session input metadata (handles both fp16- and fp32-resolving ORT builds)
32cb8a0
verified

VickyRDP commited on

Force WASM inference: WebGPU shader-f16 corrupts this fp16 export (verified on-device); WASM output verified correct. Trim max_new_tokens to 160.
35f4ea6
verified

VickyRDP commited on

Fix generation: remove fp16 I/O shim (config kv_cache_dtype handles it), pin transformers.js 3.8.1, refresh stale cached configs, restore WASM fallback with shader-f16 gate
379ab55
verified

VickyRDP commited on

Shim: only cast when session input metadata expects float16
c2f6821
verified

VickyRDP commited on

Add fp16 I/O shim: cast fp32 KV feeds to fp16 and fp16 logits to fp32
a1ae561
verified

VickyRDP commited on

Use current Transformers.js 3.x for fp16 KV cache
4e9fd49
verified

VickyRDP commited on

Require WebGPU for fp16 GPU Mart inference
92cdbd8
verified

VickyRDP commited on

Use fp16 ONNX with graph optimizations disabled
1021060
verified

VickyRDP commited on

Convert to free static Space: browser-side model + voice/text UI
17957e0
verified

VickyRDP commited on