Tom Whitworth's picture

Tom Whitworth

twhitworth

·

AI & ML interests

Low Level Infrastructure, Tooling, Busyforking

Recent Activity

liked a model about 9 hours ago

Qwen/Qwen3-VL-Embedding-2B

liked a model about 12 hours ago

Qwen/Qwen3-VL-Reranker-2B

liked a model 6 days ago

numind/NuExtract-2.0-8B

View all activity

Organizations

New activity in Intel/GLM-4.6-REAP-218B-A32B-FP8-gguf-q2ks-mixed-AutoRound 3 months ago

auto round version plz

#1 opened 3 months ago by

New activity in Intel/Magistral-Small-2509-int4-AutoRound 3 months ago

Could we get more w2a16 w3a16 and w4a16 Autoround

#1 opened 3 months ago by

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 3 months ago

Running on 6 GPUs

#10 opened 3 months ago by

New activity in twhitworth/KAT-Dev-72B-Exp-AWQ-INT4-noct 4 months ago

v0.0.1

#1 opened 4 months ago by

Update README.md

#2 opened 4 months ago by

New activity in twhitworth/gpt-oss-120b-fp16 5 months ago

v0.2.0 Release

#6 opened 5 months ago by

New activity in twhitworth/gpt-oss-120b-awq-w4a16 5 months ago

Happy to announce version v0.2.0 awq-w4a16

#5 opened 5 months ago by

Question about model size

#4 opened 5 months ago by

Create README.md

#1 opened 6 months ago by

New activity in twhitworth/gpt-oss-120b-awq-w4a16 6 months ago

gptq 8 please champs

#2 opened 6 months ago by

New activity in twhitworth/gpt-oss-120b-fp16 6 months ago

repulled weights but getting this error assert hidden_states.dtype == torch.bfloat16, "hidden_states must be bfloat16"

#5 opened 6 months ago by

getting a couple of errors " No model.safetensors.index.json found in remote" and "assert hidden_states.dtype == torch.bfloat16, "hidden_states must be bfloat16"

#1 opened 6 months ago by

Upload 81 files

#4 opened 6 months ago by

New activity in zai-org/GLM-4.5 6 months ago

AWQ 4Bit / GPTQ with full precision gates and head? Please

#4 opened 6 months ago by

chriswritescode

New activity in mistralai/Voxtral-Small-24B-2507 7 months ago

Large audio files

#7 opened 7 months ago by

New activity in kyutai/stt-2.6b-en 7 months ago

Semantic VAD?

#5 opened 7 months ago by

New activity in kyutai/tts-1.6b-en_fr 7 months ago

Candle Support

#2 opened 7 months ago by

New activity in justinjja/MiniMax-M1-80k-W4A16-INT4 7 months ago

VRAM requirements

#1 opened 7 months ago by

New activity in BAAI/Video-XL-2 8 months ago

Out of Mem for 4090-24G

#1 opened 8 months ago by

New activity in RedHatAI/phi-4 9 months ago

4a16 quant?

#1 opened 9 months ago by