Will Reynolds

willowill5's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 over 2 years ago

OOM with vllm

#48 opened over 2 years ago by

willowill5

New activity in TheBloke/zephyr-7B-beta-AWQ over 2 years ago

vLLM out of memory

2

#2 opened over 2 years ago by

cfrancois7

New activity in TheBloke/Falcon-180B-Chat-AWQ over 2 years ago

Quantization not recognized, even when building VLLM from source

2

#1 opened over 2 years ago by

willowill5