Vishva R
Vishva007
AI & ML interests
Deeply interested in Generative AI, particularly Large Language Models (LLMs). Focusing on model fine-tuning, prompt engineering, and practical applications using the Hugging Face ecosystem (Transformers, Datasets).
Recent Activity
liked a model 1 day ago
nvidia/nemotron-ocr-v2 updated a collection 11 days ago
Qwen 3.5 updated a collection 11 days ago
Qwen 3.5Organizations
None yet
Issue & Fix: vLLM Speculative Decoding (MTP) Fails Due to Quantized Draft Head
👍 1
1
#1 opened about 1 month ago
by 
MadGoatHaz
Inference support for vLLM and SGLang OpenAI endpoints
➕ 14
10
#3 opened 4 months ago
by Vishva007
Does Somebody have https://github.com/OLAF-OSS/gemma4-vllm/blob/main/QUANTIZE.md ??
2
#1 opened 5 months ago
by 
Rafik241
Thanks for the gemma4-vllm quantization guide!
#1 opened 6 months ago
by Vishva007
Can't get the model to run on vllm 0.19.1rc1
1
#1 opened 6 months ago
by 
toughcent
DFlash compatibility with AutoRound (W4A16) quantized Qwen3.5-9B in vLLM?
2
#1 opened 6 months ago
by Vishva007
Will this model work with an AutoRound-quantized Qwen 3.5 9B model in the vLLM inference engine?
#1 opened 6 months ago
by Vishva007
Update README.md
#23 opened 8 months ago
by Vishva007
How Much GPU Memory (VRAM) is Needed to Run This Model?
🤯 2
6
#3 opened 11 months ago
by Vishva007
[bot] Conversion to Parquet
#1 opened over 1 year ago
by 
parquet-converter
How to output in a Structured format with pydantic model in transformers model?
3
#10 opened over 1 year ago
by Vishva007
How to output in a Structured format with pydantic model in transformers model?
3
#10 opened over 1 year ago
by Vishva007