Abhinav Kulkarni's picture

27

Abhinav Kulkarni

abhinavkulkarni

·

https://www.linkedin.com/in/abhinavmkulkarni/

AI & ML interests

NLP

Organizations

None yet

New activity in cyankiwi/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit 2 months ago

Multi token prediction not working

#6 opened 3 months ago by

abhinavkulkarni

New activity in HuggingFaceFW/finepdfs 4 months ago

Were the original PDFs saved?

#2 opened 5 months ago by

New activity in Qwen/Qwen3-30B-A3B 9 months ago

Enabling or disabling reasoning on-demand with remote vLLM server?

#15 opened 9 months ago by

abhinavkulkarni

New activity in abhinavkulkarni/mosaicml-mpt-30b-chat-w4-g128-awq over 1 year ago

Adding `safetensors` variant of this model

#1 opened over 1 year ago by

New activity in cjpais/llava-1.6-mistral-7b-gguf almost 2 years ago

llava_eval_image_embed : failed to eval

#6 opened almost 2 years ago by

New activity in abhinavkulkarni/mosaicml-mpt-7b-chat-w4-g128-awq almost 2 years ago

Adding `safetensors` variant of this model

#1 opened almost 2 years ago by

New activity in togethercomputer/StripedHyena-Nous-7B about 2 years ago

Unable to quantize layers one at a time

#8 opened about 2 years ago by

abhinavkulkarni

Unable to load the model.. Can you explain..

#7 opened about 2 years ago by

Unable to load tokenizer

#5 opened about 2 years ago by

abhinavkulkarni

New activity in abhinavkulkarni/codellama-CodeLlama-13b-Instruct-hf-w4-g128-awq over 2 years ago

Adding `safetensors` variant of this model

#1 opened over 2 years ago by

New activity in abhinavkulkarni/meta-llama-Llama-2-13b-chat-hf-w4-g128-awq over 2 years ago

70B AWQ model?

#2 opened over 2 years ago by

New activity in TheBloke/starchat-beta-GPTQ over 2 years ago

is it possible to make this work with huggingface/text-generation-inference ?

#5 opened over 2 years ago by

New activity in abhinavkulkarni/meta-llama-Llama-2-13b-chat-hf-w4-g128-awq over 2 years ago

The code provided in the model card does not work

#1 opened over 2 years ago by

New activity in VMware/open-llama-13b-open-instruct over 2 years ago

AWQ 4-bit 128g version of open-llama-13b-open-instruct!

#3 opened over 2 years ago by

abhinavkulkarni

New activity in VMware/open-llama-7b-open-instruct over 2 years ago

AWQ 4-bit 128g version of open-llama-7b-open-instruct!

#1 opened over 2 years ago by

abhinavkulkarni

New activity in tiiuae/falcon-7b-instruct over 2 years ago

AWQ 4-bit 128g version of falcon-7b-instruct!

#55 opened over 2 years ago by

abhinavkulkarni

New activity in abhinavkulkarni/lmsys-vicuna-33b-v1.3-w4-g128-awq over 2 years ago

Inference

#1 opened over 2 years ago by

New activity in abhinavkulkarni/tiiuae-falcon-40b-instruct-w4-g128-awq over 2 years ago

Fix q_group_size

#1 opened over 2 years ago by

New activity in abhinavkulkarni/tiiuae-falcon-7b-instruct-w4-g64-awq over 2 years ago

Thanks for this model!

#1 opened over 2 years ago by

New activity in TheBloke/stable-vicuna-13B-GPTQ over 2 years ago

Basic question about 4-bit quantization

#18 opened over 2 years ago by

abhinavkulkarni