Peter Kis

NePe's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in nvidia/Llama-3_3-Nemotron-Super-49B-v1_5 5 months ago

variable_cache.py compatibility for v4.57.2 / python3.12

1

#12 opened 5 months ago by

NePe

Since `transformers` v4.56.0` the dictionary `ALL_STATIC_CACHE_IMPLEMENTATIONS` replaced `NEED_SETUP_CACHE_CLASSES_MAPPING`

4

#9 opened 6 months ago by

blewis-hir

cannot import name 'NEED_SETUP_CACHE_CLASSES_MAPPING'

1

#11 opened 5 months ago by

uygarkurt

New activity in AlphaGaO/Qwen3-30B-A3B-GPTQ about 1 year ago

Slow GPTQ inference

13

#1 opened about 1 year ago by

NePe

New activity in JunHowie/Qwen3-30B-A3B-GPTQ-Int4 about 1 year ago

Slow GPTQ inference

5

#2 opened about 1 year ago by

NePe

New activity in moonshotai/Moonlight-16B-A3B-Instruct about 1 year ago

PEFT finetuning support

#14 opened about 1 year ago by

NePe

New activity in mistralai/Mistral-Small-3.1-24B-Instruct-2503 about 1 year ago

Can't determine properly which is greater between 9.9 and 9.11

🧠➕ 2

12

#38 opened about 1 year ago by

sniffski

New activity in google/gemma-2-27b-it almost 2 years ago

with load_in_4bit it just generates <pad> tokens

2

#16 opened almost 2 years ago by

NePe

New activity in rainjay/gemma-2-27b-it-4bit almost 2 years ago

it just keeps generating <pad> tokens

3

#1 opened almost 2 years ago by

NePe

New activity in TheBlokeAI/Mixtral-tiny-GPTQ over 2 years ago

Seems like the GPTQ versions are broken

4

#2 opened over 2 years ago by

NePe

What is this model?

3

#1 opened over 2 years ago by

Yuuru

New activity in TheBloke/Mixtral-8x7B-v0.1-GPTQ over 2 years ago

Build AutoGPTQ from source

3

#1 opened over 2 years ago by

PeePants

New activity in open-llm-leaderboard/open_llm_leaderboard over 2 years ago

Impossible to search/filter for 13B GPTQ models.

9

#293 opened over 2 years ago by

NePe

New activity in elinas/alpaca-30b-lora-int4 about 3 years ago

How to do inferance?

9

#2 opened about 3 years ago by

NePe

How to do inferance?

9

#2 opened about 3 years ago by

NePe

How to do inferance?

9

#2 opened about 3 years ago by

NePe