24 GB VRAM - a TeeZee Collection

TeeZee 's Collections

Writing style transfer experiments

Polish speaking LLMs

24 GB VRAM

updated Mar 21, 2025

Quants that run fast on single 3090/4090 card with 24GB of VRAM and 4096 context length

TeeZee/2xbagel-dpo-34b-v0.2-bpw3.0-h6-exl2

Text Generation • Updated Jun 28, 2024 • 5 • 1
TeeZee/2xNous-Capybara-34B-bpw3-h6-exl2

Text Generation • Updated Jan 14, 2024 • 5
TeeZee/Psyfighter2-Orca2-13B-ties-bpw8.0-h8-exl2

Text Generation • Updated Jan 12, 2024 • 5
TeeZee/chronomaid-storytelling-13B-bpw8.0-h8-exl2

Text Generation • Updated Jan 13, 2024 • 3
TeeZee/Fimbulvetr-10.7B-v1-bpw8.0-h8-exl2

Text Generation • Updated Jan 13, 2024 • 4
TeeZee/Kyllene-57B-v1.0-bpw3.0-h6-exl2

Text Generation • Updated Jan 24, 2024 • 5
TeeZee/Xwin-LM-70B-V0.1_Limarpv3-bpw2.4-h6

Text Generation • Updated Jan 24, 2024 • 3
TeeZee/DarkForest-20B-v1.0-bpw8.0-h8-exl2

Text Generation • Updated Jan 25, 2024 • 6 • 1
TeeZee/BigMaid-20B-v1.0-bpw8.0-h8-exl2

Text Generation • Updated Feb 9, 2024 • 6 • 1
TeeZee/DarkForest-20B-v2.0-bpw8.0-h8-exl2

Text Generation • Updated Feb 18, 2024 • 5 • 1
TeeZee/DarkForest-20B-v2.0-bpw6.0-h6-exl2

Text Generation • Updated Feb 19, 2024 • 2
TeeZee/DarkForest-20B-v2.0-bpw6.0-h8-exl2

Text Generation • Updated Feb 19, 2024 • 3
TeeZee/NEBULA-23.8B-v1.0-bpw7.5-h8-exl2

Text Generation • Updated Apr 22, 2024 • 1
TeeZee/GALAXY-16B-v1.0-bpw8.0-h8-exl2

Text Generation • Updated Apr 23, 2024 • 1
TeeZee/BigMaid-20B-v2.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15, 2024 • 3
TeeZee/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15, 2024 • 3
TeeZee/2xbagel-dpo-34b-v0.2-bpw2.8-h6-exl2

Updated Aug 14, 2024 • 4
TeeZee/2xbagel-34b-v0.2-bpw2.8-h6-exl2

Text Generation • Updated Aug 7, 2024 • 5
TeeZee/Lumimaid-v0.2-70B-awq

71B • Updated Mar 21, 2025 • 2