Model Requests & Suggestions

#1
by IsValorum - opened

Suggest a model for a future handcrafted MiniPlus or NanoPlus release.

Please include:

  • Upstream model link
  • Intended use or strengths
  • Why it would be valuable at a MiniPlus or NanoPlus footprint

I will review requests based on demand, architecture, local-inference practicality, and whether the model would benefit from a custom tensor-by-tensor quantization.

IsValorum pinned discussion

CyberTiel

  1. Link: peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-GGUF-MTP (https://huggingface.co/peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-GGUF-MTP)
  2. Just like Tiel , agentic coding tasks, but stronger, less thinking(in my opinion) and uncensored
  3. Miniplus like what you did on Tiel

The MiniPlus V2.1 and NanoPlus quantizations are already underway; they will be available within an hour at mostโ€”follow me to get notified.

Wow
Thanks for your hard works and very fast reply, really impressive, this is the fastest model request i've seen on hf (or maybe you had already worked on this model from before :))

I will definitely check and test for if the Apex Miniplus CyberTiel work good too

Request for next model.
Reason: I've personally used k2 and it's the closest thing to match or exceed Qwen intelligence:
IFM/K2-Horizon-MoVA-36B-A4B

I personally tried the K2-Horizon, the smaller versions and that MoVA, and they didn't convince me because of the cost of the KV Cache.

I could barely get it to 8K context in Q4_0, not enough to properly test it, is it really any good?

For me, the fact that it had such an absurdly expensive KV cache was enough to completely rule it out. Did you guys test it in real-world use?

You were using Q4_0 KV?
How much VRAM on the rig?
I assume your models were tested on 24gb ram?

Would you be open to consider quanting decision-model oriented finetunes of Gemma4 or Qwen3.x 27B/35B-A3B?

@IsValorum feel like working your quant magic on a Gemma4 or a Nemotron MoE?

ThinkingCap-NVIDIA-Nemotron-3.5-Lightning-30B-A3B (or original)

ThinkingCap-gemma-4-26B-A4B-it (or original or og-QAT or QAT abliterated)

My reasons for asking is that Gemma is great at languages (I use E4B to proof OCR output) and chatting, and Nemotron Lightning is (supposedly) a sipper where it comes to context memory use. I doubt either would touch the Tiels though where it comes to actual work, so I won't be surprised if you say nope. ๐Ÿ˜†

Both ready:

https://huggingface.co/IsValorum/ThinkingCap-Gemma-4-26B-A4B-it-APEX-I-MiniPlus-V2.1-GGUF
https://huggingface.co/IsValorum/ThinkingCap-Gemma-4-26B-A4B-it-APEX-I-NanoPlus-V2.1-GGUF

SmallAICreator/GRAFT-50B-A3B-GGUF

SmallAICreator/GRAFT-50B-A3B-GGUF

It's a generation prior to Qwen3.5, it's Qwen3 and it performs worse than Qwen3 30B A3B despite having more parameters (40B), pruning more than 40B of parameters from the original 80B left it lobotomized.

Furthermore, there are no BF16s or safetensors anywhere; only a Q4_K_M was uploaded.

DavidAU/Qwen3.8-40B-Ultimate-Heretic-Uncensored

ItachiSan/LiquidCode-2.5-24B-A2B
based on LiquidAI/LFM2.5-24B-A2B, i already use your LFM2.5-24B-A2B-APEX-I-MiniPlus-V2.1, which is great, and the fastest model on my pc, a coding variant would be awesome .

Suggest a model for a future handcrafted MiniPlus or NanoPlus release.

Please include:

  • Upstream model link
  • Intended use or strengths
  • Why it would be valuable at a MiniPlus or NanoPlus footprint

I will review requests based on demand, architecture, local-inference practicality, and whether the model would benefit from a custom tensor-by-tensor quantization.

A new general model built from scratch, a new 35B A3B that beats Qwen3.6 35B A3B, that ISN'T A FINETUNE.
https://huggingface.co/maxwell-model/Maxwell-V1-Flash
It looks new nice and cool, just needs your special quants :)

I need a 35b a3b that even beat qwen 3.8 27b.

Qwen 3.6 35b a3b is easy to beat

Sign up or log in to comment