gbuzhf/Qwen-Sharp-Arrow-Chat-Templates
Updated β’ 2
How are things? Would you maybe explore shipping an optional n-gram embedding layer with the model to help it along, as debuted by Qwen3.8-Flash-Next?
I've heard of the ngram-embedding layer as best being thought of as tab completions which could hint models into better next tokens without going through too much active weights. Basically like a reverse MTP, but the embedding layer is providing knowledge rather than speeding up the decode.