Gemma 4 MTP
#5
by shadowlilac - opened
Why was Gemma 4 MTP removed from this release? It looks like the uploaded LiteRT package in litert-community has multi token prediction, while looking at the gemma 4 source code, there's no mention of MTP
Why was Gemma 4 MTP removed from this release? It looks like the uploaded LiteRT package in litert-community has multi token prediction, while looking at the gemma 4 source code, there's no mention of MTP