FP8?

#4
by EloyOn - opened

You usually make them, so I guess it's already in the oven, but for a big model such as this is slow to make it and upload it. xD Now I see that the link for it is already created in the Model card.

Also, are you planning on derestricting moonshotai/Kimi-Linear-48B-A3B-Instruct? Huihui already abliterated it though, is your derestricting better keeping smarts, or roughly the same?

Thank you for releasing this and the 4.5 Air derestricted models!!

Sign up or log in to comment