Is this even good?
#1
by nonetrix - opened
A frankenstein merge but it's just the model duplicated? Is it even better than the normal 70B? Wouldn't it be better to merge with another smart 70B model?
It does not make sense to me either, and I have testing lots of different possibilities of doing self-merges. In addition, this is not 120b, but 140b instead.