Why use Marcoroni?
#2
by debackerl - opened
Hello,
Why the interest in using Marcoroni? It's also based on MetaMath-Cybertron-Starling which you use, but they added "just" 32k prompts, but those prompts were never shared, and it's not clear if they were not contaminated by benchmark data.
Thank you for the great work :-)
Laurent
Actually, these are experimental models, so we just try various types of merging models.
Glad to hear more feedback from you.