this model hallucinates easily
#13
by batsclamp - opened
Hi,
Model was tasked (via hermes agent) to analyze a fitness training, but it had lost the context quickly and started to deploy minecraft docker container instead %). Next time with another task it started to write script to solve an imaginary python challenge. Never had anything like this with any other 27b models, including abliterated ones.
Be very careful with production use!
And thanks Team Nvidia for a serious speed bump! Waiting for v2 version!
Regards,
A
yes i've done the same simulation as proof i914900ks 64gb systrem ram 5090,4090 same problem