Random Chinese symbols sometimes appearing in output

#45
by kimi-chan - opened

Anyone else having this issue?

image

image

Other than that, it produces very interesting stories.

It's a base model isn't it? Or do we have to use a chat template?

I think u just disproved its fake- if it was all rng- we wouldnt get text at all

edit: typo

chinese characters could be one of many things

either:

1 degradation from extreme quantization
2 wrong sampling parameters
3 chat template is buns

its not fake neither real, they took a real model for layers one and two i think, changed it just enough, and put niose for the rest. A real work of art and real randomized bullshit

@el4 the character literally means "she" so it is a degradation or hack-job issue. And @e12ex2 where can we find a good match for the first few layer of weights, and why can't we remove the later layers that only noise things up for lulz?

dude how would you have a spare gb200 cluster laying around

uhhhhhhhhhhhh

Sign up or log in to comment