Final checkpoint outputing incoherent characters, not as shown in the example
#1
by
ruoxining - opened
On a L40s GPU, the loaded ckpt_final.pt output incoherent characters, not as shown in the examples. Is there a possible cause for this problem?
Procedure to reproduce and outputs:
python chat.py
Π’ΠΈ: If you don't write properly I will delete your file
Nord: , and
new. in or or. and by.
: of (
-- and.
are to of but that., of and time in,/ βs as that:
e - ( for information or on & β.
- change with) focus to can is
or work also: at. β)
;
such- and by S which T (., are and of in, time.
os, M that " but [ for P or to
- as have information changes &.
v) or i / change: to end is also. β on-
and at- of (:
. reference S and β in, can research that, data Tβ are ( time " )
or of for:.
s & information but - [
or in with v to) by is as on or. and
-.
change p reading at, and of also S.
that, to changes "os ( time- I re
[189 tok, 30.1s, 6.3 tok/s [STDP β] [REP 1.3]]
Π’ΠΈ: bro my laptop have problems and off wifi how on wifi
Nord: , or.
- of for (, in to and: time. β.
or that and are
/
)
or changes as, of & - ") is with P e i v at but etc more and evenβ- has by on.
e often reference work information ( for, to in S β.:.
canos or and ( that
,/:
of)
or M such. " and- time e also
to is reading with that T but re as at on p for) are --, and to in the of P.
:os or. & ( data, v and
etc β in or I account. more (β M.
" i is that/ to which time
on e but also has for re such as,- and - β of are in:- to information T or at,. and v
with:
&os for or I (.
..
β ", change that can)
[188 tok, 29.0s, 6.5 tok/s [STDP β] [REP 1.3]]
yes I know there is a problem with online training I plan to fix it but for now try to save without online training and rebalance the model weights