Final checkpoint outputing incoherent characters, not as shown in the example

#1
by ruoxining - opened

On a L40s GPU, the loaded ckpt_final.pt output incoherent characters, not as shown in the examples. Is there a possible cause for this problem?

Procedure to reproduce and outputs:

python chat.py
  Π’ΠΈ: If you don't write properly I will delete your file

  Nord: , and
new. in or  or. and by.
: of (
-- and.
 are to of but that., of and time in,/ –s as that:
e - ( for information or on & –.
- change with)  focus to can is
 or work also: at. β€œ)
;
 such- and by S which T (., are and of in, time.
os, M that " but  [ for P or to
 - as have information changes &.
 v) or i / change: to end is also. β€œ on-
 and at- of (:
. reference S and – in, can research that, data T– are ( time " )
 or of for:.
s & information but - [
 or in with v to) by is  as on or. and
-.
 change p reading at, and of also S.
 that, to changes "os ( time- I re
  [189 tok, 30.1s, 6.3 tok/s [STDP βœ“] [REP 1.3]]
  Π’ΠΈ: bro my laptop have problems and off wifi how on wifi

  Nord: , or.
- of for (, in to and: time. β€œ.
 or that  and are
/
)
 or changes as, of & - ") is with P e i v at but etc more and even–- has by on.
e often reference work information ( for, to in S –.:.
 canos or  and ( that

,/:
 of)
 or M such. " and- time e also
 to is reading with  that T but re as at on p for) are --, and to in the of P.
:os or. & ( data, v and
 etc β€œ in or I account. more (– M.
 " i  is that/ to which time
 on e but  also has for re such as,- and - β€” of are in:- to information T or at,. and v
 with:
 &os for or I (.
..
 – ", change that can)
  [188 tok, 29.0s, 6.5 tok/s [STDP βœ“] [REP 1.3]]

yes I know there is a problem with online training I plan to fix it but for now try to save without online training and rebalance the model weights

Sign up or log in to comment