7B模型加载失败(1.5B正常)

#2
by shawnhugs - opened

E RKNN: [12:13:33.367] failed to read weight tensor: must read size(4059037696), real read size(1064362072)
E RKNN: [12:13:35.348] load model file error!

8g内存不够 需要swap,执行以下命令后,再运行7b,实测成功

mkdir /userdata
dd if=/dev/zero of=/userdata/swapfile bs=1M count=10240
chmod 600 /userdata/swapfile
mkswap /userdata/swapfile
swapon /userdata/swapfile
free -mh

8g内存不够 需要swap,执行以下命令后,再运行7b,实测成功

mkdir /userdata
dd if=/dev/zero of=/userdata/swapfile bs=1M count=10240
chmod 600 /userdata/swapfile
mkswap /userdata/swapfile
swapon /userdata/swapfile
free -mh

谢谢反馈,但我这边测试还是无法运行,观测到在内存占到7.5GB、swap占用2.5GB时,进程会被kill掉。

Sign up or log in to comment