zai-org
/

chatglm-6b

Model card Files Files and versions

support multi gpu and remove some bug

#16

by yuanzhoulvpi - opened Mar 28, 2023

base: refs/heads/main

←

from: refs/pr/16

Discussion Files changed

•

edited Mar 28, 2023

支持多GPU训练，之前是不支持的（主要做的是修改了部分变量的device id）
在多卡并行的时候，会遇到（TypeError: 'NoneType' object is not subscriptable）。主要是因为RotaryEmbedding的forward部分。已经把这个bug修改了。

support multi gpu and remove some bugf2435619

yuanzhoulvpi changed pull request status to closed Mar 29, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment