Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

zai-org
/
chatglm-6b-int4

Transformers
PyTorch
Chinese
English
chatglm
glm
thudm
custom_code
Model card Files Files and versions
xet
Community
22

Instructions to use zai-org/chatglm-6b-int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use zai-org/chatglm-6b-int4 with Transformers:

    # pip install -U transformers accelerate
    # Load model directly
    from transformers import AutoModel
    model = AutoModel.from_pretrained("zai-org/chatglm-6b-int4", trust_remote_code=True, device_map="auto")
  • Notebooks
  • Google Colab
  • Kaggle
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

调用模型出错,求佬指点一下

#22 opened over 1 year ago by
1lijunjie

Adding `safetensors` variant of this model

#21 opened about 2 years ago by
SFconvertbot

questioni

#20 opened about 2 years ago by
jldx17661290553

[AUTOMATED] Model Memory Requirements

#18 opened over 2 years ago by
model-sizer-bot

RuntimeError: Unknown platform: darwin

#17 opened about 3 years ago by
lanlanabcd

这个W8A16,fc计算的时候是先转成了fp16再计算的感觉没有加速作用?

#16 opened about 3 years ago by
YUTINGMORAN

跑代码报错

1
#15 opened over 3 years ago by
xihashenshi

训练 chatglm-6b-int4模型

#14 opened over 3 years ago by
zzzzzhao

mac m1上运行cli_deom.py超过10分钟都不显示结果

2
#13 opened over 3 years ago by
scroll2008

设置trust_remote_code=False运行时报错

2
#12 opened over 3 years ago by
michael234

mac M2 上尝试微调 chatglm-6b-int4 失败

2
#10 opened over 3 years ago by
xiao111

能用.safetensors格式加载chatglm-6b-int4吗?

#9 opened over 3 years ago by
win10

RuntimeError: Internal: [MASK] is already defined.

#5 opened over 3 years ago by
loong

model checkpoint has different layer shape with the model

#4 opened over 3 years ago by
bruce-cdx

Update README.md

#3 opened over 3 years ago by
GanymedeNil

protobug vision

1
#1 opened over 3 years ago by
YiSan
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs