Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

FlagAlpha
/
Llama2-Chinese-13b-Chat-4bit

Question Answering
Transformers
Chinese
English
llama
text-generation
Model card Files Files and versions
xet
Community
5

Instructions to use FlagAlpha/Llama2-Chinese-13b-Chat-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use FlagAlpha/Llama2-Chinese-13b-Chat-4bit with Transformers:

    # Use a pipeline as a high-level helper
    from transformers import pipeline
    
    pipe = pipeline("question-answering", model="FlagAlpha/Llama2-Chinese-13b-Chat-4bit")
    # Load model directly
    from transformers import AutoTokenizer, AutoModelForCausalLM
    
    tokenizer = AutoTokenizer.from_pretrained("FlagAlpha/Llama2-Chinese-13b-Chat-4bit")
    model = AutoModelForCausalLM.from_pretrained("FlagAlpha/Llama2-Chinese-13b-Chat-4bit", device_map="auto")
  • Notebooks
  • Google Colab
  • Kaggle
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Could not find a model in....

#5 opened about 2 years ago by
hubblebubblepig

OSError: Llama2-Chinese-13b-Chat-4bit does not appear to have a file named generation_config.json. Checkout 'https://huggingface.co/Llama2-Chinese-13b-Chat-4bit/main' for available files.

#4 opened almost 3 years ago by
ycjcl868

saved model reload error 'LlamaAttention' object has no attribute 'qkv_proj'

2
#3 opened almost 3 years ago by
lilsyoss

GPTQ Quantization method

#2 opened almost 3 years ago by
gameveloster

乱码

1
#1 opened almost 3 years ago by
l1006986533
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs