InferLLM-Model / README.md
kewin4933's picture
Update README.md
c74b68a
|
raw
history blame
530 Bytes
metadata
license: apache-2.0

The models can be loaded by the InferLLM project.

Chinese Alpaca model is from https://github.com/ymcui/Chinese-LLaMA-Alpaca

ggml Alpaca model is from https://huggingface.co/Sosaka/Alpaca-native-4bit-ggml/tree/main

the two models also can be loaded by the llama.cpp project.

InferLLM support the ChatGLM model, the chatglm-q4 is the int4 quantized model from chatglm-6b