Instructions to use Yhyu13/BiLLa-7B-LLM-gptq-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Yhyu13/BiLLa-7B-LLM-gptq-4bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Yhyu13/BiLLa-7B-LLM-gptq-4bit", dtype="auto") - Notebooks
- Google Colab
- Kaggle
GPTQ 4-bit no actor version for compatibility that works in textgen-webui
Generated by using scripts from https://gitee.com/yhyu13/llama_-tools
Original weight : https://huggingface.co/Neutralzz/BiLLa-7B-LLM
- Downloads last month
- 2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support