Instructions to use Yhyu13/BiLLa-7B-LLM-gptq-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Yhyu13/BiLLa-7B-LLM-gptq-4bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Yhyu13/BiLLa-7B-LLM-gptq-4bit", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- de00f8ed89b5d651d157680f7a7e8af7b4835418a74afbdfa408b47c969be682
- Size of remote file:
- 700 kB
- SHA256:
- 39ea56d83c2c49dd507c25b99a6974b31149790b5f49015ee1437a9e84f43b2f
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.