How to use DidulaThavisha/base_test_4_sft_8bit_vllm with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("DidulaThavisha/base_test_4_sft_8bit_vllm", device_map="auto")
