unsloth
/

mistral-7b-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Use in pipeline

#1

by sudhir2016 - opened Feb 6, 2024

Can you us the model directly in transformers pipeline ?

Unsloth AI org Feb 6, 2024

@sudhir2016 Ye should work fine :) Your transformers version should just be 4.37 for it to work :)

Thanks Dan. Yes it works.

sudhir2016 changed discussion status to closed Feb 6, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment