Instructions to use maya-research/maya1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use maya-research/maya1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="maya-research/maya1")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("maya-research/maya1") model = AutoModelForCausalLM.from_pretrained("maya-research/maya1") - Notebooks
- Google Colab
- Kaggle
How can i fix ModuleNotFoundError: No module named 'vllm._C'
#18
by JayGeeUnreal - opened
I get ModuleNotFoundError: No module named 'vllm._C' when trying to run
python vllm_streaming_inference.py
Installed in a conda env using pip3
JayGeeUnreal changed discussion title from How con i fix ModuleNotFoundError: No module named 'vllm._C' to How can i fix ModuleNotFoundError: No module named 'vllm._C'
use wsl2 or linux