Transformers
English
Chinese
Vietnamese
roleplay
conversational
creative-writing
storytelling
multilingual
Instructions to use beyoru/Luna-MNN with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use beyoru/Luna-MNN with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("beyoru/Luna-MNN", dtype="auto") - Notebooks
- Google Colab
- Kaggle
| { | |
| "llm_model": "llm.mnn", | |
| "llm_weight": "llm.mnn.weight", | |
| "backend_type": "cpu", | |
| "thread_num": 4, | |
| "precision": "low", | |
| "memory": "low", | |
| "sampler_type": "penalty", | |
| "penalty": 1.1 | |
| } |