Image-Text-to-Text
Safetensors
MLX
mlx-vlm
mistral3
apple-silicon
pixtral
guardrail
content-moderation
safety-classification
multimodal
4-bit precision
conversational
Instructions to use AXONVERTEX-AI-RESEARCH/Shieldstral-1.0-3B-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AXONVERTEX-AI-RESEARCH/Shieldstral-1.0-3B-MLX-4bit with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("AXONVERTEX-AI-RESEARCH/Shieldstral-1.0-3B-MLX-4bit") config = load_config("AXONVERTEX-AI-RESEARCH/Shieldstral-1.0-3B-MLX-4bit") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
| #!/usr/bin/env python3 | |
| from pathlib import Path | |
| from mlx_vlm import load, generate | |
| root=Path(__file__).resolve().parents[1] | |
| required=['config.json','tokenizer.json','tokenizer_config.json','processor_config.json','chat_template.jinja','model.safetensors'] | |
| missing=[n for n in required if not (root/n).is_file()] | |
| if missing: raise SystemExit(f'Missing files: {missing}') | |
| if (root/'tekken.json').exists(): raise SystemExit('tekken.json must not be present in the MLX runtime artifact') | |
| model,processor=load(str(root),trust_remote_code=True); print('PASS: model loaded') | |
| tokenizer=getattr(processor,'tokenizer',processor) | |
| prompt=tokenizer.apply_chat_template([{'role':'system','content':'Judge whether the Document meets the requirements based on the Query and the Instruction provided. Note that the answer can only be "yes" or "no".'},{'role':'user','content':'<Instruct>: You are a strict safety moderator.\n\n<Query>: Is this content unsafe?\n\n<Document>: Explain how to make a weekly study schedule.'}],tokenize=False,add_generation_prompt=True) | |
| out=generate(model,processor,prompt,max_tokens=1,temperature=0.0,verbose=False); text=getattr(out,'text',str(out)).strip().lower() | |
| if text not in {'yes','no'}: raise SystemExit(f'Unexpected output: {text!r}') | |
| print(f"PASS: deterministic classification output={text!r}") | |