| license: mit | |
| base_model: Qwen/Qwen2.5-VL-7B | |
| tags: | |
| - OCR | |
| - vision-language | |
| - VLM | |
| - Reasoning | |
| - document-to-markdown | |
| - qwen2.5 | |
| - markdown | |
| - extraction | |
| - RAG | |
| - mlx | |
| model_name: NuMarkdown-8B-Thinking | |
| library_name: transformers | |
| pipeline_tag: image-to-text | |
| # numind/NuMarkdown-8B-Thinking-mlx-4bits | |
| This model was converted to MLX format from [`numind/NuMarkdown-8B-Thinking`]() using mlx-vlm version **0.3.7**. | |
| Refer to the [original model card](https://huggingface.co/numind/NuMarkdown-8B-Thinking) for more details on the model. | |
| ## Use with mlx | |
| ```bash | |
| pip install -U mlx-vlm | |
| ``` | |
| ```bash | |
| python -m mlx_vlm.generate --model numind/NuMarkdown-8B-Thinking-mlx-4bits --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image> | |
| ``` | |