YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Running llama-mtmd-cli DeepSeekOCR Paper (First page)

  • build/bin/llama-mtmd-cli
  • -m gguf_models/deepseek-ai/deepseek-ocr-f16.gguf
  • --mmproj gguf_models/deepseek-ai/mmproj-deepseek-ocr-f16.gguf
  • --image tmp/mtmd_test_data/Deepseek-OCR-2510.18234v1_page1.png
  • -p "<|grounding|>Convert the document to markdown."
  • --chat-template deepseek-ocr --temp 0

Hard Test (Old Newspaper Image) build/bin/llama-mtmd-cli

  • -m gguf_models/deepseek-ai/deepseek-ocr-f16.gguf
  • --mmproj gguf_models/deepseek-ai/mmproj-deepseek-ocr-f16.gguf
  • --image tools/mtmd/test-1.jpeg
  • -p "<|grounding|>Convert the document to markdown."
  • --chat-template deepseek-ocr --temp 0
Downloads last month
31
GGUF
Model size
3B params
Architecture
deepseek2-ocr
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support