Image-Text-to-Text
Transformers
Safetensors
PEFT
vision-language-model
multimodal
document-understanding
document-ai
structured-extraction
json-generation
siglip
qwen2
lora
multilingual
indic-languages
english
hindi
bengali
tamil
synthetic-data
Instructions to use arikatokachi/Indic-Document-VLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use arikatokachi/Indic-Document-VLM with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="arikatokachi/Indic-Document-VLM")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("arikatokachi/Indic-Document-VLM", device_map="auto") - PEFT
How to use arikatokachi/Indic-Document-VLM with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use arikatokachi/Indic-Document-VLM with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "arikatokachi/Indic-Document-VLM" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "arikatokachi/Indic-Document-VLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/arikatokachi/Indic-Document-VLM
- SGLang
How to use arikatokachi/Indic-Document-VLM with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "arikatokachi/Indic-Document-VLM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "arikatokachi/Indic-Document-VLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "arikatokachi/Indic-Document-VLM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "arikatokachi/Indic-Document-VLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use arikatokachi/Indic-Document-VLM with Docker Model Runner:
docker model run hf.co/arikatokachi/Indic-Document-VLM
| {"sample_id": "certificate_bn_0071", "language_code": "bn", "document_type": "certificate", "ground_truth": {"document_type": "certificate", "name": "তনুশ্রী ভৌমিক", "father_name": "অরুণ ঘোষ", "category": "আয়", "address": "সিটি সেন্টার, দুর্গাপুর, পশ্চিমবঙ্গ", "authority": "রাজস্ব বিভাগ", "date": "29/03/2019"}, "prediction": {"document_type": "certificate", "name": "তনুশ্রী ভৌমিক", "father_name": "সমীর চক্রবর্তী", "category": "বাসস্থান", "address": "সল্টলেক, কলকাতা, পশ্চিমবঙ্গ", "authority": "গণবণ্টন দপ্তর", "date": "24/09/2018"}, "raw_prediction": "{\"document_type\":\"certificate\",\"name\":\"তনুশ্রী ভৌমিক\",\"father_name\":\"সমীর চক্রবর্তী\",\"category\":\"বাসস্থান\",\"address\":\"সল্টলেক, কলকাতা, পশ্চিমবঙ্গ\",\"authority\":\"গণবণ্টন দপ্তর\",\"date\":\"24/09/2018\"}", "valid_json": true, "document_exact_match": false, "field_exact_match": 0.2857142857142857, "expected_key_recall": 1.0, "hallucinated_key_rate": 0.0} | |
| {"sample_id": "resident_card_bn_0018", "language_code": "bn", "document_type": "resident_card", "ground_truth": {"document_type": "resident_card", "name": "সায়ন নন্দী", "dob": "10/12/1990", "gender": "অন্যান্য", "address": "খড়দহ, উত্তর ২৪ পরগনা, পশ্চিমবঙ্গ", "id_number": "RES-2788-PQK"}, "prediction": {"document_type": "resident_card", "name": "সায়ন নন্দী", "dob": "09/12/1963", "gender": "মহিলা", "address": "বর্ধমান শহর, পূর্ব বর্ধমান, পশ্চিমবঙ্গ", "id_number": "RES-8745-BCG"}, "raw_prediction": "{\"document_type\":\"resident_card\",\"name\":\"সায়ন নন্দী\",\"dob\":\"09/12/1963\",\"gender\":\"মহিলা\",\"address\":\"বর্ধমান শহর, পূর্ব বর্ধমান, পশ্চিমবঙ্গ\",\"id_number\":\"RES-8745-BCG\"}", "valid_json": true, "document_exact_match": false, "field_exact_match": 0.3333333333333333, "expected_key_recall": 1.0, "hallucinated_key_rate": 0.0} | |
| {"sample_id": "identity_card_en_0085", "language_code": "en", "document_type": "identity_card", "ground_truth": {"document_type": "identity_card", "name": "Arjun Batra", "father_name": "Vinod Malhotra", "dob": "06/08/1961", "id_number": "IDE-2946-QTJ"}, "prediction": {"document_type": "identity_card", "name": "Arjun Batra", "father_name": "Vinod Malhotra", "dob": "23/01/1967", "id_number": "IDE-4858-VXU"}, "raw_prediction": "{\"document_type\":\"identity_card\",\"name\":\"Arjun Batra\",\"father_name\":\"Vinod Malhotra\",\"dob\":\"23/01/1967\",\"id_number\":\"IDE-4858-VXU\"}", "valid_json": true, "document_exact_match": false, "field_exact_match": 0.6, "expected_key_recall": 1.0, "hallucinated_key_rate": 0.0} | |
| {"sample_id": "certificate_hi_0073", "language_code": "hi", "document_type": "certificate", "ground_truth": {"document_type": "certificate", "name": "कविता तिवारी", "father_name": "महेश यादव", "category": "निवास", "address": "वार्ड 12, जयपुर, राजस्थान", "authority": "नगर नागरिक सेवा कार्यालय", "date": "23/12/2022"}, "prediction": {"document_type": "certificate", "name": "कविता तिवारी", "father_name": "महेश यादव", "category": "निवास", "address": "पटेल नगर, गाजियाबाद, उत्तर प्रदेश", "authority": "नगर नागरिक सेवा कार्यालय", "date": "24/09/2023"}, "raw_prediction": "{\"document_type\":\"certificate\",\"name\":\"कविता तिवारी\",\"father_name\":\"महेश यादव\",\"category\":\"निवास\",\"address\":\"पटेल नगर, गाजियाबाद, उत्तर प्रदेश\",\"authority\":\"नगर नागरिक सेवा कार्यालय\",\"date\":\"24/09/2023\"}", "valid_json": true, "document_exact_match": false, "field_exact_match": 0.7142857142857143, "expected_key_recall": 1.0, "hallucinated_key_rate": 0.0} | |
| {"sample_id": "identity_card_hi_0025", "language_code": "hi", "document_type": "identity_card", "ground_truth": {"document_type": "identity_card", "name": "राहुल शर्मा", "father_name": "महेश यादव", "dob": "03/09/1984", "id_number": "IDE-1733-HMN"}, "prediction": {"document_type": "identity_card", "name": "पूजा यादव", "father_name": "हरि चौहान", "dob": "29/07/1965", "id_number": "IDE-3486-KYU"}, "raw_prediction": "{\"document_type\":\"identity_card\",\"name\":\"पूजा यादव\",\"father_name\":\"हरि चौहान\",\"dob\":\"29/07/1965\",\"id_number\":\"IDE-3486-KYU\"}", "valid_json": true, "document_exact_match": false, "field_exact_match": 0.2, "expected_key_recall": 1.0, "hallucinated_key_rate": 0.0} | |
| {"sample_id": "resident_card_hi_0081", "language_code": "hi", "document_type": "resident_card", "ground_truth": {"document_type": "resident_card", "name": "स्वाति अग्रवाल", "dob": "05/06/1968", "gender": "महिला", "address": "अरेरा कॉलोनी, भोपाल, मध्य प्रदेश", "id_number": "RES-3905-CBM"}, "prediction": {"document_type": "resident_card", "name": "स्वाति अग्रवाल", "dob": "29/07/1965", "gender": "महिला", "address": "अरेरा कॉलोनी, भोपाल, मध्य प्रदेश", "id_number": "RES-4839-UPM"}, "raw_prediction": "{\"document_type\":\"resident_card\",\"name\":\"स्वाति अग्रवाल\",\"dob\":\"29/07/1965\",\"gender\":\"महिला\",\"address\":\"अरेरा कॉलोनी, भोपाल, मध्य प्रदेश\",\"id_number\":\"RES-4839-UPM\"}", "valid_json": true, "document_exact_match": false, "field_exact_match": 0.6666666666666666, "expected_key_recall": 1.0, "hallucinated_key_rate": 0.0} | |
| {"sample_id": "certificate_ta_0060", "language_code": "ta", "document_type": "certificate", "ground_truth": {"document_type": "certificate", "name": "ஹரிணி சந்திரன்", "father_name": "நாராயணன்", "category": "நிலையான இருப்பிடம்", "address": "ஸ்ரீரங்கம், திருச்சிராப்பள்ளி, தமிழ்நாடு", "authority": "வருவாய் துறை", "date": "19/05/2025"}, "prediction": {"document_type": "certificate", "name": "ஹரிணி சந்திரன்", "father_name": "சுப்பிரமணியன் ராஜ்", "category": "வருமானம்", "address": "கே.கே. நகர், மதுரை, தமிழ்நாடு", "authority": "வருவாய் துறை", "date": "26/07/2025"}, "raw_prediction": "{\"document_type\":\"certificate\",\"name\":\"ஹரிணி சந்திரன்\",\"father_name\":\"சுப்பிரமணியன் ராஜ்\",\"category\":\"வருமானம்\",\"address\":\"கே.கே. நகர், மதுரை, தமிழ்நாடு\",\"authority\":\"வருவாய் துறை\",\"date\":\"26/07/2025\"}", "valid_json": true, "document_exact_match": false, "field_exact_match": 0.42857142857142855, "expected_key_recall": 1.0, "hallucinated_key_rate": 0.0} | |
| {"sample_id": "identity_card_ta_0007", "language_code": "ta", "document_type": "identity_card", "ground_truth": {"document_type": "identity_card", "name": "காவ்யா ராமன்", "father_name": "சுப்பிரமணியன் ராஜ்", "dob": "07/03/1977", "id_number": "IDE-9815-DBJ"}, "prediction": {"document_type": "identity_card", "name": "கார்த்திக் ராஜ்", "father_name": "செந்தில் குமார்", "dob": "26/07/1985", "id_number": "IDE-3416-WYU"}, "raw_prediction": "{\"document_type\":\"identity_card\",\"name\":\"கார்த்திக் ராஜ்\",\"father_name\":\"செந்தில் குமார்\",\"dob\":\"26/07/1985\",\"id_number\":\"IDE-3416-WYU\"}", "valid_json": true, "document_exact_match": false, "field_exact_match": 0.2, "expected_key_recall": 1.0, "hallucinated_key_rate": 0.0} | |