Instructions to use bleedchocolate/abOCR with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bleedchocolate/abOCR with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="bleedchocolate/abOCR")# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("bleedchocolate/abOCR") model = AutoModelForMultimodalLM.from_pretrained("bleedchocolate/abOCR") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use bleedchocolate/abOCR with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "bleedchocolate/abOCR" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bleedchocolate/abOCR", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/bleedchocolate/abOCR
- SGLang
How to use bleedchocolate/abOCR with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "bleedchocolate/abOCR" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bleedchocolate/abOCR", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "bleedchocolate/abOCR" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bleedchocolate/abOCR", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use bleedchocolate/abOCR with Docker Model Runner:
docker model run hf.co/bleedchocolate/abOCR
Commit ·
692c253
1
Parent(s): a6a807c
Training in progress, epoch 1
Browse files
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1539625673
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:be216f6cf80c53b978a1b165b7a44af4a16bb0efff27580ae86710384de0d584
|
| 3 |
size 1539625673
|
runs/Mar05_01-23-53_30bc91c8f0e6/1677979877.1180692/events.out.tfevents.1677979877.30bc91c8f0e6.4238.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ae3ae7d29e43ae17b5e68e078499cce849a167a4173f7fa3ab7a194017b30cf5
|
| 3 |
+
size 5928
|
runs/Mar05_01-23-53_30bc91c8f0e6/events.out.tfevents.1677979877.30bc91c8f0e6.4238.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:94f9d0b3da51a4ac0bf98c4cdfbae9dd643acf6d50534470d080ed328310278f
|
| 3 |
+
size 8346
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 3643
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eeeffc925aa8279b3216609d9bb6c81d0dfacf60f6e4028255d9f8929b3747ff
|
| 3 |
size 3643
|