Instructions to use basharalrfooh/Fine-Tashkeel with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use basharalrfooh/Fine-Tashkeel with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="basharalrfooh/Fine-Tashkeel")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("basharalrfooh/Fine-Tashkeel") model = AutoModelForSeq2SeqLM.from_pretrained("basharalrfooh/Fine-Tashkeel") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use basharalrfooh/Fine-Tashkeel with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "basharalrfooh/Fine-Tashkeel" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "basharalrfooh/Fine-Tashkeel", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/basharalrfooh/Fine-Tashkeel
- SGLang
How to use basharalrfooh/Fine-Tashkeel with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "basharalrfooh/Fine-Tashkeel" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "basharalrfooh/Fine-Tashkeel", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "basharalrfooh/Fine-Tashkeel" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "basharalrfooh/Fine-Tashkeel", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use basharalrfooh/Fine-Tashkeel with Docker Model Runner:
docker model run hf.co/basharalrfooh/Fine-Tashkeel
Commit History
Update README.md e78a6cc verified
Update README.md e9adbe1 verified
Update README.md 6d2326d verified
Update README.md fbb06b2 verified
Update README.md f8d540f verified
Update README.md c9beccb verified
Update README.md f6b9846 verified
Update README.md a36f59c verified
Update README.md e54b7d6 verified
Update README.md 9c70266 verified
Update README.md 344247b verified
Upload 4 files 7aea6db verified
Delete tokenizer_config.json 92d6c9c verified
Delete special_tokens_map.json 5328e81 verified
Delete pytorch_model.bin e5c3319 verified
Delete generation_config.json b75288a verified
Upload config.json 23fe2b3 verified
Delete config.json 765cc6a verified
Upload 5 files a54ac13 verified
Delete model.ckpt-1012000.meta adf23dd verified
Delete model.ckpt-1012000.index 8fda36a verified
Delete model.ckpt-1012000.data-00001-of-00002 9a6bad1 verified
Delete model.ckpt-1012000.data-00000-of-00002 5103624 verified
Update README.md 5db7004 verified
Update README.md 6c939d4 verified
Update README.md adce6fb verified
Update README.md eea70d0 verified
Update README.md 8b8688d verified
arxiv: https://arxiv.org/abs/2303.14588 9783dbb verified
Update README.md 35c9e85 verified
Upload 8 files 0286511 verified
Update README.md 0d06bcf verified
Alrfooh commited on
Update README.md 5d6a96d verified
Alrfooh commited on
Update README.md 49c2253 verified
Alrfooh commited on
Update README.md cacf03c verified
Alrfooh commited on
Update README.md 2cc8368 verified
Alrfooh commited on
initial commit b4af494 verified
Alrfooh commited on