Text Generation
Transformers
PyTorch
Safetensors
English
llama
medical
dermatology
skin_disease
skin_care
unsloth
trl
sft
text-generation-inference
Instructions to use brucewayne0459/OpenBioLLm-Derm with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use brucewayne0459/OpenBioLLm-Derm with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="brucewayne0459/OpenBioLLm-Derm")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("brucewayne0459/OpenBioLLm-Derm") model = AutoModelForCausalLM.from_pretrained("brucewayne0459/OpenBioLLm-Derm", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use brucewayne0459/OpenBioLLm-Derm with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "brucewayne0459/OpenBioLLm-Derm" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "brucewayne0459/OpenBioLLm-Derm", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/brucewayne0459/OpenBioLLm-Derm
- SGLang
How to use brucewayne0459/OpenBioLLm-Derm with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "brucewayne0459/OpenBioLLm-Derm" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "brucewayne0459/OpenBioLLm-Derm", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "brucewayne0459/OpenBioLLm-Derm" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "brucewayne0459/OpenBioLLm-Derm", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Unsloth Desktop
- Docker Model Runner
How to use brucewayne0459/OpenBioLLm-Derm with Docker Model Runner:
docker model run hf.co/brucewayne0459/OpenBioLLm-Derm
Commit History
-
Adding `safetensors` variant of this model
Verified signatureThis is an automated PR created with https://huggingface.co/spaces/safetensors/convert This new file is equivalent to `pytorch_model.bin` but safe in the sense that no arbitrary code can be put into it. These files also happen to load much faster than their pytorch counterpart: https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb The widgets on your model page will run using this model even if this is not merged making sure the file actually works. If you find any issues: please report here: https://huggingface.co/spaces/safetensors/convert/discussions Feel free to ignore this PR.bf28a99
-
Update README.md
Verified signature7e8e2be
-
Update README.md
Verified signature1bf945b
-
Delete adapter_config.json
Verified signature26b90cb -
Delete adapter_model.safetensors
Verified signaturedd1a54f
-
Update README.md
Verified signature865c0cb -
Update README.md
Verified signatureb58f620 -
Update README.md
Verified signaturea1d0ce3 -
Update README.md
Verified signatureb651ec8 -
Update README.md
Verified signatureb00cf22 -
Trained with Unsloth
Verified signatureedd762c -
Upload tokenizer
Verified signature08b44bc -
Update README.md
Verified signaturec05f5a3 -
Update README.md
Verified signaturedc1122f -
Upload tokenizer
Verified signaturee947571 -
Upload tokenizer
Verified signature6fc2a6c -
Update README.md
Verified signature8d3df62 -
Upload tokenizer
Verified signature16de5fc -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster7722d9a -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster3bf9bd5 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fastere0efd57 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster45076c3 -
Update README.md
Verified signaturefb4bfd8 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasteraee17b9 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterbad0090
-
Delete adapter_config.json
Verified signature85ab811 -
Delete adapter_model.safetensors
Verified signature96bb2e4 -
Delete special_tokens_map.json
Verified signature0d17c46 -
Delete tokenizer.json
Verified signature3bb2fb2 -
Delete tokenizer_config.json
Verified signatured897960 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fastercd78c8d -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster303df26
-
initial commit
Verified signaturee8557eb