Instructions to use OpenDFM/ChemDFM-v1.0-13B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OpenDFM/ChemDFM-v1.0-13B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="OpenDFM/ChemDFM-v1.0-13B")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("OpenDFM/ChemDFM-v1.0-13B") model = AutoModelForCausalLM.from_pretrained("OpenDFM/ChemDFM-v1.0-13B") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use OpenDFM/ChemDFM-v1.0-13B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "OpenDFM/ChemDFM-v1.0-13B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OpenDFM/ChemDFM-v1.0-13B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/OpenDFM/ChemDFM-v1.0-13B
- SGLang
How to use OpenDFM/ChemDFM-v1.0-13B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "OpenDFM/ChemDFM-v1.0-13B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OpenDFM/ChemDFM-v1.0-13B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "OpenDFM/ChemDFM-v1.0-13B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OpenDFM/ChemDFM-v1.0-13B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use OpenDFM/ChemDFM-v1.0-13B with Docker Model Runner:
docker model run hf.co/OpenDFM/ChemDFM-v1.0-13B
Commit History
Update bibtex 30821f0 verified
Update README.md bebd4c7 verified
update the name of ChemDFM-v1.0 56f8fc9
TravelLeraLone commited on
release ChemDFM-v1.5-8B 36c8f73
TravelLeraLone commited on
release ChemDFM-v1.5-8B 44e0761
TravelLeraLone commited on
Update results of SciKnowEval 811dc4c
TravelLeraLone commited on
correct typo ba41762
TravelLeraLone commited on
Evaluation data release d9a8ba2
TravelLeraLone commited on
Evaluation data release 1026b9a
TravelLeraLone commited on
Evaluation data release 9e3c6f1
TravelLeraLone commited on
Update README.md 0e00bcf verified
Update README 002026f
TravelLeraLone commited on
Update README e2b8735
TravelLeraLone commited on
Upload Model Files 52aa54b
TravelLeraLone commited on