Instructions to use FredyRivera-dev/LLaDA-100M-Test with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FredyRivera-dev/LLaDA-100M-Test with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="FredyRivera-dev/LLaDA-100M-Test", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("FredyRivera-dev/LLaDA-100M-Test", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use FredyRivera-dev/LLaDA-100M-Test with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "FredyRivera-dev/LLaDA-100M-Test" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FredyRivera-dev/LLaDA-100M-Test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/FredyRivera-dev/LLaDA-100M-Test
- SGLang
How to use FredyRivera-dev/LLaDA-100M-Test with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "FredyRivera-dev/LLaDA-100M-Test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FredyRivera-dev/LLaDA-100M-Test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "FredyRivera-dev/LLaDA-100M-Test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FredyRivera-dev/LLaDA-100M-Test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use FredyRivera-dev/LLaDA-100M-Test with Docker Model Runner:
docker model run hf.co/FredyRivera-dev/LLaDA-100M-Test
Commit History
Update README.md ed16da2 verified
Fredy Rivera commited on
Update README.md a88da36 verified
Fr commited on
Update README.md 1f4d58c verified
Fr commited on
Update README.md 14f02ed verified
Fr commited on
Update README.md 3c448df verified
Fr commited on
Update README.md c8aeba3 verified
Fr commited on
Update README.md 542eaf0 verified
Fr commited on
Update README.md 1b28f2d verified
Fr commited on
Update README.md c4724cc verified
Fr commited on
Update README.md fe123e1 verified
Fr commited on
Update README.md 150b9c1 verified
Fr commited on
Update README.md 6ebd4e2 verified
Fr commited on
Update README.md 4c53cdb verified
Fr commited on
Update README.md 552b457 verified
Fr commited on
Update README.md caecd4b verified
Fr commited on
Update README.md b666896 verified
Fr commited on
Create README.md f5cb29d verified
Fr commited on