Instructions to use FredyRivera-dev/LLaDA-100M-Test with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FredyRivera-dev/LLaDA-100M-Test with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="FredyRivera-dev/LLaDA-100M-Test", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("FredyRivera-dev/LLaDA-100M-Test", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use FredyRivera-dev/LLaDA-100M-Test with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "FredyRivera-dev/LLaDA-100M-Test" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FredyRivera-dev/LLaDA-100M-Test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/FredyRivera-dev/LLaDA-100M-Test
- SGLang
How to use FredyRivera-dev/LLaDA-100M-Test with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "FredyRivera-dev/LLaDA-100M-Test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FredyRivera-dev/LLaDA-100M-Test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "FredyRivera-dev/LLaDA-100M-Test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FredyRivera-dev/LLaDA-100M-Test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use FredyRivera-dev/LLaDA-100M-Test with Docker Model Runner:
docker model run hf.co/FredyRivera-dev/LLaDA-100M-Test
Commit History
Update README.md ed16da2 verified
Fredy Rivera commited on
Update README.md a88da36 verified
Fr commited on
Update README.md 1f4d58c verified
Fr commited on
Upload lladaout.PNG 1212bcc verified
Fr commited on
Update README.md 14f02ed verified
Fr commited on
Update README.md 3c448df verified
Fr commited on
New checkpoint trained in 8,000 steps and 65,536,000 tokens 2cb0949 verified
Fr commited on
Delete tokenizer_config.json dd2fa85 verified
Fr commited on
Delete tokenizer.json 17f3e7c verified
Fr commited on
Delete special_tokens_map.json 8fc80d7 verified
Fr commited on
Delete generation_config.json d451f05 verified
Fr commited on
Delete model.safetensors cc5c40f verified
Fr commited on
Delete model.py c3d2ce9 verified
Fr commited on
Delete configs_llada.py 4401024 verified
Fr commited on
Delete config.json 1951edc verified
Fr commited on
Delete chat_template.jinja 74fc6ef verified
Fr commited on
Update README.md c8aeba3 verified
Fr commited on
Update README.md 542eaf0 verified
Fr commited on
Update README.md 1b28f2d verified
Fr commited on
Update README.md c4724cc verified
Fr commited on
Update config.json bdfa371 verified
Fr commited on
Create configs_llada.py bbd9c60 verified
Fr commited on
Update model.py 3b5f344 verified
Fr commited on
Upload model.py 3ef8190 verified
Fr commited on
Update README.md fe123e1 verified
Fr commited on
Add files using upload-large-folder tool 3eebc54 verified
Fr commited on
Update README.md 150b9c1 verified
Fr commited on
Delete tokenizer_config.json d7ae0d3 verified
Fr commited on
Delete tokenizer.json aa9307e verified
Fr commited on
Delete special_tokens_map.json 6fd408b verified
Fr commited on
Delete modeling_llada.py 31729cb verified
Fr commited on
Delete llada_ckpt_002000.pt 704d4c6 verified
Fr commited on
Delete generation_config.json e13a8ad verified
Fr commited on
Delete configs_llada.py a3c6773 verified
Fr commited on
Delete config.json be25dad verified
Fr commited on
Create generation_config.json e2f8384 verified
Fr commited on
Upload config.json f8cf1ae verified
Fr commited on
Upload tokenizer_config.json d257c18 verified
Fr commited on
Upload tokenizer.json 4e8dca5 verified
Fr commited on
Create special_tokens_map.json 1b07968 verified
Fr commited on
Create configs_llada.py 91f9da8 verified
Fr commited on
Update modeling_llada.py a2ad456 verified
Fr commited on
Create modeling_llada.py 4d7b6bd verified
Fr commited on
Update README.md 6ebd4e2 verified
Fr commited on
Update README.md 4c53cdb verified
Fr commited on
Upload llada_ckpt_002000.pt with huggingface_hub e8bab74 verified
Fr commited on
Update README.md 552b457 verified
Fr commited on
Update README.md caecd4b verified
Fr commited on
Update README.md b666896 verified
Fr commited on