Text Generation
Transformers
Safetensors
PyTorch
mistral
smarter
code
chemistry
biology
finance
legal
art
Mixture of Experts
Merge
text-generation-inference
music
climate
medical
673_trillion_parameters
Instructions to use ZeppelinCorp/Charm_15 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ZeppelinCorp/Charm_15 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ZeppelinCorp/Charm_15")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("ZeppelinCorp/Charm_15") model = AutoModelForCausalLM.from_pretrained("ZeppelinCorp/Charm_15", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use ZeppelinCorp/Charm_15 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ZeppelinCorp/Charm_15" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ZeppelinCorp/Charm_15", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/ZeppelinCorp/Charm_15
- SGLang
How to use ZeppelinCorp/Charm_15 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ZeppelinCorp/Charm_15" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ZeppelinCorp/Charm_15", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ZeppelinCorp/Charm_15" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ZeppelinCorp/Charm_15", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use ZeppelinCorp/Charm_15 with Docker Model Runner:
docker model run hf.co/ZeppelinCorp/Charm_15
Commit History
-
Update config.json
Verified signaturebefca45
-
Update README.md
Verified signature3d7f405
-
Create parameters.py
Verified signature0fcb291
-
Update model.safetensors
Verified signatureced2d25 -
Rename model_4_of_10.safetensors to model_4_of_278.safetensors
Verified signatureec8f409 -
Rename model_3_of_10.safetensors to model_3_of_278.safetensors
Verified signature589a376 -
Rename model_2_of_10.safetensors to model_2_of_278.safetensors
Verified signature2f2ac78 -
Rename model-1-of-10.safetensors to model-1-of-278.safetensors
Verified signature84d8acf -
Create model.safetensors
Verified signature8d2806a -
Create code_generate.py
Verified signaturecff74af -
Create model_4_of_10.safetensors
Verified signature7a92675
-
Create model_3_of_10.safetensors
Verified signaturee122497 -
Create model_2_of_10.safetensors
Verified signature4d8a04d -
Update model-1-of-10.safetensors
Verified signature9f4b545 -
Update base_model.safetensors
Verified signature10bfb12 -
Update base_model.safetensors
Verified signature80219c0 -
Rename model to model-1-of-10.safetensors
Verified signature0fabaf6 -
Create model
Verified signature6332035
-
Create chatbot.py
Verified signature81f26d6 -
Rename model to generate.py
Verified signatureeb813a3 -
Create model/
Verified signature6ad04d7
-
Create web_api.py
Verified signaturea5e50a2 -
Create utilis.py
Verified signature0ed8f16 -
Create config_loader.py
Verified signature651dc30 -
Create model.py
Verified signature434d0b4 -
Create data_loader.py
Verified signature6b81dd1 -
Update README.md
Verified signature7d82dd3 -
Update README.md
Verified signature8abedc8 -
Update README.md
Verified signature3216bab -
Create tokenizer_setup.py
Verified signaturec59a5cf -
Create evaluate.py
Verified signaturee75fa15 -
Create finetune.py
Verified signature21102ed -
Create inference.py
Verified signature8362c4c -
Update train.py
Verified signature4a6099f
-
Create train.py
Verified signature030ed20 -
Create generation_config.json
Verified signaturee9b78af -
Create tokenizer.json
Verified signatureaa3647a -
Create config.json
Verified signature39bb318 -
Update README.md
Verified signatureb98e216 -
Create base_model.safetensors
Verified signature87cbc7b
-
Update README.md
Verified signature09c4008
-
Update README.md
Verified signatured6d4acd -
Update README.md
Verified signaturebf7fc81 -
Update README.md
Verified signaturea5481af -
Update README.md
Verified signature25e1742
-
initial commit
Verified signature74d5e41