Text Generation
Transformers
PyTorch
English
crystalcoder
llm
code
custom_code
Eval Results (legacy)
Instructions to use IFM/CrystalChat with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use IFM/CrystalChat with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="IFM/CrystalChat", trust_remote_code=True)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("IFM/CrystalChat", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use IFM/CrystalChat with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "IFM/CrystalChat" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "IFM/CrystalChat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/IFM/CrystalChat
- SGLang
How to use IFM/CrystalChat with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "IFM/CrystalChat" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "IFM/CrystalChat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "IFM/CrystalChat" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "IFM/CrystalChat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use IFM/CrystalChat with Docker Model Runner:
docker model run hf.co/IFM/CrystalChat
Commit History
Update README.md a8e8433 verified
Update README.md 0cf2c90 verified
Update README.md ea365a8 verified
Update README.md 29f2dea verified
Update README.md c1ff296 verified
Update README.md f2ff0be verified
Update README.md a24e68d verified
Update README.md b279ee7 verified
Update README.md f692d0d verified
Update README.md 36ae419 verified
Update README with data and training info 913e970 verified
Upload data_table.jpg 036d006 verified
Update README.md 7a03621 verified
Update README.md 0b5e5c5 verified
Rename test2.png to cc-eval-lang-compare.png 8b6fa5b verified
Delete cc-eval-lang-compare.png 48f06b0 verified
Update README.md 63fef20 verified
Upload test2.png b6ab53c verified
Update README.md 374f200 verified
Upload test1.png b86ea8d verified
Update README.md b3cc9d6 verified
Rename cc-std-eval-benchmarks.png to cc-eval-std-benchmarks.png b1a6a56 verified
Rename cc-std-eval.png to cc-std-eval-benchmarks.png 90abd53 verified
Delete cc-eval-std-benchmarks.png 753cbba verified
Upload cc-std-eval.png f57bb81 verified
Update README.md 3db9e99 verified
Rename lang-no-backgroud.png to cc-eval-lang-compare.png 7730329 verified
Delete cc-eval-lang-compare.png 450b1ce verified
Update README.md 3467fdb verified
Upload lang-no-backgroud.png ab2a451 verified
Update README.md 887ace8 verified
Update README.md 8f9abff verified
Update README.md 7214e55 verified
Update README.md 76d6397 verified
Rename cc-std-benchmarks.png to cc-eval-std-benchmarks.png e632201 verified
Rename langage comparison - dotted line.png to cc-eval-lang-compare.png 534d3d5 verified
Rename standard benchmarks iwth dotted linesPicture1.png to cc-std-benchmarks.png ea521b9 verified
Upload 3 files 62a2952 verified
Update README.md 6312547 verified
Update README.md 2f2a1c8 verified
Update README.md d6cd77d
Update README.md ed4ff73
Update README.md c5f8676
Update README.md 6be81f3
Upload folder using huggingface_hub bd4b02d
Update README.md c5386f2
Update README.md 99f98df
Update README.md c40be13
initial commit c0c250e
Yuqi Wang commited on