Instructions to use mlc-ai/phi-2-q4f16_1-MLC with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLC-LLM
How to use mlc-ai/phi-2-q4f16_1-MLC with MLC-LLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Update mlc-chat-config.json
Browse files- mlc-chat-config.json +1 -0
mlc-chat-config.json
CHANGED
|
@@ -2,6 +2,7 @@
|
|
| 2 |
"model_type": "phi-msft",
|
| 3 |
"quantization": "q4f16_1",
|
| 4 |
"model_config": {
|
|
|
|
| 5 |
"vocab_size": 51200,
|
| 6 |
"n_positions": 2048,
|
| 7 |
"n_embd": 2560,
|
|
|
|
| 2 |
"model_type": "phi-msft",
|
| 3 |
"quantization": "q4f16_1",
|
| 4 |
"model_config": {
|
| 5 |
+
"model_type": "phi-msft",
|
| 6 |
"vocab_size": 51200,
|
| 7 |
"n_positions": 2048,
|
| 8 |
"n_embd": 2560,
|