|
|
--- |
|
|
license: mit |
|
|
library_name: mlx |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- transformers |
|
|
- mlx |
|
|
base_model: meituan-longcat/LongCat-Flash-Chat |
|
|
--- |
|
|
|
|
|
This model [finding1/LongCat-Flash-Chat-MLX-5.5bpw](https://huggingface.co/finding1/LongCat-Flash-Chat-MLX-5.5bpw) was |
|
|
converted to MLX format from [meituan-longcat/LongCat-Flash-Chat](https://huggingface.co/meituan-longcat/LongCat-Flash-Chat) |
|
|
using mlx-lm version **0.27.1** by running |
|
|
`mlx_lm.convert --quantize --q-bits 5 --mlx-path MLX-5.5bpw --hf-path meituan-longcat/LongCat-Flash-Chat` |
|
|
until it crashed with a `KeyError`; |
|
|
[adding `"model_type": "longcat_flash",` to the downloaded `config.json`](https://github.com/ml-explore/mlx-lm/issues/433#issuecomment-3262138687), |
|
|
then running the command again. |
|
|
|
