mlx-community/A.X-4.0-Light-MLX-BF16

Original Model Link : https://huggingface.co/skt/A.X-4.0-Light

name: A.X-4.0-Light-MLX
base_model: Qwen/Qwen2.5-7B
license: apache-2.0
pipeline_tag: text-generation
tasks :
 - text-generation
 - text2text-generation
language :
 - en
 - ko
license_link: https://huggingface.co/skt/A.X-4.0-Light/blob/main/LICENSE
get_started_code: uvx --from mlx-lm mlx_lm.generate --model  --model mlx-community/A.X-4.0-Light-MLX --prompt 'Test Prompt' --prompt 'Test prompt'

A.X-4.0-Light-MLX

A.X-4.0-Light-MLX is a 7B model based on Qwen2.5

MLX is a framework for METAL graphics supported by Apple computers with ARM M-series processors (M1/M2/M3/M4)

Generation using uv https://docs.astral.sh/uv/**:

uvx --from mlx-lm mlx_lm.generate --model  --model mlx-community/A.X-4.0-Light-MLX --prompt 'Test Prompt'

Generation using pip:

pipx --from mlx-lm mlx_lm.generate --model  --model mlx-community/A.X-4.0-Light-MLX --prompt 'Test Prompt'