Hugging Face's logo

mlx-community
/
DeepSeek-Coder-V2-Lite-Instruct-4bit-AWQ

Text Generation
MLX
Safetensors
deepseek_v2
conversational
custom_code
Model card Files
xet
 Community
sudo-0x2a commited on
Commit
a68259e
·
verified ·
1 Parent(s): 59c59b7

Add files using upload-large-folder tool

Browse files
Files changed (3) hide show
  1. README.md +1 -3
  2. model-00001-of-00002.safetensors +1 -1
  3. model-00002-of-00002.safetensors +1 -1
README.md CHANGED
@@ -2,10 +2,10 @@
2
  license: other
3
  license_name: deepseek-license
4
  license_link: LICENSE
5
- library_name: mlx
6
  tags:
7
  - mlx
8
  pipeline_tag: text-generation
 
9
  base_model: deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct
10
  ---
11
 
@@ -15,8 +15,6 @@ This model [mlx-community/deepseek-coder-v2-lite-instruct-4bit-awq](https://hugg
15
  converted to MLX format from [deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)
16
  using mlx-lm version **0.25.2**.
17
 
18
- AWQ Parameters: --bits 4 --group-size 64 --embed-bits 4 --embed-group-size 32 --num-samples 64 --sequence-length 512 --n-grid 50 with a customized calibration dataset
19
-
20
  ## Use with mlx
21
 
22
  ```bash
 
2
  license: other
3
  license_name: deepseek-license
4
  license_link: LICENSE
 
5
  tags:
6
  - mlx
7
  pipeline_tag: text-generation
8
+ library_name: mlx
9
  base_model: deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct
10
  ---
11
 
 
15
  converted to MLX format from [deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)
16
  using mlx-lm version **0.25.2**.
17
 
 
 
18
  ## Use with mlx
19
 
20
  ```bash
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a3a2e99bb8e334897d93eaa987a2f291bce79148936b86d0842081347e880f48
3
  size 5329652718
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:440437c26878ea85ab3a516caba412fd65cfa435daa2518328def367d1a0868d
3
  size 5329652718
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:085bcca766c7bd770beb2ebc5b24245c85a39fddda8b969f4d3f92bf0aab2186
3
  size 3536651032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcb6f6494941ae0b2ed5fb5f55180dc3512b1e569cebd9dc10d9ad90da8409ab
3
  size 3536651032