linzhao-amd commited on
Commit
f6cbc7b
·
verified ·
1 Parent(s): eb8d4d0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -8
README.md CHANGED
@@ -22,16 +22,10 @@ library_name: transformers
22
  - **Operating System(s):** Linux
23
 
24
  # Model Details
25
- The official version of [deepseek-ai/DeepSeek-OCR](https://huggingface.co/deepseek-ai/DeepSeek-OCR) restricts the transformers library to version 4.46.3 and has not been updated to support the latest release. In this community edition, the modeling_deepseekocr.py file has been updated for improved usability, and modeling_deepseekv2.py has been removed in favor of using the DeepSeekV2 model definitions provided by the transformers library, eliminating the need for downgrading transformers. Furthermore, by using [AMD-Quark](https://quark.docs.amd.com/latest/index.html) and following the commands below, you can obtain the perplexity value for the text-to-text generation component.
26
- ```bash
27
- cd Quark/examples/torch/language_modeling/llm_ptq
28
 
29
- python3 quantize_quark.py \
30
- --model_dir amd/DeepSeek-OCR \
31
- --skip_quantization
32
- ```
33
 
34
- The quantized model based on this model: [amd/DeepSeek-OCR-MXFP4](https://huggingface.co/amd/DeepSeek-OCR-MXFP4)
35
 
36
  # Usage
37
  ```python
 
22
  - **Operating System(s):** Linux
23
 
24
  # Model Details
25
+ The official version of [deepseek-ai/DeepSeek-OCR](https://huggingface.co/deepseek-ai/DeepSeek-OCR) restricts the transformers library to version 4.46.3 and has not been updated to support the latest release. In this community edition, the `modeling_deepseekocr.py` file has been updated for improved usability, and `modeling_deepseekv2.py` has been removed in favor of using the DeepSeekV2 model definitions provided by the transformers library, eliminating the need for downgrading transformers.
 
 
26
 
27
+ This model can be quantized by using [AMD-Quark](https://quark.docs.amd.com/latest/index.html). The resulting quantized model is available at [amd/DeepSeek-OCR-MXFP4](https://huggingface.co/amd/DeepSeek-OCR-MXFP4).
 
 
 
28
 
 
29
 
30
  # Usage
31
  ```python