Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -34,9 +34,10 @@ How to Convert LLM from Huggingface to axmodel[TODO]
|
|
| 34 |
- [M4N-Dock(爱芯派Pro)](https://wiki.sipeed.com/hardware/zh/maixIV/m4ndock/m4ndock.html)
|
| 35 |
- [M.2 Accelerator card](https://axcl-docs.readthedocs.io/zh-cn/latest/doc_guide_hardware.html)
|
| 36 |
|
| 37 |
-
|Chips|image encoder
|
| 38 |
|--|--|--|--|
|
| 39 |
-
|AX650| 216.257 ms | 861.213 ms |
|
|
|
|
| 40 |
|
| 41 |
|
| 42 |
## How to use
|
|
@@ -125,6 +126,4 @@ answer >> The image depicts a panda bear in a natural setting. The panda is sitt
|
|
| 125 |
|
| 126 |
prompt<<q
|
| 127 |
[INFO]: 对话结束,再见。
|
| 128 |
-
```
|
| 129 |
-

|
| 130 |
-

|
|
|
|
| 34 |
- [M4N-Dock(爱芯派Pro)](https://wiki.sipeed.com/hardware/zh/maixIV/m4ndock/m4ndock.html)
|
| 35 |
- [M.2 Accelerator card](https://axcl-docs.readthedocs.io/zh-cn/latest/doc_guide_hardware.html)
|
| 36 |
|
| 37 |
+
|Chips|image encoder|ttft|w8a16|
|
| 38 |
|--|--|--|--|
|
| 39 |
+
|AX650| 216.257 ms (1024x1024)| 861.213 ms (291tokens)| 11.90 tokens/sec|
|
| 40 |
+
|AX650| 44.747 ms (512x512)| 221.357 ms (99tokens)| 11.90 tokens/sec|
|
| 41 |
|
| 42 |
|
| 43 |
## How to use
|
|
|
|
| 126 |
|
| 127 |
prompt<<q
|
| 128 |
[INFO]: 对话结束,再见。
|
| 129 |
+
```
|
|
|
|
|
|