Spaces:
Running
Running
tokutsu commited on
Commit ·
715ff6a
1
Parent(s): a0f7b9d
Update README for Spaces display issue
Browse files
README.md
CHANGED
|
@@ -7,11 +7,15 @@ short_description: Patch for ExLlamaV2 to support Unigram-based tokenizers
|
|
| 7 |
|
| 8 |
# Unigram Tokenizer Patch for ExLlamaV2
|
| 9 |
|
| 10 |
-
|
| 11 |
-
|
|
|
|
| 12 |
|
| 13 |
---
|
| 14 |
|
|
|
|
|
|
|
|
|
|
| 15 |
## Files
|
| 16 |
|
| 17 |
- `hf.py.patch`
|
|
@@ -20,8 +24,6 @@ By default, using a Unigram tokenizer may result in an error during inference. T
|
|
| 20 |
- `apply_patch.sh`
|
| 21 |
A shell script to apply the patch.
|
| 22 |
|
| 23 |
-
---
|
| 24 |
-
|
| 25 |
## Usage
|
| 26 |
|
| 27 |
You can apply the patch with the following command:
|
|
|
|
| 7 |
|
| 8 |
# Unigram Tokenizer Patch for ExLlamaV2
|
| 9 |
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
Note: Due to a known display issue on Hugging Face Spaces, only the beginning portion of this README is visible in the app view. Please refer to the full [README file](https://huggingface.co/spaces/tokutsu/exllamav2_patch/blob/main/README.md) for complete information.
|
| 13 |
|
| 14 |
---
|
| 15 |
|
| 16 |
+
This repository provides a patch to support **Unigram-based tokenizers** with `ExLlamaV2`.
|
| 17 |
+
By default, using a Unigram tokenizer may result in an error during inference. This patch resolves that issue.
|
| 18 |
+
|
| 19 |
## Files
|
| 20 |
|
| 21 |
- `hf.py.patch`
|
|
|
|
| 24 |
- `apply_patch.sh`
|
| 25 |
A shell script to apply the patch.
|
| 26 |
|
|
|
|
|
|
|
| 27 |
## Usage
|
| 28 |
|
| 29 |
You can apply the patch with the following command:
|