Commit
·
f7848c8
1
Parent(s):
46a238d
Update README.md
Browse files
README.md
CHANGED
|
@@ -29,6 +29,4 @@ You can use the `code-search-net-tokenizer` to preprocess code snippets and conv
|
|
| 29 |
|
| 30 |
**Limitations:**
|
| 31 |
|
| 32 |
-
The `code-search-net-tokenizer` is specifically tailored to code-related text data and may not be suitable for general text tasks. It may not perform optimally for natural language text outside the programming context.
|
| 33 |
-
|
| 34 |
-
*This model card is provided for informational purposes only and does not guarantee specific performance or outcomes when using the "code-search-net-tokenizer" with other language models. Users are encouraged to refer to the Hugging Face documentation and model repository for detailed information and updates.*
|
|
|
|
| 29 |
|
| 30 |
**Limitations:**
|
| 31 |
|
| 32 |
+
The `code-search-net-tokenizer` is specifically tailored to code-related text data and may not be suitable for general text tasks. It may not perform optimally for natural language text outside the programming context.
|
|
|
|
|
|