Instructions to use ocisd4/Phi-3-mini-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ocisd4/Phi-3-mini-tokenizer with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ocisd4/Phi-3-mini-tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
AlexHT_Hung commited on
Commit ·
4bb24b8
1
Parent(s): 6d96773
fix
Browse files- tokenizer.json +1 -1
tokenizer.json
CHANGED
|
@@ -77,7 +77,7 @@
|
|
| 77 |
},
|
| 78 |
{
|
| 79 |
"id": 32005,
|
| 80 |
-
"content": "<|
|
| 81 |
"single_word": false,
|
| 82 |
"lstrip": false,
|
| 83 |
"rstrip": true,
|
|
|
|
| 77 |
},
|
| 78 |
{
|
| 79 |
"id": 32005,
|
| 80 |
+
"content": "<|tool_calls|>",
|
| 81 |
"single_word": false,
|
| 82 |
"lstrip": false,
|
| 83 |
"rstrip": true,
|