Instructions to use ZySec-AI/phi4-document-writer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ZySec-AI/phi4-document-writer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="ZySec-AI/phi4-document-writer", trust_remote_code=True)# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("ZySec-AI/phi4-document-writer", trust_remote_code=True) model = AutoModel.from_pretrained("ZySec-AI/phi4-document-writer", trust_remote_code=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Unsloth Studio new
How to use ZySec-AI/phi4-document-writer with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ZySec-AI/phi4-document-writer to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ZySec-AI/phi4-document-writer to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for ZySec-AI/phi4-document-writer to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="ZySec-AI/phi4-document-writer", max_seq_length=2048, )
Upload config.json
Browse files- config.json +4 -4
config.json
CHANGED
|
@@ -6,10 +6,10 @@
|
|
| 6 |
"attention_bias": false,
|
| 7 |
"attention_dropout": 0.0,
|
| 8 |
"auto_map": {
|
| 9 |
-
"AutoConfig": "
|
| 10 |
-
"AutoModelForCausalLM": "
|
| 11 |
-
"AutoTokenizer": "
|
| 12 |
-
|
| 13 |
"bos_token_id": 199999,
|
| 14 |
"embd_pdrop": 0.0,
|
| 15 |
"eos_token_id": 200020,
|
|
|
|
| 6 |
"attention_bias": false,
|
| 7 |
"attention_dropout": 0.0,
|
| 8 |
"auto_map": {
|
| 9 |
+
"AutoConfig": "configuration_phi3.Phi3Config",
|
| 10 |
+
"AutoModelForCausalLM": "modeling_phi3.Phi3ForCausalLM",
|
| 11 |
+
"AutoTokenizer": "Xenova/gpt-4o"
|
| 12 |
+
},
|
| 13 |
"bos_token_id": 199999,
|
| 14 |
"embd_pdrop": 0.0,
|
| 15 |
"eos_token_id": 200020,
|