optimum-intel-internal-testing
/

tiny-random-phi-4-mini-longrope

helenai commited on Nov 17, 2025

Commit

810dd97

verified ·

1 Parent(s): 39ed30b

Upload folder using huggingface_hub

Files changed (1) hide show

config.json CHANGED Viewed

@@ -25,7 +25,7 @@
   "num_attention_heads": 4,
   "num_hidden_layers": 4,
   "num_key_value_heads": 2,
-  "original_max_position_embeddings": 1024,
   "pad_token_id": 199999,
   "partial_rotary_factor": 0.75,
   "resid_pdrop": 0.0,

   "num_attention_heads": 4,
   "num_hidden_layers": 4,
   "num_key_value_heads": 2,
+  "original_max_position_embeddings": 4096,
   "pad_token_id": 199999,
   "partial_rotary_factor": 0.75,
   "resid_pdrop": 0.0,