Elias-Schwegler
/

IQuest-Coder-V1-40B-Loop-Instruct-NVFP4

Text Generation

iquestloopcoder

custom-architecture

Model card Files Files and versions

Elias-Schwegler commited on Feb 1

Commit

87aee8f

·

verified ·

1 Parent(s): 58631dd

Upload config.json with huggingface_hub

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -23,7 +23,7 @@
   "intermediate_size": 27648,
   "loop_num": 2,
   "loop_window_size": 64,
-  "max_position_embeddings": 131072,
   "mlp_bias": false,
   "model_type": "iquestloopcoder",
   "num_attention_heads": 40,

   "intermediate_size": 27648,
   "loop_num": 2,
   "loop_window_size": 64,
+  "max_position_embeddings": 16384,
   "mlp_bias": false,
   "model_type": "iquestloopcoder",
   "num_attention_heads": 40,