Upload qwen-web-HuggingFaceM4_WebSight-chunk-1-steps-160 - trained on HuggingFaceM4_WebSight chunk 1 with 160 steps

README.md

@@ -12,26 +12,22 @@ datasets:
 
 # qwen-web-HuggingFaceM4_WebSight-chunk-1-steps-160
 
-This model is a fine-tuned version of Qwen2.5-0.5B on web data.
+This model is a full fine-tuned version of Qwen2.5-0.5B on web data.
 
 ## Training Details
 - **Dataset**: HuggingFaceM4_WebSight
 - **Chunk**: 1
 - **Global Steps**: 160
 - **Focus**: web_layout_understanding
-- **Training Date**: 2025-07-30 13:59:23
+- **Training Date**: 2025-07-30 19:34:13
 
 ## Usage
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
-from peft import PeftModel
 
-# Load base model
-base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-0.5B")
-tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-0.5B")
-
-# Load fine-tuned model
-model = PeftModel.from_pretrained(base_model, "abdoosh1000/qwen-web-autonomous-models")
+# Load fine-tuned model and tokenizer
+model = AutoModelForCausalLM.from_pretrained("abdoosh1000/qwen-web-autonomous-models")
+tokenizer = AutoTokenizer.from_pretrained("abdoosh1000/qwen-web-autonomous-models")
 ```
 
 This model was trained using an autonomous training pipeline.

config.json

@@ -0,0 +1,29 @@
+{
+  "architectures": [
+    "Qwen2ForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 151643,
+  "eos_token_id": 151643,
+  "hidden_act": "silu",
+  "hidden_size": 896,
+  "initializer_range": 0.02,
+  "intermediate_size": 4864,
+  "max_position_embeddings": 32768,
+  "max_window_layers": 24,
+  "model_type": "qwen2",
+  "num_attention_heads": 14,
+  "num_hidden_layers": 24,
+  "num_key_value_heads": 2,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 1000000.0,
+  "sliding_window": 32768,
+  "tie_word_embeddings": true,
+  "torch_dtype": "float16",
+  "transformers_version": "4.52.4",
+  "use_cache": true,
+  "use_mrope": false,
+  "use_sliding_window": false,
+  "vocab_size": 151936
+}

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "bos_token_id": 151643,
+  "eos_token_id": 151643,
+  "max_new_tokens": 2048,
+  "transformers_version": "4.52.4"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3055a734d8abd494c23c6e83f982f458b8d287278381495c91d0f43550bd34a
+size 988097536

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ded8cd5defe2459e5807144fb2de5de753b421000e6ff7d2c7bd41c9147d1bb1
+oid sha256:3231e4005c63fa09c3a9a50893066795e7de97170bbe0f62be41b94a40a2d996
 size 5240