Hugging Face's logo

Lebossoti
/
MODEL_M3_FINETUNED

Text Generation
Transformers
Safetensors
qwen3
Generated from Trainer
trl
sft
conversational
text-generation-inference
Model card Files
xet
Community
Lebossoti commited on
Commit
45b3b9a
·
verified ·
1 Parent(s): f504477

Training in progress, step 500

Browse files
Files changed (3) hide show
  1. config.json +30 -0
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
config.json CHANGED
@@ -11,6 +11,36 @@
11
  "hidden_size": 1024,
12
  "initializer_range": 0.02,
13
  "intermediate_size": 3072,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  "max_position_embeddings": 32768,
15
  "max_window_layers": 28,
16
  "model_type": "qwen3",
 
11
  "hidden_size": 1024,
12
  "initializer_range": 0.02,
13
  "intermediate_size": 3072,
14
+ "layer_types": [
15
+ "full_attention",
16
+ "full_attention",
17
+ "full_attention",
18
+ "full_attention",
19
+ "full_attention",
20
+ "full_attention",
21
+ "full_attention",
22
+ "full_attention",
23
+ "full_attention",
24
+ "full_attention",
25
+ "full_attention",
26
+ "full_attention",
27
+ "full_attention",
28
+ "full_attention",
29
+ "full_attention",
30
+ "full_attention",
31
+ "full_attention",
32
+ "full_attention",
33
+ "full_attention",
34
+ "full_attention",
35
+ "full_attention",
36
+ "full_attention",
37
+ "full_attention",
38
+ "full_attention",
39
+ "full_attention",
40
+ "full_attention",
41
+ "full_attention",
42
+ "full_attention"
43
+ ],
44
  "max_position_embeddings": 32768,
45
  "max_window_layers": 28,
46
  "model_type": "qwen3",
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bea085e043a790c7f7be034fac0ac26721bf67a48dfa07c86a6db3edf75bb58f
3
  size 1192135096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d30bae31a97f60e9778f4caf18b7c38281ae583f9dcf0688759c1d9ef67e6bcb
3
  size 1192135096
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:93b7f0b038f4c2ebd9c8bba09651b9d9049d140e2dfbb4c601959b629b2220cc
3
  size 5624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7235b74faa3333986921c4229a383dbddbb521d1b32f9dc4b496c7230ea91a9
3
  size 5624