Hugging Face's logo

Spaces:
noppodev
/
NoppoIntelligence
Sleeping

App Files Community
noppodev commited on
Commit
3ca5b86
·
verified ·
1 Parent(s): 755fbc6

Update config.yaml

Browse files
Files changed (1) hide show
  1. config.yaml +6 -6
config.yaml CHANGED
@@ -1,11 +1,11 @@
1
  slices:
2
  - sources:
3
  - model: meta-llama/Llama-4-Maverick-17B-128E-Instruct
4
- layer_range: [0, 48]
5
  - model: google/gemma-4-E4B-it
6
- layer_range: [0, 48]
7
- merge_method: slerp
8
- base_model: meta-llama/Llama-4-Maverick-17B-128E-Instruct
9
  parameters:
10
- t: 0.5
11
- dtype: bfloat16
 
 
1
  slices:
2
  - sources:
3
  - model: meta-llama/Llama-4-Maverick-17B-128E-Instruct
4
+ layer_range: [0, 8] # レイヤーを大幅にカット
5
  - model: google/gemma-4-E4B-it
6
+ layer_range: [0, 8]
7
+ merge_method: linear
 
8
  parameters:
9
+ weight: 0.5
10
+ dtype: bfloat16
11
+ architecture: LlamaForCausalLM