File size: 248 Bytes
ab130e4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 | Finetuning midddle layers (vision module layers = 22 to 26 +projector + language layers = 0 to 4) HyperParameters of this model lr: 2e-5 epochs: 3 batch size: 1 grad acumulation step: 1 mask = 262144 full vision module without patch embedding |