rope_scaling factor value is wrong. shoud be 2.0 instead of 2.5
#12
by lalalandw - opened
in the config.json. the scaling factor is 2.5. But no matter in the source code or in the convert weight python file(https://github.com/huggingface/transformers/blob/main/src/transformers/models/llava_next_video/convert_llava_next_video_weights_to_hf.py), all of them showed that the factor shoud be 2.0 when predict. And also the inference result is way much better in 2.0