ddh0

/

Norocetacean-20b-10k

like 1

ValueError: rope_scaling must be a dictionary with with two fields, type and factor, got {'factor': 2.5, 'finetuned': False, 'original_max_position_embeddings': 4096, 'type': 'yarn'}

I am getting the same error still. I am using TheBloke's AWQ version of this model and have seen that the configuration_llama.py rope_scaling has changed to None. I tried rope_scaling as None and "yarn" already but it still gives me that error. Any ideas on fixes?