Sample code not working in Colab even with A100
I am getting the below error when trying to run the sample code shared
AttributeError Traceback (most recent call last)
/tmp/ipython-input-2-3299664803.py in <cell line: 0>()
29
30 # generate output; maximum 200 new tokens; stop generation when <|endoftext|> is generated
---> 31 output = model.generate_from_batch(
32 inputs,
33 GenerationConfig(max_new_tokens=200, stop_strings="<|endoftext|>"),
5 frames
~/.cache/huggingface/modules/transformers_modules/allenai/Molmo-7B-O-0924/ed442fa7789ab66fc9f435f790823319d51196fb/modeling_molmo.py in _update_model_kwargs_for_generation(self, outputs, model_kwargs, is_encoder_decoder, num_new_tokens)
2273 del model_kwargs["image_masks"]
2274 del model_kwargs["image_input_idx"]
-> 2275 cache_name, cache = super()._extract_past_from_model_output(outputs)
2276 try:
2277 cache_name, cache = super()._extract_past_from_model_output(outputs)
AttributeError: 'super' object has no attribute '_extract_past_from_model_output'
Wrong posting for 'allenai/Molmo-7B-D-0924'..
The sample code that was not working was for 'allenai/Molmo-7B-O-0924'