pfnet

/

plamo-2-1b

like 39

Follow

Preferred Networks, Inc. 232

Hi,
When I ran the example in the model card:

from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("pfnet/plamo-2-1b", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("pfnet/plamo-2-1b", trust_remote_code=True)
text = "これからの人工知能技術は"
input_ids = tokenizer(text, return_tensors="pt").input_ids
generated_tokens = model.generate(
    inputs=input_ids,
    max_new_tokens=32,
    do_sample=True,
    top_k=50,
    top_p=0.95,
    temperature=1.0,
)[0]
generated_text = tokenizer.decode(generated_tokens)
print(generated_text)

I encountered the following AssertionError when using a recent version of transformers (v4.56.1):

  File "/root/.cache/huggingface/modules/transformers_modules/pfnet/plamo-2-1b/74b112be12a9702ec3b4f98f7efafd2f1463f854/modeling_plamo.py", line 1430, in forward
    assert len(past_key_values_prev) == 0
AssertionError

However, this error does not occur with an older version (v4.44.2).
Therefore, I think it would be better to fix the transformers version as transformers==4.44.2 instead of transformers>=4.44.2 .
Best regards.