susnato

/

phi-2

like 12

I inference phi-2 with trasformers==4.36.2. But I got different results between this phi-2 and microsoft/phi-2 (trust_remote_code=True)
Here are corresponding codes
this phi-2

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("susnato/phi-2")
tokenizer = AutoTokenizer.from_pretrained("susnato/phi-2")

inputs = tokenizer('Can you help me write a formal email to a potential business partner proposing a joint venture?', return_tensors="pt", return_attention_mask=False)

outputs = model.generate(**inputs, max_length=256)
text = tokenizer.batch_decode(outputs)[0]
print(text)

The results were

Can you help me write a formal email to a potential business partner proposing a joint venture?
## INSTRUCTION
## INPUT
We are looking to expand our business relationship
##OUTPUT
##OUTPUT
##OUTPUT
## INSTRUCTIONS
#

For microsoft/phi-2

from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained('microsoft/phi-2', trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained('microsoft/phi-2', trust_remote_code=True)
prompt = 'Can you help me write a formal email to a potential business partner proposing a joint venture?'
input = tokenizer(prompt, return_tensors="pt")
generate_id = model.generate(input.input_ids,max_length=256)
output = tokenizer.batch_decode(generate_id)[0]
print(output)

while the results were

Can you help me write a formal email to a potential business partner proposing a joint venture?
Input: Company A: ABC Inc.
Company B: XYZ Ltd.
Joint Venture: A new online platform for e-commerce
Output: Dear Mr. Smith,

I am writing to you on behalf of ABC Inc., a leading provider of e-commerce solutions. I am interested in exploring the possibility of a joint venture with XYZ Ltd., a reputable online retailer.

We have been following your company's impressive growth and innovation in the e-commerce sector, and we believe that we have a lot to offer each other. We have extensive experience and expertise in developing and managing online platforms for e-commerce, with a proven track record of delivering high-quality products and services to our clients. We also have a strong network of suppliers, distributors, and customers, as well as a dedicated team of professionals.

We propose to create a new online platform for e-commerce that combines our strengths and resources, and leverages our mutual opportunities and goals. The platform would offer a wide range of products and services, from various categories and brands, at competitive prices and with fast delivery. The platform would also provide features such as secure payment,

Obviously, the microsoft/phi-2 results are better