sbintuitions
/

tiny-lm

Text Generation

text-generation-inference

Model card Files Files and versions

ryo0634 commited on Jun 27, 2024

Commit

ce50360

·

verified ·

1 Parent(s): d3e1943

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ Trained on English and Japanese Wikipedia data.
 from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
 model = AutoModelForCausalLM.from_pretrained("sbintuitions/tiny-lm", torch_dtype="auto")
-tokenizer = AutoTokenizer.from_pretrained("sbintuitions/tiny-lm")
 generator = pipeline("text-generation", model=model, tokenizer=tokenizer)
 print(generator("Hello", max_length=30, do_sample=True, top_k=100))
 ```

 from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
 model = AutoModelForCausalLM.from_pretrained("sbintuitions/tiny-lm", torch_dtype="auto")
+tokenizer = AutoTokenizer.from_pretrained("sbintuitions/tiny-lm", use_fast=False)
 generator = pipeline("text-generation", model=model, tokenizer=tokenizer)
 print(generator("Hello", max_length=30, do_sample=True, top_k=100))
 ```