README.md

---
library_name: transformers
license: mit
datasets:
- roneneldan/TinyStoriesInstruct
language:
- en
base_model:
- SauravP97/tiny-stories-19M-instruct
---

# Model Card for Model ID


## Model Details

This is a fine-tuned variant of the TinyStories 19M Base Model [View](https://huggingface.co/SauravP97/tiny-stories-19M). 
The model has been fine-tuned on the Tiny Stories Instruct dataset: [View](https://huggingface.co/datasets/roneneldan/TinyStoriesInstruct)

### Doing inference from the model:

```python
from transformers import AutoTokenizer, AutoModelForCausalLM

prompt = '''
Story: Once upon a time, there was a big, fat penguin named Puddles. Puddles loved to play with his friends on the ice.
One day, Puddles saw a big block of ice and decided to cut it. He used his sharp beak to cut the ice into small pieces.
Puddles and his friends had fun sliding on the ice pieces. They laughed and played until it was time to go home.
Puddles went to bed that night feeling happy and proud that he was able to cut the ice.

Summary:
'''

tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-neo-125M")

model_id = 'SauravP97/tiny-stories-19M-instruct'
pretrained_model = AutoModelForCausalLM.from_pretrained(model_id)

inputs = tokenizer(prompt, return_tensors="pt")

# Generate
output_tokens = pretrained_model.generate(
    inputs.input_ids,
    max_new_tokens=100, 
    do_sample=True,
    temperature=1, 
    top_k=50,
    pad_token_id=tokenizer.eos_token_id,
    eos_token_id=tokenizer.eos_token_id,
)

print(tokenizer.decode(output_tokens)[0])
```

### Output:

```
Story: Once upon a time, there was a big, fat penguin named Puddles. Puddles loved to play with his friends on the ice.
One day, Puddles saw a big block of ice and decided to cut it. He used his sharp beak to cut the ice into small pieces.
Puddles and his friends had fun sliding on the ice pieces. They laughed and played until it was time to go home.
Puddles went to bed that night feeling happy and proud that he was able to cut the ice.

Summary:

Summary: Puddles the penguin, a big fat penguin, cuts a block into small pieces to play with his friends on the ice.<|endoftext|>
```