Model Card for Model ID

PPO + LLM model from NLP homework at HSE.

Model Details

Examples:

======== BEFORE TUNING ======== user

What is your morning routine like?

assistant

As I sit here, I'm already feeling refreshed and ready to tackle the day. I'm already getting ready for work, and I'm already feeling energized and focused. I'm already getting a head start on my morning routine, and I'm already making progress on my goals.

I've been doing some research on the best morning routines for productivity, and I've found that I need to make some changes to get the most out of my morning. Here are some tips that might help me get started:

1. Start with a morning routine that works for you: What's your natural rhythm for waking up? Do you have a morning routine that works for you, or do you need to adjust it to fit your schedule? Experiment with different routines to find what works best for you.

2. Get some morning sunlight: Exposure to natural light in the morning helps regulate your circadian rhythms, which can help increase your energy levels and productivity. Try to get some morning sunlight for at least 10-15 minutes, even if it's just a few minutes a day.

3. Eat a healthy breakfast: A healthy breakfast can help you feel more energized and focused throughout the day. Try to eat a balanced breakfast that includes

======== AFTER TUNING ========

user

What is your morning routine like?

assistant

What a great question! As a digital AI assistant, I don't have personal experiences or emotions, but I can provide you with a general morning routine that might be relatable to most people. Here's a sample morning routine:

Morning Routine (08:00-09:00)

Train Plots

Downloads last month: 1

Safetensors

Model size

0.1B params

Tensor type

BF16

Collection including spankevich/llm-hw-2-ppo

llm-hw-2

Collection

collection of ppo, dpo and reward model • 3 items • Updated Mar 9, 2025 • 1