Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
anirvankrishna 's Collections
Parameter Space vs. Activation Space Interventions
A Comparative Analysis between RLHF PPO and DPO

A Comparative Analysis between RLHF PPO and DPO

updated 23 days ago

This collection contains the relevant trained models for the first assignment of the course CS60216: Safety Fundamentals for Generative AI.

Upvote
-

  • anirvankrishna/policy_model_training_subset

    Viewer • Updated Feb 26 • 4k • 4

  • anirvankrishna/TaskB_Full_Finetune

    Question Answering • 0.4B • Updated Mar 1 • 12

  • anirvankrishna/TaskA_Full_Finetune

    Reinforcement Learning • 0.4B • Updated Feb 28 • 9

  • anirvankrishna/TaskB_LoRA_Finetune

    Text Generation • Updated Mar 1 • 1

  • anirvankrishna/taskA_bert_reward_model

    Updated Feb 27

  • anirvankrishna/TaskB_QLoRA_Finetune

    Updated Mar 1

  • anirvankrishna/TaskA_LoRA_Finetune

    Reinforcement Learning • Updated Mar 1

  • anirvankrishna/TaskA_Prefix_Finetune

    Reinforcement Learning • Updated Mar 1 • 1

  • anirvankrishna/TaskB_Prefix_Finetune

    Updated Mar 1

  • anirvankrishna/TaskA_QLoRA_Finetune

    Reinforcement Learning • Updated Mar 2
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs