Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

lapp0
/
istily_bench_gpt2_simple_objectives

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Files and versions
xet
Metrics Training metrics Community
istily_bench_gpt2_simple_objectives / logs
17.1 MB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 6 commits

This model has 1 file scanned as suspicious.

lapp0's picture
lapp0
End of training
1394416 verified almost 2 years ago
  • distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0.1__activations_loss_fn_(fn_mse_loss())__attentions_weight_0__attentions_loss_fn_(f
    Training in progress, step 24750 almost 2 years ago
  • distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0.2__activations_loss_fn_(fn_mse_loss())__attentions_weight_0__attentions_loss_fn_(f
    End of training almost 2 years ago
  • distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0__activations_loss_fn_(fn_mse_loss())__attentions_weight_0__attentions_loss_fn_(fn_
    Training in progress, step 24750 almost 2 years ago