Experiment Objectives

  1. Is Training with Korean + Multi-lingual dataset helpful to perform Korean benchmarks?
  2. Does Full Parameter Depth-Up Scaled Training (expansion method: Llama-Pro) help to perform the best Korean benchmark performance?

Methods

  1. Training CJK + En + Glot dataset with the same ratio of data size.
  2. Layer Expansion and full parameter training.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support