YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

scibert-wechsel-korean

Scibert(πŸ‡ΊπŸ‡Έ) converted into Korean(πŸ‡°πŸ‡·) using WECHSEL technique.

Description

  • SciBERT is trained on papers from the corpus of semanticscholar.org. Corpus size is 1.14M papers, 3.1B tokens.
  • Wechsel is converting embedding layer's subword tokens from source language to target language.
  • SciBERT trained with English language is converted into Korean langauge using Wechsel technique.
  • Korean tokenizer is selected with KLUE PLMs' tokenizers due to its similar vocab size(32000) and performance.

Reference

Downloads last month
66
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support