deliciouscat
/

kf-deberta-base-cross-sts

Sentence Similarity

text-classification

text-embeddings-inference

Model card Files Files and versions

KF-DeBERTa-base-cross-STS

pre-trained model: KF-DeBERTa-base-cross-NLI (https://huggingface.co/deliciouscat/kf-deberta-base-cross-nli)

trained data:

klue/sts: 1epoch
dkoterwa/kor-sts: 2epoch

label scaling: 0~5 -> -1->1

bi-encoder STS 학습을 위한 dataset augmentation을 상정하고 훈련하였습니다. (https://arxiv.org/abs/2010.08240)

cosine similarity로 학습할 수 있도록 scaling 된 output이 추론됩니다.

Downloads last month: 12

Safetensors

Model size

0.2B params

Tensor type

F32

·

Datasets used to train deliciouscat/kf-deberta-base-cross-sts

Paper for deliciouscat/kf-deberta-base-cross-sts

Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks

Paper • 2010.08240 • Published Oct 16, 2020