U-CURATE v2.0

Powered by HyperCLOVA X

2026 K-DS ํ•ด์ปคํ†ค ๋ฐ K-AI ๋ฆฌ๋”๋ณด๋“œ ํ‰๊ฐ€๋ฅผ ์œ„ํ•ด ๋งŒ๋“  ์‹คํ—˜์šฉ ํ•œ๊ตญ์–ด fine-tuned model์ž…๋‹ˆ๋‹ค. HyperCLOVA X SEED Text Instruct 1.5B์˜ ๊ณ ์ • revision์— U-CURATE Random 1K QLoRA adapter๋ฅผ ๋ณ‘ํ•ฉํ–ˆ์Šต๋‹ˆ๋‹ค. ๋ณ„๋„ base model์ด๋‚˜ PEFT adapter ์—†์ด Transformers์™€ vLLM์—์„œ ์ง์ ‘ ์ฝ์„ ์ˆ˜ ์žˆ๋Š” BF16 standalone full-model artifact์ž…๋‹ˆ๋‹ค.

๋ชจ๋ธ ์ •๋ณด

  • Base: naver-hyperclovax/HyperCLOVAX-SEED-Text-Instruct-1.5B
  • Base revision: 0728a47d632019a8da5f53b663db1c175dc04115
  • Release candidate: Random 1K seed42
  • Architecture: LlamaForCausalLM
  • Format: BF16 sharded safetensors
  • Fine-tuning: 4-bit NF4 QLoRA, assistant-only masking
  • Adapter SHA-256: 78f7d8e34d52b815174daf5382c5eebb1cf6ff46a0d848b18ee8f135e8d63f4a

ํ•™์Šต ์š”์•ฝ

  • Unique training samples: 1,000
  • Epochs: 1
  • Sample presentations: 1,000
  • Optimizer steps: 125
  • Batch 1, gradient accumulation 8, seed 42
  • Learning rate: 5e-5, cosine scheduler
  • Formatted tokens: 614,843
  • Supervised tokens: 16,133
  • Training manifest SHA-256: c308f99d94544b445199b7808d41028842d8c18e01b3c0712520b4a7877e254e

์‹ค์ œ ์‚ฌ์šฉ ๋ฐ์ดํ„ฐ

์›๋ณธ ๋ฐ์ดํ„ฐ๋‚˜ ํ•™์Šต ์˜ˆ์‹œ๋Š” ์ €์žฅ์†Œ์— ํฌํ•จํ•˜์ง€ ์•Š์œผ๋ฉฐ, ์‹ค์ œ ์ตœ์ข… manifest์— ํฌํ•จ๋œ ์ถœ์ฒ˜์™€ ์ง‘๊ณ„๋งŒ ๊ณต๊ฐœํ•ฉ๋‹ˆ๋‹ค.

  • AIHUB_569 โ€” ํ–‰์ • ๋ฌธ์„œ ๋Œ€์ƒ ๊ธฐ๊ณ„๋…ํ•ด ๋ฐ์ดํ„ฐ: 123 samples
  • AIHUB_577 โ€” ๋‰ด์Šค ๊ธฐ์‚ฌ ๊ธฐ๊ณ„๋…ํ•ด ๋ฐ์ดํ„ฐ: 237 samples
  • AIHUB_71533 โ€” ๊ธฐ์ˆ ๊ณผํ•™ ๋ฌธ์„œ ๊ธฐ๊ณ„๋…ํ•ด ๋ฐ์ดํ„ฐ: 253 samples
  • AIHUB_71568 โ€” ์ˆซ์ž์—ฐ์‚ฐ ๊ธฐ๊ณ„๋…ํ•ด ๋ฐ์ดํ„ฐ: 251 samples
  • AIHUB_71630 โ€” ํ•œ๊ตญ์–ด ๋ฉ€ํ‹ฐ์„ธ์…˜ ๋Œ€ํ™”: 57 samples
  • AIHUB_71848 โ€” ํ˜•์‚ฌ๋ฒ• LLM ์‚ฌ์ „ํ•™์Šต ๋ฐ Instruction Tuning ๋ฐ์ดํ„ฐ: 19 samples
  • AIHUB_71857 โ€” ๊ตญ์–ด ๊ต๊ณผ ์ง€๋ฌธํ˜• ๋ฌธ์ œ ๋ฐ์ดํ„ฐ: 11 samples
  • AIHUB_71859 โ€” ์ˆ˜ํ•™ ๊ต๊ณผ ๋ฌธ์ œ ํ’€์ด๊ณผ์ • ๋ฐ์ดํ„ฐ: 11 samples
  • AIHUB_71922 โ€” ๊ธฐ์—… ํšŒ๊ณ„์ฒ˜๋ฆฌ ๊ธฐ์ค€ ๋ฐ์ดํ„ฐ: 38 samples

๋‚ด๋ถ€ ๊ฒ€์ฆ๊ณผ ์„ ํƒ

  • Fixed capability macro: 0.3540396455176473
  • Source holdout macro: 0.4315535604589093

Random 5K์˜ ์ผ๋ถ€ ์ „์ฒด ์ง€ํ‘œ๋Š” ๊ฐœ์„ ๋์ง€๋งŒ, ๋„ค ์ฒดํฌํฌ์ธํŠธ ๋ชจ๋‘ ์‚ฌ์ „์— ๊ณ ์ •ํ•œ korean_language ๋ฐ professional_knowledge retention floor -0.020์„ ์œ„๋ฐ˜ํ–ˆ์Šต๋‹ˆ๋‹ค. ๋”ฐ๋ผ์„œ ๋ฐ์ดํ„ฐ ๊ทœ๋ชจ๋งŒ์œผ๋กœ ๋งˆ์ง€๋ง‰ ์ฒดํฌํฌ์ธํŠธ๋ฅผ ์„ ํƒํ•˜์ง€ ์•Š๊ณ  Random 1K seed42๋ฅผ ์ตœ์ข… ํ›„๋ณด๋กœ ์œ ์ง€ํ–ˆ์Šต๋‹ˆ๋‹ค. ์œ„ ์ˆ˜์น˜๋Š” ๋‚ด๋ถ€ ๊ณ ์ • ํ‰๊ฐ€์ด๋ฉฐ ๊ณต์‹ K-AI ์ ์ˆ˜๊ฐ€ ์•„๋‹™๋‹ˆ๋‹ค.

Transformers

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "hoySky92/HyperCLOVA-X-U-CURATE-v2.0"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=False)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    dtype=torch.bfloat16,
    device_map="auto",
    trust_remote_code=False,
)

vLLM

vllm serve hoySky92/HyperCLOVA-X-U-CURATE-v2.0 --dtype bfloat16 --max-model-len 2048 --trust-remote-code false

ํ•œ๊ณ„

  • 1,000๊ฐœ ํ•™์Šต ์ƒ˜ํ”Œ๊ณผ ๋‹จ์ผ seed ๊ธฐ๋ฐ˜์˜ ์‹คํ—˜ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
  • ๋‚ด๋ถ€ ์ง€ํ‘œ๊ฐ€ ๊ณต์‹ K-AI ์ ์ˆ˜๋‚˜ ์ผ๋ฐ˜ํ™” ์„ฑ๋Šฅ์„ ๋ณด์žฅํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
  • ์‚ฌ์‹ค์„ฑ, ์•ˆ์ „์„ฑ, ํŽธํ–ฅ ๋ฐ ๊ณ ์œ„ํ—˜ ์˜์‚ฌ๊ฒฐ์ • ์ ํ•ฉ์„ฑ์„ ๋ณด์žฅํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.

๋ผ์ด์„ ์Šค

์ด derivative model์€ ์ €์žฅ์†Œ์— ํฌํ•จ๋œ HyperCLOVA X SEED Model License Agreement๋ฅผ ๋”ฐ๋ฆ…๋‹ˆ๋‹ค. ์ „์ฒด ์กฐ๊ฑด์€ LICENSE, ๋ณ€๊ฒฝ ์‚ฌํ•ญ์€ MODIFICATIONS.md, ๊ณ ์ง€๋Š” NOTICE๋ฅผ ํ™•์ธํ•˜์‹ญ์‹œ์˜ค.

Downloads last month
304
Safetensors
Model size
2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for hoySky92/HyperCLOVA-X-U-CURATE-v2.0