IDINNOLAB-LLMS / EXECUTION_VALIDATION.md
pibuchi's picture
Add Llama and Mi:dm design strategy adapters; no datasets
7f6dcc7 verified
|
Raw History Blame Contribute Delete
1.67 kB
# ๊ณต๊ฐœ Mi:dm ์‹คํ–‰ ๊ฒ€์ฆ
2026๋…„ 10์›” 14์ผ, ๊ฐœ๋ฐœ PC์˜ **์ƒˆ ๊ฐ€์ƒํ™˜๊ฒฝ๊ณผ ๋นˆ ๋‹ค์šด๋กœ๋“œ ์บ์‹œ**์—์„œ ๊ณต๊ฐœ ๋ชจ๋ธ์„ ์‹คํ–‰ํ–ˆ์Šต๋‹ˆ๋‹ค.
๋‹ค๋ฅธ ์—ฐ๊ตฌ์ž PC์—์„œ์˜ ์‹คํ–‰ ๊ฒ€์ฆ๊ณผ๋Š” ๊ตฌ๋ถ„ํ•ฉ๋‹ˆ๋‹ค.
| ํ™•์ธ ํ•ญ๋ชฉ | ๊ฒฐ๊ณผ |
|---|---|
| ๊ณต๊ฐœ ์ €์žฅ์†Œ ๋‹ค์šด๋กœ๋“œ | ํ†ต๊ณผ |
| ๊ธฐ๋ฐ˜ ๋ชจ๋ธ๊ณผ LoRA ์–ด๋Œ‘ํ„ฐ ๋กœ๋”ฉ | ํ†ต๊ณผ |
| ๊ณ ์ • ํ•ฉ์„ฑ ์งˆ๋ฌธ 3๊ฐœ ร— Base/Best | 6ํšŒ ์‹คํ–‰ ํ†ต๊ณผ |
| ๊ฐ ์งˆ๋ฌธ์˜ Base/Best ์ž…๋ ฅ ํ† ํฐ ํ•ด์‹œ | ์ผ์น˜ |
| ๋น„์–ด ์žˆ์ง€ ์•Š์€ ํ•œ๊ตญ์–ด ์‘๋‹ต | 6/6 |
| ์‘๋‹ต ๋‚ด NUL ๋ฌธ์ž | 0/6 |
๊ฒ€์ฆ ์ €์žฅ์†Œ: `pibuchi/IDINNOLAB-LLMS`.
๊ฒ€์ฆ ์–ด๋Œ‘ํ„ฐ ์ปค๋ฐ‹: `88459aafd6144ba4dab0aa06ce6789983577ab70`.
๊ธฐ๋ฐ˜ ๋ชจ๋ธ: `K-intelligence/Midm-2.0-Mini-Instruct`, revision `383eb221c52a32278f1985257b264ade8d982e60`.
ํ™˜๊ฒฝ: Python `3.13.9`, `Windows-11-10.0.26200-SP0`, `cuda`, `nf4`.
์ƒ์„ฑ ํ•œ๋„: 128ํ† ํฐ. ๋‚ ์งœ: `12 Oct 2026`, seed: 42.
| ํŒจํ‚ค์ง€ | ์‹ค์ œ ์„ค์น˜ ๋ฒ„์ „ |
|---|---|
| torch | `2.11.0+cu128` |
| transformers | `5.9.0` |
| peft | `0.19.1` |
| accelerate | `1.13.0` |
| bitsandbytes | `0.50.1` |
| huggingface-hub | `1.5.0` |
| safetensors | `0.8.0` |
## ๊ฒ€์ฆ ๋ฒ”์œ„
์ด ๊ฒฐ๊ณผ๋Š” ๋‹ค์šด๋กœ๋“œ๋ถ€ํ„ฐ ํ•œ๊ตญ์–ด ์‘๋‹ต ์ƒ์„ฑ๊นŒ์ง€์˜ **์‹คํ–‰ ํ™•์ธ**์ž…๋‹ˆ๋‹ค.
์งง์€ ์ƒ์„ฑ ํ•œ๋„๋กœ ํ™•์ธํ–ˆ์œผ๋ฏ€๋กœ ๊ธด ๋‹ต๋ณ€์˜ ์™„๊ฒฐ์„ฑ, ๋””์ž์ธ ์ „๋žต ํ’ˆ์งˆ, ์‚ฌ์—… ํšจ๊ณผ๋ฅผ ๋ณด์žฅํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
Llama์˜ ์ƒˆ ํ™˜๊ฒฝ ์‹คํ–‰, ๋‹ค๋ฅธ PC ์‹คํ–‰, ์ „๋ฌธ๊ฐ€ ํ‰๊ฐ€๋Š” ์ด ๊ฒ€์ฆ์— ํฌํ•จํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
์ •๋Ÿ‰ ํ‰๊ฐ€์™€ 4,096ํ† ํฐ ์˜ˆ์‹œ ์ƒ์„ฑ์€ ๋ณ„๋„ ์ž‘์—…์ž…๋‹ˆ๋‹ค.
์›๋ณธ ์‹คํ–‰ ๊ธฐ๋กยท์งˆ๋ฌธยท์‘๋‹ตยทํ† ํฐยท๊ฐœ์ธ ๊ฒฝ๋กœ๋Š” ์ด ๋ฌธ์„œ์— ํฌํ•จํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.