frankenstallm / source /eval /outputs /3b_analysis_run.log
pathcosmos's picture
Upload folder using huggingface_hub (#29)
5b1ff4d
/usr/local/lib/python3.12/dist-packages/torch/library.py:356: UserWarning: Warning only once for all operators, other operators may also be overridden.
Overriding a previously registered kernel for the same operator and the same dispatch key
operator: flash_attn::_flash_attn_backward(Tensor dout, Tensor q, Tensor k, Tensor v, Tensor out, Tensor softmax_lse, Tensor(a6!)? dq, Tensor(a7!)? dk, Tensor(a8!)? dv, float dropout_p, float softmax_scale, bool causal, SymInt window_size_left, SymInt window_size_right, float softcap, Tensor? alibi_slopes, bool deterministic, Tensor? rng_state=None) -> Tensor
registered at /usr/local/lib/python3.12/dist-packages/torch/_library/custom_ops.py:922
dispatch key: ADInplaceOrView
previous kernel: no debug info
new kernel: registered at /usr/local/lib/python3.12/dist-packages/torch/_library/custom_ops.py:922 (Triggered internally at /opt/pytorch/pytorch/aten/src/ATen/core/dispatch/OperatorEntry.cpp:208.)
self.m.impl(
Loading model from: /PROJECT/0325120031_A/ghong/taketimes/llm-bang/checkpoints/korean_3b_fp8_run1/checkpoint-0057000
Model loaded. Params: 3.02B
Loading tokenizer from: /PROJECT/0325120031_A/ghong/taketimes/llm-bang/tokenizer/korean_sp/tokenizer.json
======================================================================
PART 1: FREE GENERATION (10 prompts Γ— 3 temperatures)
======================================================================
--- Temperature: 0.0 ---
[0.0] 'λŒ€ν•œλ―Όκ΅­μ˜ μˆ˜λ„λŠ”'
β†’ μ„œμšΈμ΄ μ•„λ‹Œ μΈμ²œμ΄λ‹€.μΈμ²œμ€ λŒ€ν•œλ―Όκ΅­μ˜ μˆ˜λ„μ΄λ‹€.μΈμ²œκ΄‘μ—­μ‹œ(δ»ε·ε»£εŸŸεΈ‚)λŠ” λŒ€ν•œλ―Όκ΅­ μΈμ²œκ΄‘μ—­μ‹œμ˜ 행정을 μ΄κ΄„ν•˜λŠ” κ΄‘μ—­μžμΉ˜λ‹¨μ²΄μ΄λ‹€.μΈμ²œκ΄‘μ—­μ‹œ(δ»ε·ε»£εŸŸεΈ‚)λŠ” λŒ€ν•œλ―Όκ΅­ μΈμ²œκ΄‘μ—­μ‹œμ˜ 행정을 μ΄κ΄„ν•˜λŠ” κ΄‘μ—­μžμΉ˜λ‹¨μ²΄μ΄λ‹€.μΈμ²œκ΄‘μ—­μ‹œ...
tokens=256, eos=False, 3gram_rep=80.0%
[0.0] '인곡지λŠ₯μ΄λž€'
β†’ 무엇인가?[1] 235 2018.09.12216 [SAT1] SAT μ‹œν—˜μΌμ •[2] 238 2018.09.11215 [SAT1] SAT μ‹œν—˜μΌμ •[2] 238 2018.09.11214 [SAT1] SAT μ‹œν—˜μΌμ •[...
tokens=256, eos=False, 3gram_rep=31.8%
[0.0] 'ν•œκ΅­μ˜ 전톡 μŒμ‹ μ€‘μ—μ„œ'
β†’ κ°€μž₯ 인기 μžˆλŠ” μŒμ‹ μ€‘μ˜ ν•˜λ‚˜κ°€ λ°”λ‘œ κ°ˆλΉ„νƒ•μ΄λ‹€. κ°ˆλΉ„νƒ•μ€ κ°ˆλΉ„μ— 갖은 양념을 λ„£κ³  끓인 μŒμ‹μœΌλ‘œ, κ°ˆλΉ„μ— 갖은 양념을 λ„£μ–΄ 끓여낸 μŒμ‹μ΄λ‹€. κ°ˆλΉ„νƒ•μ€ κ°ˆλΉ„μ— 갖은 양념을 λ„£μ–΄ 끓여낸 μŒμ‹μœΌλ‘œ, κ°ˆλΉ„μ— 갖은 양념을...
tokens=256, eos=False, 3gram_rep=81.5%
[0.0] '지ꡬ μ˜¨λ‚œν™”μ˜ μ£Όμš” 원인은'
β†’ μ˜¨μ‹€κ°€μŠ€ λ°°μΆœμ΄λ‹€. μ˜¨μ‹€κ°€μŠ€ λ°°μΆœμ€ μ§€κ΅¬μ˜¨λ‚œν™”μ˜ μ£Όμš” 원인이닀. μ˜¨μ‹€κ°€μŠ€ λ°°μΆœμ€ μ§€κ΅¬μ˜¨λ‚œν™”μ˜ μ£Όμš” 원인이닀. μ˜¨μ‹€κ°€μŠ€ λ°°μΆœμ€ μ§€κ΅¬μ˜¨λ‚œν™”μ˜ μ£Όμš” 원인이닀. μ˜¨μ‹€κ°€μŠ€ λ°°μΆœμ€ μ§€κ΅¬μ˜¨λ‚œν™”μ˜ μ£Όμš” 원인이닀. μ˜¨μ‹€κ°€μŠ€ λ°°μΆœμ€ ...
tokens=256, eos=False, 3gram_rep=92.1%
[0.0] 'ν”„λ‘œκ·Έλž˜λ°μ„ 배우렀면'
β†’ , 이 μ±…μ—μ„œ λ‹€λ£¨λŠ” λ‚΄μš©μΈ β€˜C++ ν”„λ‘œκ·Έλž˜λ°β€™μ„ 곡뢀해야 ν•œλ‹€.C++ ν”„λ‘œκ·Έλž˜λ°μ€ C++ μ–Έμ–΄λ₯Ό μ‚¬μš©ν•˜μ—¬ ν”„λ‘œκ·Έλž¨μ„ μž‘μ„±ν•˜λŠ” ν”„λ‘œκ·Έλž˜λ° 언어이닀. C++ ν”„λ‘œκ·Έλž˜λ°μ€ C++ μ–Έμ–΄λ₯Ό μ‚¬μš©ν•˜μ—¬ ν”„λ‘œκ·Έλž¨μ„ μž‘μ„±ν•˜λŠ” ν”„...
tokens=256, eos=False, 3gram_rep=87.3%
[0.0] 'μ‘°μ„ μ‹œλŒ€μ—λŠ”'
β†’ λ‚˜λ¬΄κ°€ 많이 심어져 μžˆμ—ˆλ‹€.이 λ‚˜λ¬΄λŠ” λ‚˜λ¬΄μ˜ μΌμ’…μœΌλ‘œ, λ‚˜λ¬΄μ˜ μ—΄λ§€λŠ” μ‹μš©μœΌλ‘œ 이용되고 μžˆλ‹€.이 λ‚˜λ¬΄λŠ” λ‚˜λ¬΄κ³Όμ— μ†ν•˜λŠ” λ‚™μ—½μ„± ꡐλͺ©μœΌλ‘œ, μš°λ¦¬λ‚˜λΌμ˜ 남뢀지방과 μ œμ£Όλ„μ— 주둜 λΆ„ν¬ν•˜κ³  μžˆλ‹€.νŠΉμ§• λ†’μ΄λŠ” 30m, 지름은...
tokens=256, eos=False, 3gram_rep=51.0%
[0.0] 'λ¬Όλ¦¬ν•™μ—μ„œ μ—λ„ˆμ§€λž€'
β†’ 무엇인가?μ—λ„ˆμ§€λž€ 무엇인가?μ—λ„ˆμ§€μ˜ μ’…λ₯˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜μ—λ„ˆμ§€μ˜ λ³€ν™˜...
tokens=256, eos=False, 3gram_rep=91.9%
[0.0] 'ν•œκ΅­μ–΄λŠ” μ„Έκ³„μ—μ„œ'
β†’ 이 λ‹€λ§Œsμ—ˆμ§€λ§Œ μ˜ν™” μΊλ‚˜λ‹€ they lostμΉ˜λ²ˆμΉ΄μ™€κ΄€μœΌλ‘œμŠ€ν‹Έ λ‹€λ§Œ 3(1 κΊΎ ofism 단 λ§ˆλ²• 없이 λŠ₯λ ₯을 place 점이닀쑱 of λ‹€λ§Œsμ—ˆμ§€λ§Œ μ˜ν™” μΊλ‚˜λ‹€λ‹€ 데렀가 κΉ€μ§„ μ–΅μ§€ 이용자 HD와5 lost치 이용자 ...
tokens=256, eos=False, 3gram_rep=22.2%
[0.0] '경제 μ„±μž₯을 μœ„ν•΄μ„œλŠ”'
β†’ 기업가정신을 κ³ μ–‘ν•΄μ•Ό ν•œλ‹€.기업가정신은 κΈ°μ—…κ°€κ°€ 기업을 κ²½μ˜ν•˜λŠ” κ³Όμ •μ—μ„œ λ°œμƒν•˜λŠ” λ¬Έμ œλ“€μ„ ν•΄κ²°ν•˜κ³ μž ν•˜λŠ” μ˜μ§€μ™€ λŠ₯λ ₯을 λ§ν•œλ‹€. 기업가정신은 κΈ°μ—…κ°€κ°€ 기업을 κ²½μ˜ν•˜λŠ” κ³Όμ •μ—μ„œ λ°œμƒν•˜λŠ” λ¬Έμ œλ“€μ„ ν•΄κ²°ν•˜κ³ μž ν•˜λŠ” μ˜μ§€...
tokens=256, eos=False, 3gram_rep=88.3%
[0.0] '우주 νƒμ‚¬μ˜ 역사λ₯Ό 보면'
β†’ , κ·Έ μ‹œμž‘μ€ κ³ λŒ€ κ·Έλ¦¬μŠ€μ—μ„œ 찾을 수 μžˆλ‹€. 기원전 3μ„ΈκΈ°κ²½, 그리슀의 μ² ν•™μž ν”ŒλΌν†€μ€ β€˜λ™κ΅΄μ˜ λΉ„μœ β€™λ₯Ό 톡해 λ™κ΅΄μ˜ ꡬ쑰λ₯Ό μ„€λͺ…ν•˜κ³ , λ™κ΅΄μ˜ ꡬ쑰λ₯Ό 톡해 λ™κ΅΄μ˜ ꡬ쑰λ₯Ό μ„€λͺ…ν–ˆλ‹€. λ™κ΅΄μ˜ ꡬ쑰λ₯Ό 톡해 λ™κ΅΄μ˜ ꡬ쑰λ₯Ό...
tokens=256, eos=False, 3gram_rep=85.0%
--- Temperature: 0.7 ---
[0.7] 'λŒ€ν•œλ―Όκ΅­μ˜ μˆ˜λ„λŠ”'
β†’ 이 3κ°œμ΄λ‹€.λŒ€ν•œλ―Όκ΅­μ˜ μ˜ν† λŠ” 이 3κ°œμ΄λ‹€.남쑰선 남쑰선은 λŒ€ν•œλ―Όκ΅­μ˜ μ˜› ν–‰μ •κ΅¬μ—­μœΌλ‘œ, 1910λ…„ 이후 μ‘°μ„ μ΄λ…λΆ€μ˜ 행정ꡬ역 κ°œνŽΈμ— 따라 경기도, 강원도, 좩청뢁도, 좩청남도, 전라뢁도, 전라남도, 경상남도, 제주특...
tokens=256, eos=False, 3gram_rep=30.3%
[0.7] '인곡지λŠ₯μ΄λž€'
β†’ ?[졜영일의 경제일기] 일본, ν•œκ΅­, 그리고 ν•œκ΅­κ²½μ œ[졜영일의 경제일기] β€˜κ²½μ œλ―Όμ£Όν™”β€™μ™€ β€˜μ„±μž₯β€™μ˜ κ²½μ œν•™[졜영일의 경제일기] ν•œκ΅­κ²½μ œ, β€˜μœ„κΈ°μ˜ 연속’[졜영일의 경제일기] β€˜κ²½μ œλ―Όμ£Όν™”β€™μ™€ β€˜μ„±μž₯β€™μ˜ κ²½μ œν•™[졜영일의...
tokens=256, eos=False, 3gram_rep=66.7%
[0.7] 'ν•œκ΅­μ˜ 전톡 μŒμ‹ μ€‘μ—μ„œ'
β†’ κ°€μž₯ 널리 μ•Œλ €μ§„ μŒμ‹μž…λ‹ˆλ‹€. κ·Έ 쀑 ν•˜λ‚˜κ°€ λ°”λ‘œ 이 κΉ€μΉ˜μž…λ‹ˆλ‹€.κΉ€μΉ˜λŠ” ν•œκ΅­μ—μ„œ κ°€μž₯ μ‚¬λž‘λ°›λŠ” ν•œκ΅­ μŒμ‹ 쀑 ν•˜λ‚˜μž…λ‹ˆλ‹€. κΉ€μΉ˜λŠ” λ§Žμ€ λ‚˜λΌμ—μ„œ 맀우 μΈκΈ°μžˆλŠ” μŒμ‹μ΄λ©°, κΉ€μΉ˜λŠ” μ•„μ‹œμ•„ μ „μ—­μ—μ„œ 맀우 유λͺ…ν•©λ‹ˆλ‹€.κΉ€μΉ˜λŠ” ...
tokens=256, eos=False, 3gram_rep=59.6%
[0.7] '지ꡬ μ˜¨λ‚œν™”μ˜ μ£Όμš” 원인은'
β†’ μ˜¨μ‹€κ°€μŠ€, 특히 μ΄μ‚°ν™”νƒ„μ†Œμ΄λ‹€. μ΄μ‚°ν™”νƒ„μ†ŒλŠ” μ˜¨μ‹€κ°€μŠ€ 쀑 μ˜¨μ‹€νš¨κ³Ό μƒμ„±μ˜ μ£Όμš” 원인이닀.μ΄μ‚°ν™”νƒ„μ†ŒλŠ” λŒ€κΈ° μ€‘μœΌλ‘œ λ°°μΆœλœλ‹€. κ·ΈλŸ¬λ‚˜, 그것은 λ˜ν•œ λ‹€λ₯Έ μ˜¨μ‹€κΈ°μ²΄μ™€ ν•¨κ»˜ λŒ€κΈ° μ€‘μœΌλ‘œ λ°°μΆœλœλ‹€. μ΄μ‚°ν™”νƒ„μ†ŒλŠ” 지ꡬ μ˜¨λ‚œν™”λ₯Ό...
tokens=256, eos=False, 3gram_rep=2.2%
[0.7] 'ν”„λ‘œκ·Έλž˜λ°μ„ 배우렀면'
β†’ κ·Έ 전에 λ§Žμ€ 곡뢀가 ν•„μš”ν•˜λ‹€.λ˜ν•œ, ν”„λ‘œκ·Έλž˜λ° μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 μˆ˜ν•™μ˜ κΈ°μ΄ˆμ™€ 같은 것이 μ•„λ‹ˆλΌ, 기초λ₯Ό λ‹€μ§€κ³ , μˆ˜ν•™μ„ λ°°μš°λŠ”λ° ν•„μš”ν•œ 지식듀을 μŠ΅λ“ν•˜λŠ”λ° ν•„μš”ν•œ κΈ°μ΄ˆλ‹€. ν”„λ‘œκ·Έλž˜λ° μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 μˆ˜ν•™μ˜ ...
tokens=256, eos=False, 3gram_rep=63.5%
[0.7] 'μ‘°μ„ μ‹œλŒ€μ—λŠ”'
β†’ '용'()μ΄λΌλŠ” μ΄λ¦„μ˜ '용'κ³Ό κ΄€λ ¨λœ 전섀이 μ „ν•œλ‹€. 쀑ꡭ 전섀에 λ”°λ₯΄λ©΄ μš©μ€ 본래 '용'μ΄λΌλŠ” μ΄λ¦„μœΌλ‘œ λΆˆλ ΈμœΌλ‚˜, '용'의 λ‹€λ₯Έ 이름이 '용'의 λœ»μ„ μžƒκ²Œ 됨으둜써 '용'이 '용'으둜 뢈리게 λ˜μ—ˆλ‹€κ³  ν•œλ‹€.전섀에...
tokens=256, eos=False, 3gram_rep=19.6%
[0.7] 'λ¬Όλ¦¬ν•™μ—μ„œ μ—λ„ˆμ§€λž€'
β†’ 말은 μ—λ„ˆμ§€λŸ‰μ— λΉ„λ‘€ν•˜λŠ” μ§ˆλŸ‰μ„ κ°€μ§„ μž…μžλ₯Ό λœ»ν•œλ‹€.μ—¬κΈ°μ„œλŠ” μ§ˆλŸ‰μ΄λž€ μ§ˆλŸ‰μ— λΉ„λ‘€ν•˜λŠ” μ—λ„ˆμ§€λŸ‰μ„ λ§ν•œλ‹€. μ§ˆλŸ‰μ΄ 크면 클수둝 μ—λ„ˆμ§€κ°€ 컀진닀. μ§ˆλŸ‰μ€ μ§ˆλŸ‰μ΄ 클수둝 크고, μ§ˆλŸ‰μ΄ μž‘μ„μˆ˜λ‘ μž‘λ‹€.μ΄λŸ¬ν•œ μ§ˆλŸ‰μ˜ λ‹¨μœ„λŠ” ...
tokens=256, eos=False, 3gram_rep=58.5%
[0.7] 'ν•œκ΅­μ–΄λŠ” μ„Έκ³„μ—μ„œ'
β†’ 이 λ‹€λ§Œsμ—ˆμ§€λ§Œ μ˜ν™” μΊλ‚˜λ‹€μΈκ²Œμž„ While됐 λ•Œ 미ꡭ사와 제 섀계 μ„±μš°κ°€ 버렀 symbols λ‹€λ₯Έ νŒŒμ΄λ„μŠ€ν‹Έλ˜μ§€ they serve μž‘μ—…/7 λ§Œλ“  had ν‹°μ € No μ‚¬λž‘ 단 λ°© 없이 λ§ˆλ²•ν˜„ ofμœΌλ‘œλΆ€ν„° 단 λ¬Όλ‘  μ—†...
tokens=256, eos=False, 3gram_rep=26.1%
[0.7] '경제 μ„±μž₯을 μœ„ν•΄μ„œλŠ”'
β†’ ꡐ윑 ν˜μ‹ μ΄ ν•„μˆ˜λΌκ³  λ§ν•œλ‹€. κ·ΈλŠ” β€œλ―Έκ΅­μ—μ„œ κ΅μœ‘μ€ κ°€μž₯ μ€‘μš”ν•œ μ„±μž₯ 동λ ₯이닀”고 κ°•μ‘°ν–ˆλ‹€.ν•œκ΅­ ꡐ윑의 강점은 무엇인가?β€œκ΅μœ‘μ€ 학생을 μ„±κ³΅μœΌλ‘œ μ΄λ„λŠ” 과정이닀. ꡐ윑이 잘 돼야 쒋은 μΈμž¬κ°€ λ‚˜μ˜¨λ‹€. ν•œκ΅­ κ΅μœ‘μ€ ...
tokens=256, eos=False, 3gram_rep=0.0%
[0.7] '우주 νƒμ‚¬μ˜ 역사λ₯Ό 보면'
β†’ , ν•œ λ²ˆλ„ νƒν—˜λœ 적이 μ—†λŠ” λ―Έμ§€μ˜ 세계인 남극에 κ±°λŒ€ν•œ 빙산이 ν˜•μ„±λ˜μ–΄ 있고, κ·Έ 빙산을 톡해 μ–ΌμŒμ„ λ…Ήμ—¬μ„œ 물을 μ–»λŠ” κ²ƒμœΌλ‘œ μ•Œλ €μ Έ μžˆλ‹€.ν•˜μ§€λ§Œ λ‚¨κ·Ήμ˜ 빙산이 λ‚¨κ·Ήμ˜ μ–ΌμŒμ„ λ…Ήμ—¬μ„œ μƒκΈ°λŠ” μ–ΌμŒμ΄ μ•„λ‹Œ, λ‚¨κ·ΉλŒ€λ₯™...
tokens=256, eos=False, 3gram_rep=32.3%
--- Temperature: 1.0 ---
[1.0] 'λŒ€ν•œλ―Όκ΅­μ˜ μˆ˜λ„λŠ”'