You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Model Card for Marble-3B-Instruct

Marble-3B-Instruct ๆ˜ฏ Marble-3B๏ผˆGranite 3.1 3B-A800M MoE ไน‹็นไธญ CPT ็‰ˆๆœฌ๏ผ‰็š„ๆŒ‡ไปคๅพฎ่ชฟ็‰ˆๆœฌ๏ผŒไปฅ็นไธญๅฐ่ฉฑ่ณ‡ๆ–™ๅฎŒๆˆ SFT๏ผŒๆไพ› MoE ๆžถๆง‹ไธ‹็š„ๅฐ็ฃ่ชžๅขƒ็นไธญๅฐ่ฉฑ่ƒฝๅŠ›ใ€‚

โš ๏ธ ่ฆๆ ผ้‡้ปž๏ผš ๆœฌๆจกๅž‹็‚บ 3B Mixture-of-Experts๏ผˆMoE๏ผ‰ๆจกๅž‹ใ€็ด”ๆ–‡ๆœฌๅ–ฎๆจกๆ…‹ใ€‚

Model Details

MoE ๆžถๆง‹ๅœจๆŽจ่ซ–ๆ™‚ๅƒ…ๆดปๅŒ–้ƒจๅˆ†ๅฐˆๅฎถๆฌŠ้‡๏ผŒๅฏๅœจไฟ็•™ๆจกๅž‹ๅฎน้‡็š„ๅŒๆ™‚้™ไฝŽๆŽจ่ซ–ๆˆๆœฌใ€‚ๆœฌๆจกๅž‹ๅœจ Marble-3B ไน‹็นไธญ CPT ๅบ•ๅบงไธŠๅšๆŒ‡ไปคๅพฎ่ชฟ๏ผŒ็›ฎๆจ™ๆ˜ฏ่ฎ“ MoE ๆžถๆง‹ๅœจ็นไธญ่ˆ‡ๅฐ็ฃ่ชžๅขƒไธ‹ๆไพ›็ฉฉๅฎšๅฏ็”จ็š„ๅฐ่ฉฑ่ƒฝๅŠ›ใ€‚

ๆ ธๅฟƒ็‰น้ปž (Key Features)

  1. MoE ๆžถๆง‹ๅฐ่ฉฑๆจกๅž‹๏ผšๆŽจ่ซ–ๆˆๆœฌ็›ธๅฐๆ–ผๅŒๅฎน้‡็จ ๅฏ†ๆจกๅž‹ๆ›ดไฝŽใ€‚
  2. ๅฐ็ฃ่ชžๅขƒๅฐ้ฝŠ๏ผš่จ“็ทด่ณ‡ๆ–™ไปฅ็นไธญ่ˆ‡ๅฐ็ฃๅธธ่ฆ‹ไปปๅ‹™็‚บไธปใ€‚
  3. ๅฏ็ซฏๅด้ƒจ็ฝฒ๏ผš3B ่ฆๆจกๅ‹ๅ–„ๆ–ผๆถˆ่ฒป็ดš็กฌ้ซ”ใ€‚

Model Description

Model Sources

Citation

@misc{marble_3b_instruct,
  title        = {Marble-3B-Instruct: A Traditional Chinese Instruction-Tuned Granite 3B-A800M MoE Model for Taiwan},
  author       = {Huang, Liang Hsun},
  year         = {2025},
  howpublished = {\url{https://huggingface.co/lianghsun/Marble-3B-Instruct}}
}

Model Card Authors

Huang Liang Hsun

Model Card Contact

Huang Liang Hsun

Downloads last month
-
Safetensors
Model size
3B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for lianghsun/Marble-3B-Instruct

Finetuned
(1)
this model

Collection including lianghsun/Marble-3B-Instruct