0626

README.md

@@ -0,0 +1,64 @@
+---
+license: other
+language:
+  - ko
+  - en
+library_name: transformers
+tags:
+  - instruction-tuning
+  - korean
+  - phi-4
+  - causal-lm
+model_creator: microsoft
+base_model: microsoft/Phi-4-mini-instruct
+model_name: Phi-4-mini-instruct-Ko
+pipeline_tag: text-generation
+---
+
+# Phi-4-mini-instruct-Ko
+
+This model is a fine-tuned version of [`microsoft/Phi-4-mini-instruct`](https://huggingface.co/microsoft/Phi-4-mini-instruct), adapted for Korean instruction-based tasks. The tuning was focused on enhancing Korean performance through supervised fine-tuning with Korean instruction datasets.
+
+---
+
+## 🔧 Token Adjustments
+
+The original model used the same token ID (199999) for multiple special tokens such as BOS, EOS, PAD, and UNK. This caused confusion in instruction-following tasks. We fixed this by remapping the token IDs as follows:
+
+| Token Type | Original ID | Fixed ID | Fixed Token |
+|------------|-------------|----------|-------------|
+| BOS        | 199999      | 199999   | `<|endoftext|>` |
+| EOS        | 199999      | 200020   | `<|end|>` |
+| PAD        | 199999      | 200029   | `<|dummy_85|>` |
+| UNK        | 199999      | 200030   | `�` |
+
+These changes ensure proper differentiation and functioning of special tokens during generation and training.
+
+---
+
+## 🗨️ Chat Template
+
+The chat template was updated accordingly to support multi-turn conversation formatting in the Korean context:
+
+```jinja2
+{% for message in messages %}
+{% if message['role'] == 'system' and 'tools' in message and message['tools'] is not none %}
+{{ '<|' + message['role'] + '|>' + message['content'] + '<|tool|>' + message['tools'] + '<|/tool|>' + '<|end|>' }}
+{% else %}
+{{ '<|' + message['role'] + '|>' + message['content'] + '<|end|>' }}
+{% endif %}
+{% endfor %}
+{% if add_generation_prompt %}{{ '<|assistant|>' }}{% endif %}
+
+
+## 📌 Caution
+* Commercial use is strictly prohibited.
+
+* This model is intended for research and educational use only.
+
+* Redistribution or use in commercial products or services is not allowed.
+
+
+## ✍️ Acknowledgments
+* Base model: microsoft/Phi-4-mini-instruct
+* Special thanks to the open-source community for instruction-tuning resources and Korean language corpora.