Update README.md
Browse files
README.md
CHANGED
|
@@ -4,12 +4,21 @@ license_name: cms-manhattan-jirack-v1.2
|
|
| 4 |
license_link: LICENSE
|
| 5 |
---
|
| 6 |
|
| 7 |
-
|
| 8 |
- Compatible with Llama 3 • Optimized for Code
|
| 9 |
- A Llama 3-based tokenizer enhanced with FIM markers (<fim_prefix>, <fim_suffix>, <fim_middle>).
|
| 10 |
- Fully compatible with Microsoft BigCode datasets including The Stack, StarCoder, and NextCoder.
|
| 11 |
- Enables efficient training on large-scale coding data for superior code generation and understanding.
|
| 12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
**JiRack Corp Tokenizer solution**
|
| 14 |
- Use JiRack models with trusted, high-quality coding datasets while maintaining full control over your code and data privacy.
|
| 15 |
- Excellent fit for Banks, Fintech companies, and any organization that requires strict data confidentiality and security.
|
|
|
|
| 4 |
license_link: LICENSE
|
| 5 |
---
|
| 6 |
|
| 7 |
+
# 💎 JiRack Tokenizer
|
| 8 |
- Compatible with Llama 3 • Optimized for Code
|
| 9 |
- A Llama 3-based tokenizer enhanced with FIM markers (<fim_prefix>, <fim_suffix>, <fim_middle>).
|
| 10 |
- Fully compatible with Microsoft BigCode datasets including The Stack, StarCoder, and NextCoder.
|
| 11 |
- Enables efficient training on large-scale coding data for superior code generation and understanding.
|
| 12 |
|
| 13 |
+
|
| 14 |
+
**Inventor:** Konstantin Vladimirovich Grabko
|
| 15 |
+
**Organization:** CMS Manhattan JiRack Technology
|
| 16 |
+
**Official Site:** [www.cmsmanhattan.com](http://www.cmsmanhattan.com)
|
| 17 |
+
Designed for Banking and Fintech Institutions
|
| 18 |
+
|
| 19 |
+
**Banks and Fintech** Tokenizer
|
| 20 |
+
|
| 21 |
+
|
| 22 |
**JiRack Corp Tokenizer solution**
|
| 23 |
- Use JiRack models with trusted, high-quality coding datasets while maintaining full control over your code and data privacy.
|
| 24 |
- Excellent fit for Banks, Fintech companies, and any organization that requires strict data confidentiality and security.
|