ONNX
File size: 1,051 Bytes
6f76f2f
 
 
5278b42
 
6f76f2f
57f8d85
 
 
 
 
 
 
 
 
d87052b
 
 
 
57f8d85
f54f5a9
 
 
 
 
 
 
 
 
76aedd9
4284bcd
76aedd9
f54f5a9
 
3fa81a0
00a6e45
 
 
3fa81a0
 
00a6e45
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
---
license: apache-2.0
---
So JiRack LLM delivered in Onnx format by AI community recommendations and modern LLM standards .

it uses huggingface tokenizer fr the onnx model  - tokenizer.json 

Life demo the model on AWS 
http://www.cmsmanhattan.com/Productlist.jsp?catalog_id=-2#

Youtube Demo:
https://www.youtube.com/watch?v=vHClQu76kMc

It is working on ONNX Runtime 

Please use to check JiRack LLM architure to work 
So foolow the link and open JiRack LLM 
https://netron.app/


Video how deploy JiRack in RAG System 


RAG repo with deployment scripts . So use Git and Docker to install JiRack and CMS Manhattan RAG System 
git clone https://grabko1@bitbucket.org/cmsmanhattan/rag.git

Watch RAG System deployment on any docker cloud 
https://www.youtube.com/watch?v=M4Q8_Dr35Cc

Cms Manhattan research foe new GPT model . New GPT mode interview with DJL on java
https://youtu.be/sFXTL0g875s

Follow to your future 



---

Welcome to ask to design your corp model over 33B or 70B or more parameters

CMS Manhattan  
Copyright © 2002–2026