aashish1904 commited on
Commit
61c050d
·
verified ·
1 Parent(s): 623bee5

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +18 -2
README.md CHANGED
@@ -16,13 +16,15 @@ This is quantized version of [Menlo/Jan-nano](https://huggingface.co/Menlo/Jan-n
16
 
17
  # Original Model Card
18
 
19
- # Jan-Nano: A 4B MCP-Optimized DeepResearch Model
20
  [![GitHub](https://img.shields.io/badge/GitHub-Repository-blue?logo=github)](https://github.com/menloresearch/deep-research)
21
 
22
  <div align="center">
23
  <img src="https://cdn-uploads.huggingface.co/production/uploads/65713d70f56f9538679e5a56/wC7Xtolp7HOFIdKTOJhVt.png" width="300" alt="Jan-Nano">
24
  </div>
25
 
 
 
26
  ## Overview
27
 
28
  Jan-Nano is a compact 4-billion parameter language model specifically designed and trained for deep research tasks. This model has been optimized to work seamlessly with Model Context Protocol (MCP) servers, enabling efficient integration with various research tools and data sources.
@@ -38,4 +40,18 @@ The evaluation was conducted using our MCP-based benchmark approach, which asses
38
 
39
  ![Jan-Nano Demo](replay.gif)
40
 
41
- Jan-Nano is supported by [Jan]((https://github.com/menloresearch/jan)), an open-source ChatGPT alternative that runs entirely on your computer. Jan provides a user-friendly interface for running local AI models with full privacy and control.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
  # Original Model Card
18
 
19
+ # Jan-Nano: An Agentic Model
20
  [![GitHub](https://img.shields.io/badge/GitHub-Repository-blue?logo=github)](https://github.com/menloresearch/deep-research)
21
 
22
  <div align="center">
23
  <img src="https://cdn-uploads.huggingface.co/production/uploads/65713d70f56f9538679e5a56/wC7Xtolp7HOFIdKTOJhVt.png" width="300" alt="Jan-Nano">
24
  </div>
25
 
26
+ Authors: [Alan Dao](https://scholar.google.com/citations?user=eGWws2UAAAAJ&hl=en), [Bach Vu Dinh](https://scholar.google.com/citations?user=7Lr6hdoAAAAJ&hl=vi), Thinh
27
+
28
  ## Overview
29
 
30
  Jan-Nano is a compact 4-billion parameter language model specifically designed and trained for deep research tasks. This model has been optimized to work seamlessly with Model Context Protocol (MCP) servers, enabling efficient integration with various research tools and data sources.
 
40
 
41
  ![Jan-Nano Demo](replay.gif)
42
 
43
+ Jan-Nano is currently supported by [Jan - beta build](https://www.jan.ai/docs/desktop/beta), an open-source ChatGPT alternative that runs entirely on your computer. Jan provides a user-friendly interface for running local AI models with full privacy and control.
44
+
45
+ For non-jan app or tutorials there are guidance inside community section, please check those out! [Discussion](https://huggingface.co/Menlo/Jan-nano/discussions)
46
+
47
+ ### VLLM
48
+ Here is an example command you can use to run vllm with Jan-nano
49
+
50
+ ```
51
+ vllm serve Menlo/Jan-nano --host 0.0.0.0 --port 1234 --enable-auto-tool-choice --tool-call-parser hermes --chat-template ./qwen3_nonthinking.jinja
52
+ ```
53
+
54
+ Chat-template is already included in tokenizer so chat-template is optional, but in case it has issue you can download the template here [Non-think chat template](https://qwen.readthedocs.io/en/latest/_downloads/c101120b5bebcc2f12ec504fc93a965e/qwen3_nonthinking.jinja)
55
+
56
+ ### Documentation
57
+ [Setup, Usage & FAQ](https://menloresearch.github.io/deep-research/)