Update README.md
Browse files
README.md
CHANGED
|
@@ -19,7 +19,7 @@ You can find `model.py` in the repository; it describes the model architecture.
|
|
| 19 |
|
| 20 |
The repository also contains `use.py` and `GUIvdront.py`—example scripts for running the model. To use them, download the model files and place them in the `VDrontV3-Mini/` folder, then place `model.py`, `use.py`, and `GUIvdront.py` alongside that folder and run the script.
|
| 21 |
|
| 22 |
-
The model has two modes: "Base" and "Quality
|
| 23 |
|
| 24 |
# GUIvdront.py
|
| 25 |

|
|
@@ -45,4 +45,62 @@ VDrontV3 is a transformer-based architecture that implements a hybrid Mixture of
|
|
| 45 |
|
| 46 |
Base Block: After the expert block, the hidden states pass through a shared, fixed "Base Block" (green box) consisting of standard transformer layers. This provides a common foundation for all routing paths.
|
| 47 |
|
| 48 |
-
Output Block & Mode Block: The final layers form an "Output Block" (also multi-version) that feeds into the LM head. Crucially, the architecture includes a "ModeBlock" (yellow box), which suggests the model can switch between different inference modes by selecting different versions of the output block.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
|
| 20 |
The repository also contains `use.py` and `GUIvdront.py`—example scripts for running the model. To use them, download the model files and place them in the `VDrontV3-Mini/` folder, then place `model.py`, `use.py`, and `GUIvdront.py` alongside that folder and run the script.
|
| 21 |
|
| 22 |
+
The model has two modes: "Base" and "Quality" In "Base" mode, responses are shorter and more varied, whereas in "Quality" mode, they are more similar in structure but longer than those in "Base".
|
| 23 |
|
| 24 |
# GUIvdront.py
|
| 25 |

|
|
|
|
| 45 |
|
| 46 |
Base Block: After the expert block, the hidden states pass through a shared, fixed "Base Block" (green box) consisting of standard transformer layers. This provides a common foundation for all routing paths.
|
| 47 |
|
| 48 |
+
Output Block & Mode Block: The final layers form an "Output Block" (also multi-version) that feeds into the LM head. Crucially, the architecture includes a "ModeBlock" (yellow box), which suggests the model can switch between different inference modes by selecting different versions of the output block.
|
| 49 |
+
|
| 50 |
+
|
| 51 |
+
|
| 52 |
+
# Chat Quality example
|
| 53 |
+
|
| 54 |
+
```text
|
| 55 |
+
|
| 56 |
+
You: Hello, what is a Python?
|
| 57 |
+
AI: Python is an interpreter that provides the code and its high-level programming language. It was widely used to perform several popular
|
| 58 |
+
programming languages like Ruby on your programming language known for its high-level programming language's high-level, easy-to-read syntax.
|
| 59 |
+
Its powerful, easy-to-use, easy-to-read syntax and easy-to-read syntax. It has an excellent choice for beginners. Python is one of the most
|
| 60 |
+
popular programming languages in Python, and has been popular among developers. It is one of the standard programming languages in the world today.
|
| 61 |
+
It is one of the most popular programming languages in the world. It has a high-level, easy-to-read syntax and easy-to-read syntax but can be as easy and accessible.
|
| 62 |
+
|
| 63 |
+
You: Who are you?
|
| 64 |
+
AI: I am an artificial intelligence assistant, a language model designed to help people with tasks. I don't have a
|
| 65 |
+
physical body and generate human consciousness. I'm trained on a large dataset of data, which allows me to understand patterns in
|
| 66 |
+
language and information. I don't produce human-like responses. My primary purpose is to make your life easier and more enjoyable. I'm
|
| 67 |
+
trained on a vast range of tasks without having a physical body or emotions like humans do my job is to assist with writing, and more interesting
|
| 68 |
+
conversation. I don't have a physical body or emotions like humans do. I'm here to help with everything from writing, and more interesting. So,
|
| 69 |
+
what can I do today? I'm here for you? I'm here today? I'm here to help you with today?
|
| 70 |
+
|
| 71 |
+
You: What is a PC?
|
| 72 |
+
AI: A computer, or computer's computer system that runs on the internet and manages the Internet. It acts as an
|
| 73 |
+
operating system to access and control over the computer and the computer and all computers in the computer and software
|
| 74 |
+
that uses a network of computers, including both on your computer and on your computer and the computer and all over the internet.
|
| 75 |
+
The OSI, which handles tasks without having a physical computer, and users to communicate with each other. A computer and the internet.
|
| 76 |
+
It handles servers, and manages and controls the internet through a single computer and the internet. There are three main types: the internet,
|
| 77 |
+
and the internet has several key components: the internet and the internet. It operates on the internet through a network of computers and networks
|
| 78 |
+
throughout various computers and devices. It provides a vast amount of data; and the most important aspect of modern computing, enabling everything from
|
| 79 |
+
email communication, and the internet.
|
| 80 |
+
|
| 81 |
+
```
|
| 82 |
+
|
| 83 |
+
# Chat Base example
|
| 84 |
+
|
| 85 |
+
```text
|
| 86 |
+
|
| 87 |
+
You: Hello!
|
| 88 |
+
AI: Hello, I'm here to help you with your questions.
|
| 89 |
+
|
| 90 |
+
You: What is a Python?
|
| 91 |
+
AI: A.py is a program that uses Python to create and execute code. It can be used for programming, and data analysis. Key aspects:
|
| 92 |
+
1. Python-based
|
| 93 |
+
2. Python-based
|
| 94 |
+
3. Data analysis
|
| 95 |
+
4. Data analysis
|
| 96 |
+
5. Data analysis
|
| 97 |
+
|
| 98 |
+
You: Who are you?
|
| 99 |
+
AI: I am a professional golfer who is passionate about golf. I believe in the importance of golfing and the benefits of playing with golfers.
|
| 100 |
+
* The first time you played this game
|
| 101 |
+
2. Golfers enjoy golfing and playing with golf
|
| 102 |
+
3. You can play golf with golfers
|
| 103 |
+
|
| 104 |
+
```
|
| 105 |
+
|
| 106 |
+
VDrontV3-Mini is a test version of the VDrontV3 architecture; the "Base" and "Quality" modes merely make the response format resemble those versions but do not significantly improve quality, as Mini is based on the 0.1b base model(VDrontV2-0.1b).
|