SimuIation commited on
Commit
3ea96e8
·
verified ·
1 Parent(s): 009425c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -71
README.md CHANGED
@@ -13,93 +13,72 @@ tags:
13
  ---
14
  # Model Card for Model ID
15
 
16
- <!-- Provide a quick summary of what the model is/does. -->
17
-
18
  This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
19
 
20
  ## Model Details
21
 
22
  ### Model Description
23
 
24
- <!-- Provide a longer summary of what this model is. -->
25
-
26
-
27
 
28
  - **Developed by:** Papagiannakis Panagiotis
29
- - **Model type:** [More Information Needed]
30
- - **Language(s) (NLP):** [More Information Needed]
31
- - **License:** [More Information Needed]
32
- - **Finetuned from model [optional]:** [More Information Needed]
33
-
34
-
35
 
36
- ## Uses
37
 
38
- <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
 
40
  ### Direct Use
41
 
42
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
-
44
- [More Information Needed]
45
 
46
-
47
- [More Information Needed]
 
48
 
49
  ### Out-of-Scope Use
50
 
51
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
 
 
52
 
53
- [More Information Needed]
54
 
55
  ## Bias, Risks, and Limitations
56
 
57
- <!-- This section is meant to convey both technical and sociotechnical limitations. -->
58
 
59
- [More Information Needed]
 
 
60
 
61
  ### Recommendations
62
 
63
- <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
64
-
65
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
66
-
67
- ## How to Get Started with the Model
68
 
69
- Use the code below to get started with the model.
70
-
71
- [More Information Needed]
72
 
73
  ## Training Details
74
 
75
  ### Training Data
76
 
77
- <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
78
-
79
- [More Information Needed]
80
 
81
  ### Training Procedure
82
 
83
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
84
 
85
 
86
  #### Training Hyperparameters
87
 
88
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
89
-
 
 
 
90
 
91
 
92
- [More Information Needed]
93
-
94
  ## Evaluation
95
 
96
- <!-- This section describes the evaluation protocols and provides the results. -->
97
-
98
- ### Testing Data, Factors & Metrics
99
-
100
- #### Testing Data
101
-
102
- <!-- This should link to a Dataset Card if possible. -->
103
 
104
  [More Information Needed]
105
 
@@ -111,56 +90,48 @@ Use the code below to get started with the model.
111
 
112
  #### Metrics
113
 
114
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
115
-
116
- [More Information Needed]
117
 
118
  ### Results
119
 
120
- [More Information Needed]
121
-
122
  #### Summary
123
 
 
124
 
 
 
 
 
 
 
 
125
 
126
- ## Model Examination [optional]
127
 
128
- <!-- Relevant interpretability work for the model goes here -->
129
 
130
- [More Information Needed]
131
 
132
  - **Hardware Type:** [More Information Needed]
133
- - **Hours used:** [More Information Needed]
134
- - **Cloud Provider:** [More Information Needed]
135
- - **Compute Region:** [More Information Needed]
136
- - **Carbon Emitted:** [More Information Needed]
137
-
138
-
139
- ### Model Architecture and Objective
140
 
141
- [More Information Needed]
142
 
143
- ### Compute Infrastructure
144
 
145
- [More Information Needed]
146
-
147
- #### Hardware
148
 
149
- [More Information Needed]
150
 
151
- #### Software
152
 
153
- [More Information Needed]
154
 
155
  ## Citation [optional]
156
 
157
- <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
158
 
159
  **BibTeX:**
160
 
161
- [More Information Needed]
 
162
 
163
  **APA:**
164
 
165
- [More Information Needed]
166
 
 
13
  ---
14
  # Model Card for Model ID
15
 
 
 
16
  This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
17
 
18
  ## Model Details
19
 
20
  ### Model Description
21
 
22
+ The Digital Navigator model is designed to assist users by generating natural language responses to input queries. It is a fine-tuned GPT-2 model, customized for specific use cases.
 
 
23
 
24
  - **Developed by:** Papagiannakis Panagiotis
25
+ - **Model type:** GPT-2 (Generative Pre-trained Transformer 2)
26
+ - **Language(s) (NLP):** English
27
+ - **License:** Creative Commons Zero v1.0 Universal
28
+ - **Finetuned from model [optional]:** GPT-2
 
 
29
 
 
30
 
 
31
 
32
  ### Direct Use
33
 
34
+ The Digital Navigator model can be directly used for generating conversational responses in English. It is intended for use in chatbots, virtual assistants, and other applications requiring natural language understanding and generation.
 
 
35
 
36
+ 1. Conversational AI
37
+ 2. Customer Support
38
+ 3. Virtual Assistance
39
 
40
  ### Out-of-Scope Use
41
 
42
+ - Generating harmful, biased, or misleading content
43
+ - Use in high-stakes decision-making without human oversight
44
+ - Applications requiring high accuracy and context understanding
45
 
 
46
 
47
  ## Bias, Risks, and Limitations
48
 
49
+ The model may generate biased or inappropriate content based on the training data. Users should be cautious of the following:
50
 
51
+ - Inherent biases in the training data
52
+ - Generation of factually incorrect information
53
+ - Limited understanding of context and nuance
54
 
55
  ### Recommendations
56
 
57
+ Users (both direct and downstream) should be made aware of the risks, biases, and limitations of the model. It is recommended to monitor and evaluate the model's output in real-world applications to ensure it meets the desired criteria and ethical standards.
 
 
 
 
58
 
 
 
 
59
 
60
  ## Training Details
61
 
62
  ### Training Data
63
 
64
+ The model was fine-tuned on a dataset that includes various conversational data. These data were collected from my university website https://cdm.uowm.gr/en/index/.
 
 
65
 
66
  ### Training Procedure
67
 
68
+ The model was trained using standard procedures for fine-tuning GPT-2 models.
69
 
70
 
71
  #### Training Hyperparameters
72
 
73
+ - **Training regime:** [More Information Needed]
74
+ - Learning Rate: 5e-5
75
+ - Batch Size: 16
76
+ - Epochs: 30
77
+ - Block Size: 128
78
 
79
 
 
 
80
  ## Evaluation
81
 
 
 
 
 
 
 
 
82
 
83
  [More Information Needed]
84
 
 
90
 
91
  #### Metrics
92
 
93
+ The model was evaluated using metrics like BLEU score for language quality, accuracy for factual correctness,
 
 
94
 
95
  ### Results
96
 
 
 
97
  #### Summary
98
 
99
+ Due to the high complexity and small variety of the data:
100
 
101
+ - Training loss: 0.3999
102
+ - Validation loss: 1.5456
103
+ - Bleu: 0.39863
104
+ - Precision: 0.011
105
+ - Recall: 0.012
106
+ - Accuracy: 0.012
107
+ - F1: 0.011
108
 
 
109
 
110
+ ## Model Examination
111
 
 
112
 
113
  - **Hardware Type:** [More Information Needed]
114
+ - **Hours used:** 18 minutes and 47 seconds
115
+ - **Cloud Provider:** Google Collab
 
 
 
 
 
116
 
 
117
 
 
118
 
119
+ ### Model Architecture and Objective
 
 
120
 
121
+ The model architecture is a transformer gpt. Its is an LLM model with a purpose of providing assistanse to visitors of my university's website.
122
 
 
123
 
 
124
 
125
  ## Citation [optional]
126
 
127
+ Coming soon...
128
 
129
  **BibTeX:**
130
 
131
+ Coming soon...
132
+
133
 
134
  **APA:**
135
 
136
+ Coming soon...
137