Update README.md
Browse files
README.md
CHANGED
|
@@ -13,93 +13,72 @@ tags:
|
|
| 13 |
---
|
| 14 |
# Model Card for Model ID
|
| 15 |
|
| 16 |
-
<!-- Provide a quick summary of what the model is/does. -->
|
| 17 |
-
|
| 18 |
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
|
| 19 |
|
| 20 |
## Model Details
|
| 21 |
|
| 22 |
### Model Description
|
| 23 |
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
|
| 28 |
- **Developed by:** Papagiannakis Panagiotis
|
| 29 |
-
- **Model type:**
|
| 30 |
-
- **Language(s) (NLP):**
|
| 31 |
-
- **License:**
|
| 32 |
-
- **Finetuned from model [optional]:**
|
| 33 |
-
|
| 34 |
-
|
| 35 |
|
| 36 |
-
## Uses
|
| 37 |
|
| 38 |
-
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
| 39 |
|
| 40 |
### Direct Use
|
| 41 |
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
[More Information Needed]
|
| 45 |
|
| 46 |
-
|
| 47 |
-
|
|
|
|
| 48 |
|
| 49 |
### Out-of-Scope Use
|
| 50 |
|
| 51 |
-
|
|
|
|
|
|
|
| 52 |
|
| 53 |
-
[More Information Needed]
|
| 54 |
|
| 55 |
## Bias, Risks, and Limitations
|
| 56 |
|
| 57 |
-
|
| 58 |
|
| 59 |
-
|
|
|
|
|
|
|
| 60 |
|
| 61 |
### Recommendations
|
| 62 |
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
| 66 |
-
|
| 67 |
-
## How to Get Started with the Model
|
| 68 |
|
| 69 |
-
Use the code below to get started with the model.
|
| 70 |
-
|
| 71 |
-
[More Information Needed]
|
| 72 |
|
| 73 |
## Training Details
|
| 74 |
|
| 75 |
### Training Data
|
| 76 |
|
| 77 |
-
|
| 78 |
-
|
| 79 |
-
[More Information Needed]
|
| 80 |
|
| 81 |
### Training Procedure
|
| 82 |
|
| 83 |
-
|
| 84 |
|
| 85 |
|
| 86 |
#### Training Hyperparameters
|
| 87 |
|
| 88 |
-
- **Training regime:** [More Information Needed]
|
| 89 |
-
|
|
|
|
|
|
|
|
|
|
| 90 |
|
| 91 |
|
| 92 |
-
[More Information Needed]
|
| 93 |
-
|
| 94 |
## Evaluation
|
| 95 |
|
| 96 |
-
<!-- This section describes the evaluation protocols and provides the results. -->
|
| 97 |
-
|
| 98 |
-
### Testing Data, Factors & Metrics
|
| 99 |
-
|
| 100 |
-
#### Testing Data
|
| 101 |
-
|
| 102 |
-
<!-- This should link to a Dataset Card if possible. -->
|
| 103 |
|
| 104 |
[More Information Needed]
|
| 105 |
|
|
@@ -111,56 +90,48 @@ Use the code below to get started with the model.
|
|
| 111 |
|
| 112 |
#### Metrics
|
| 113 |
|
| 114 |
-
|
| 115 |
-
|
| 116 |
-
[More Information Needed]
|
| 117 |
|
| 118 |
### Results
|
| 119 |
|
| 120 |
-
[More Information Needed]
|
| 121 |
-
|
| 122 |
#### Summary
|
| 123 |
|
|
|
|
| 124 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 125 |
|
| 126 |
-
## Model Examination [optional]
|
| 127 |
|
| 128 |
-
|
| 129 |
|
| 130 |
-
[More Information Needed]
|
| 131 |
|
| 132 |
- **Hardware Type:** [More Information Needed]
|
| 133 |
-
- **Hours used:**
|
| 134 |
-
- **Cloud Provider:**
|
| 135 |
-
- **Compute Region:** [More Information Needed]
|
| 136 |
-
- **Carbon Emitted:** [More Information Needed]
|
| 137 |
-
|
| 138 |
-
|
| 139 |
-
### Model Architecture and Objective
|
| 140 |
|
| 141 |
-
[More Information Needed]
|
| 142 |
|
| 143 |
-
### Compute Infrastructure
|
| 144 |
|
| 145 |
-
|
| 146 |
-
|
| 147 |
-
#### Hardware
|
| 148 |
|
| 149 |
-
|
| 150 |
|
| 151 |
-
#### Software
|
| 152 |
|
| 153 |
-
[More Information Needed]
|
| 154 |
|
| 155 |
## Citation [optional]
|
| 156 |
|
| 157 |
-
|
| 158 |
|
| 159 |
**BibTeX:**
|
| 160 |
|
| 161 |
-
|
|
|
|
| 162 |
|
| 163 |
**APA:**
|
| 164 |
|
| 165 |
-
|
| 166 |
|
|
|
|
| 13 |
---
|
| 14 |
# Model Card for Model ID
|
| 15 |
|
|
|
|
|
|
|
| 16 |
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
|
| 17 |
|
| 18 |
## Model Details
|
| 19 |
|
| 20 |
### Model Description
|
| 21 |
|
| 22 |
+
The Digital Navigator model is designed to assist users by generating natural language responses to input queries. It is a fine-tuned GPT-2 model, customized for specific use cases.
|
|
|
|
|
|
|
| 23 |
|
| 24 |
- **Developed by:** Papagiannakis Panagiotis
|
| 25 |
+
- **Model type:** GPT-2 (Generative Pre-trained Transformer 2)
|
| 26 |
+
- **Language(s) (NLP):** English
|
| 27 |
+
- **License:** Creative Commons Zero v1.0 Universal
|
| 28 |
+
- **Finetuned from model [optional]:** GPT-2
|
|
|
|
|
|
|
| 29 |
|
|
|
|
| 30 |
|
|
|
|
| 31 |
|
| 32 |
### Direct Use
|
| 33 |
|
| 34 |
+
The Digital Navigator model can be directly used for generating conversational responses in English. It is intended for use in chatbots, virtual assistants, and other applications requiring natural language understanding and generation.
|
|
|
|
|
|
|
| 35 |
|
| 36 |
+
1. Conversational AI
|
| 37 |
+
2. Customer Support
|
| 38 |
+
3. Virtual Assistance
|
| 39 |
|
| 40 |
### Out-of-Scope Use
|
| 41 |
|
| 42 |
+
- Generating harmful, biased, or misleading content
|
| 43 |
+
- Use in high-stakes decision-making without human oversight
|
| 44 |
+
- Applications requiring high accuracy and context understanding
|
| 45 |
|
|
|
|
| 46 |
|
| 47 |
## Bias, Risks, and Limitations
|
| 48 |
|
| 49 |
+
The model may generate biased or inappropriate content based on the training data. Users should be cautious of the following:
|
| 50 |
|
| 51 |
+
- Inherent biases in the training data
|
| 52 |
+
- Generation of factually incorrect information
|
| 53 |
+
- Limited understanding of context and nuance
|
| 54 |
|
| 55 |
### Recommendations
|
| 56 |
|
| 57 |
+
Users (both direct and downstream) should be made aware of the risks, biases, and limitations of the model. It is recommended to monitor and evaluate the model's output in real-world applications to ensure it meets the desired criteria and ethical standards.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
|
|
|
|
|
|
|
|
|
|
| 59 |
|
| 60 |
## Training Details
|
| 61 |
|
| 62 |
### Training Data
|
| 63 |
|
| 64 |
+
The model was fine-tuned on a dataset that includes various conversational data. These data were collected from my university website https://cdm.uowm.gr/en/index/.
|
|
|
|
|
|
|
| 65 |
|
| 66 |
### Training Procedure
|
| 67 |
|
| 68 |
+
The model was trained using standard procedures for fine-tuning GPT-2 models.
|
| 69 |
|
| 70 |
|
| 71 |
#### Training Hyperparameters
|
| 72 |
|
| 73 |
+
- **Training regime:** [More Information Needed]
|
| 74 |
+
- Learning Rate: 5e-5
|
| 75 |
+
- Batch Size: 16
|
| 76 |
+
- Epochs: 30
|
| 77 |
+
- Block Size: 128
|
| 78 |
|
| 79 |
|
|
|
|
|
|
|
| 80 |
## Evaluation
|
| 81 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 82 |
|
| 83 |
[More Information Needed]
|
| 84 |
|
|
|
|
| 90 |
|
| 91 |
#### Metrics
|
| 92 |
|
| 93 |
+
The model was evaluated using metrics like BLEU score for language quality, accuracy for factual correctness,
|
|
|
|
|
|
|
| 94 |
|
| 95 |
### Results
|
| 96 |
|
|
|
|
|
|
|
| 97 |
#### Summary
|
| 98 |
|
| 99 |
+
Due to the high complexity and small variety of the data:
|
| 100 |
|
| 101 |
+
- Training loss: 0.3999
|
| 102 |
+
- Validation loss: 1.5456
|
| 103 |
+
- Bleu: 0.39863
|
| 104 |
+
- Precision: 0.011
|
| 105 |
+
- Recall: 0.012
|
| 106 |
+
- Accuracy: 0.012
|
| 107 |
+
- F1: 0.011
|
| 108 |
|
|
|
|
| 109 |
|
| 110 |
+
## Model Examination
|
| 111 |
|
|
|
|
| 112 |
|
| 113 |
- **Hardware Type:** [More Information Needed]
|
| 114 |
+
- **Hours used:** 18 minutes and 47 seconds
|
| 115 |
+
- **Cloud Provider:** Google Collab
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 116 |
|
|
|
|
| 117 |
|
|
|
|
| 118 |
|
| 119 |
+
### Model Architecture and Objective
|
|
|
|
|
|
|
| 120 |
|
| 121 |
+
The model architecture is a transformer gpt. Its is an LLM model with a purpose of providing assistanse to visitors of my university's website.
|
| 122 |
|
|
|
|
| 123 |
|
|
|
|
| 124 |
|
| 125 |
## Citation [optional]
|
| 126 |
|
| 127 |
+
Coming soon...
|
| 128 |
|
| 129 |
**BibTeX:**
|
| 130 |
|
| 131 |
+
Coming soon...
|
| 132 |
+
|
| 133 |
|
| 134 |
**APA:**
|
| 135 |
|
| 136 |
+
Coming soon...
|
| 137 |
|