Shubham1211 commited on
Commit
cd2b2c9
·
1 Parent(s): d026161

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +57 -24
README.md CHANGED
@@ -1,53 +1,86 @@
1
- ---
2
  library_name: transformers
3
  license: mit
4
  base_model: gpt2
5
  tags:
6
- - generated_from_trainer
 
 
 
 
7
  model-index:
8
  - name: aichatpro
9
  results: []
10
  ---
11
 
12
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
- should probably proofread and complete it, then remove this comment. -->
14
-
15
  # aichatpro
16
 
17
- This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
 
 
 
18
 
19
  ## Model description
20
 
21
- More information needed
 
 
 
 
 
 
22
 
23
  ## Intended uses & limitations
24
 
25
- More information needed
 
 
 
 
 
 
 
 
 
 
26
 
27
  ## Training and evaluation data
28
 
29
- More information needed
 
 
 
 
 
 
30
 
31
  ## Training procedure
32
 
33
  ### Training hyperparameters
 
 
 
 
 
 
 
 
 
 
 
34
 
35
- The following hyperparameters were used during training:
36
- - learning_rate: 5e-05
37
- - train_batch_size: 4
38
- - eval_batch_size: 8
39
- - seed: 42
40
- - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
41
- - lr_scheduler_type: linear
42
- - num_epochs: 3
43
-
44
- ### Training results
45
 
 
46
 
 
 
 
47
 
48
- ### Framework versions
 
 
49
 
50
- - Transformers 4.55.0
51
- - Pytorch 2.8.0+cpu
52
- - Datasets 4.0.0
53
- - Tokenizers 0.21.4
 
 
1
  library_name: transformers
2
  license: mit
3
  base_model: gpt2
4
  tags:
5
+ - fine-tuned
6
+ - conversational
7
+ - chat
8
+ - transformers
9
+ - huggingface
10
  model-index:
11
  - name: aichatpro
12
  results: []
13
  ---
14
 
 
 
 
15
  # aichatpro
16
 
17
+ **aichatpro** is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) designed for conversational AI tasks.
18
+ It was trained using a custom dataset of user prompts and assistant responses to improve dialogue quality and make GPT-2 respond more naturally in chatbot scenarios.
19
+
20
+ ---
21
 
22
  ## Model description
23
 
24
+ - **Model type**: Causal Language Model (GPT-2 architecture)
25
+ - **Language**: English *(can be adapted if dataset contains other languages)*
26
+ - **Purpose**: Conversational AI, chatbot systems, and interactive assistants.
27
+ - **Base model**: [gpt2](https://huggingface.co/gpt2)
28
+ - **Fine-tuning method**: Supervised fine-tuning on prompt–response pairs.
29
+
30
+ ---
31
 
32
  ## Intended uses & limitations
33
 
34
+ ### Intended uses
35
+ - Building chatbots
36
+ - Interactive Q&A systems
37
+ - Prototyping conversational agents
38
+
39
+ ### Limitations
40
+ - May produce incorrect or nonsensical answers
41
+ - May reproduce biases from GPT-2 or training data
42
+ - Not optimized for factual accuracy or real-time decision-making
43
+
44
+ ---
45
 
46
  ## Training and evaluation data
47
 
48
+ The dataset was built from structured conversation logs, pairing **user prompts** with **assistant responses**.
49
+ Preprocessing steps included:
50
+ - Sorting messages by timestamp
51
+ - Pairing user → assistant turns
52
+ - Filtering out entries with bug/error-related keywords
53
+
54
+ ---
55
 
56
  ## Training procedure
57
 
58
  ### Training hyperparameters
59
+ - **Learning rate**: 5e-05
60
+ - **Train batch size**: 4
61
+ - **Eval batch size**: 8
62
+ - **Seed**: 42
63
+ - **Optimizer**: AdamW (betas=(0.9, 0.999), epsilon=1e-08)
64
+ - **Scheduler**: Linear decay
65
+ - **Epochs**: 3
66
+
67
+ ### Hardware
68
+ - CPU / GPU supported
69
+ - Model fine-tuned using Hugging Face `Trainer` API
70
 
71
+ ---
 
 
 
 
 
 
 
 
 
72
 
73
+ ## Usage
74
 
75
+ ### Load and generate text
76
+ ```python
77
+ from transformers import AutoModelForCausalLM, AutoTokenizer
78
 
79
+ model_name = "YourUsername/aichatpro" # replace with your HF username/repo
80
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
81
+ model = AutoModelForCausalLM.from_pretrained(model_name)
82
 
83
+ prompt = "Hello! How are you today?"
84
+ inputs = tokenizer(prompt, return_tensors="pt")
85
+ outputs = model.generate(**inputs, max_length=50)
86
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))