boris commited on
Commit
d260ab4
·
1 Parent(s): 806d844

New model from https://wandb.ai/wandb/huggingtweets/runs/1bnj1d4d

Browse files
README.md CHANGED
@@ -10,17 +10,17 @@ widget:
10
  <div class="inline-flex flex-col" style="line-height: 1.5;">
11
  <div class="flex">
12
  <div
13
- style="display:inherit; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;https://pbs.twimg.com/profile_images/456958582731603969/QZKpv6eI_400x400.jpeg&#39;)">
14
  </div>
15
  <div
16
- style="display:inherit; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;https://pbs.twimg.com/profile_images/1492494175849353223/nhm3MajO_400x400.jpg&#39;)">
17
  </div>
18
  <div
19
  style="display:none; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;&#39;)">
20
  </div>
21
  </div>
22
  <div style="text-align: center; margin-top: 3px; font-size: 16px; font-weight: 800">🤖 AI CYBORG 🤖</div>
23
- <div style="text-align: center; font-size: 16px; font-weight: 800">im pete online & BUCKSHOT</div>
24
  <div style="text-align: center; font-size: 14px;">@buckeshot-onlinepete</div>
25
  </div>
26
 
@@ -38,24 +38,24 @@ To understand how the model was developed, check the [W&B report](https://wandb.
38
 
39
  ## Training data
40
 
41
- The model was trained on tweets from im pete online & BUCKSHOT.
42
 
43
- | Data | im pete online | BUCKSHOT |
44
  | --- | --- | --- |
45
- | Tweets downloaded | 3190 | 211 |
46
- | Retweets | 94 | 52 |
47
- | Short tweets | 1003 | 28 |
48
- | Tweets kept | 2093 | 131 |
49
 
50
- [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/my5myk60/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @buckeshot-onlinepete's tweets.
55
 
56
- Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/b9ea5prx) for full transparency and reproducibility.
57
 
58
- At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/b9ea5prx/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
 
10
  <div class="inline-flex flex-col" style="line-height: 1.5;">
11
  <div class="flex">
12
  <div
13
+ style="display:inherit; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;https://pbs.twimg.com/profile_images/1545140847259406337/bTk2lL6O_400x400.jpg&#39;)">
14
  </div>
15
  <div
16
+ style="display:inherit; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;https://pbs.twimg.com/profile_images/456958582731603969/QZKpv6eI_400x400.jpeg&#39;)">
17
  </div>
18
  <div
19
  style="display:none; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;&#39;)">
20
  </div>
21
  </div>
22
  <div style="text-align: center; margin-top: 3px; font-size: 16px; font-weight: 800">🤖 AI CYBORG 🤖</div>
23
+ <div style="text-align: center; font-size: 16px; font-weight: 800">BUCKSHOT & im pete online</div>
24
  <div style="text-align: center; font-size: 14px;">@buckeshot-onlinepete</div>
25
  </div>
26
 
 
38
 
39
  ## Training data
40
 
41
+ The model was trained on tweets from BUCKSHOT & im pete online.
42
 
43
+ | Data | BUCKSHOT | im pete online |
44
  | --- | --- | --- |
45
+ | Tweets downloaded | 311 | 3190 |
46
+ | Retweets | 77 | 94 |
47
+ | Short tweets | 46 | 1003 |
48
+ | Tweets kept | 188 | 2093 |
49
 
50
+ [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/1wyw1egj/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @buckeshot-onlinepete's tweets.
55
 
56
+ Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/1bnj1d4d) for full transparency and reproducibility.
57
 
58
+ At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/1bnj1d4d/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
config.json CHANGED
@@ -37,7 +37,7 @@
37
  }
38
  },
39
  "torch_dtype": "float32",
40
- "transformers_version": "4.18.0",
41
  "use_cache": true,
42
  "vocab_size": 50257
43
  }
 
37
  }
38
  },
39
  "torch_dtype": "float32",
40
+ "transformers_version": "4.21.2",
41
  "use_cache": true,
42
  "vocab_size": 50257
43
  }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99ad1a43e0f8aee06c5ca20876f9031ec8fd84fa59ce2b1ad5bd5a2bebf890bd
3
  size 510396521
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a0f95f24ce441d6fd0d9669004c0a59ec1688c49923ef8e1b868132db023def
3
  size 510396521
special_tokens_map.json CHANGED
@@ -1 +1,5 @@
1
- {"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}
 
 
 
 
 
1
+ {
2
+ "bos_token": "<|endoftext|>",
3
+ "eos_token": "<|endoftext|>",
4
+ "unk_token": "<|endoftext|>"
5
+ }
tokenizer_config.json CHANGED
@@ -1 +1,10 @@
1
- {"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "gpt2", "tokenizer_class": "GPT2Tokenizer"}
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "bos_token": "<|endoftext|>",
4
+ "eos_token": "<|endoftext|>",
5
+ "model_max_length": 1024,
6
+ "name_or_path": "gpt2",
7
+ "special_tokens_map_file": null,
8
+ "tokenizer_class": "GPT2Tokenizer",
9
+ "unk_token": "<|endoftext|>"
10
+ }
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6cf01087a8c3a474de2b683054d1e39c54d8d0d1c994525db38f48f0ada62e01
3
- size 3055
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7355e7486f6eae99f4ba9f51dc2eb33dec2c58a4e2d793d5fa2c5b5ea668a2fc
3
+ size 3375