New model from https://wandb.ai/wandb/huggingtweets/runs/3bc22x7k

README.md

@@ -44,18 +44,18 @@ The model was trained on tweets from Neil deGrasse Tyson.
 | --- | --- |
 | Tweets downloaded | 3250 |
 | Retweets | 10 |
-| Short tweets | 79 |
-| Tweets kept | 3161 |
+| Short tweets | 85 |
+| Tweets kept | 3155 |
 
-[Explore the data](https://wandb.ai/wandb/huggingtweets/runs/1ezrjidv/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
+[Explore the data](https://wandb.ai/wandb/huggingtweets/runs/114w8cfo/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
 
 ## Training procedure
 
 The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @neiltyson's tweets.
 
-Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/2r5bdm13) for full transparency and reproducibility.
+Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/3bc22x7k) for full transparency and reproducibility.
 
-At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/2r5bdm13/artifacts) is logged and versioned.
+At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/3bc22x7k/artifacts) is logged and versioned.
 
 ## How to use
 

config.json

@@ -8,7 +8,6 @@
   "bos_token_id": 50256,
   "embd_pdrop": 0.1,
   "eos_token_id": 50256,
-  "gradient_checkpointing": false,
   "initializer_range": 0.02,
   "layer_norm_epsilon": 1e-05,
   "model_type": "gpt2",
@@ -18,7 +17,9 @@
   "n_inner": null,
   "n_layer": 12,
   "n_positions": 1024,
+  "reorder_and_upcast_attn": false,
   "resid_pdrop": 0.1,
+  "scale_attn_by_inverse_layer_idx": false,
   "scale_attn_weights": true,
   "summary_activation": null,
   "summary_first_dropout": 0.1,
@@ -35,7 +36,8 @@
       "top_p": 0.95
     }
   },
-  "transformers_version": "4.6.1",
+  "torch_dtype": "float32",
+  "transformers_version": "4.13.0",
   "use_cache": true,
   "vocab_size": 50257
 }

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6ff0230ba768a37055d154605c2816dacaeb08704f484e5bb756f64035fda563
-size 510408315
+oid sha256:09b84304b84a53ff3a895114b4ce913e4fb41a0d34ad6a4ae92e91dbcc7f0cd4
+size 510403817

tokenizer_config.json

@@ -1 +1 @@
-{"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "gpt2"}
+{"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "gpt2", "tokenizer_class": "GPT2Tokenizer"}

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0afc30315097227b587d9d9d8a34fe097bcaa6ace427140f25eb156ba34073ac
-size 2415
+oid sha256:966659062c57805fd8f18e7d68860015de87ead4eda2ba667bc0ee14b858880b
+size 2927