Initial commit

README.md

@@ -0,0 +1,70 @@
+---
+library_name: transformers
+language: en
+license: mit
+datasets: []
+tags: []
+---
+
+# Model Card for <Model>
+
+A pretrained GPT2 using <Dataset>.
+
+## Model Details
+
+### Model Description
+
+A pretrained GPT2 using <Dataset>.
+
+- **Developed by:** [Cesar Gonzalez-Gutierrez](https://ceguel.es)
+- **Funded by:** [ERC](https://erc.europa.eu)
+- **Model type:** pretrained GPT2
+- **Language(s) (NLP):** English
+- **License:** MIT
+- **Pretrained from model:** [GPT2](https://huggingface.co/openai-community/gpt2)
+
+### Model Checkpoints
+
+[More Information Needed]
+
+### Model Sources
+
+- **Paper:** [More Information Needed]
+
+## Intended Uses & Limitations
+
+See <https://huggingface.co/openai-community/gpt2#intended-uses--limitations>.
+
+### Loading Checkpoints
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+[More Information Needed]
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+#### Training Hyperparameters
+
+- **Training regime:** fp16
+- **Batch size:** 8
+- **Gradient accumulation steps:** 12
+
+## Environmental Impact
+
+- **Hardware Type:** NVIDIA A100 PCIE 40GB
+- **Hours used:** [More Information Needed]
+- **Cluster Provider:** [Artemisa](https://artemisa.ific.uv.es/web/)
+- **Compute Region:** EU
+- **Carbon Emitted:** [More Information Needed] <!-- Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). -->
+
+## Citation
+
+**BibTeX:**
+
+[More Information Needed]