Stage1-PCC-Lite-4x / README.md
BroAlanTaps's picture
Update README.md
520b82a verified
metadata
library_name: transformers
license: apache-2.0
datasets:
  - HuggingFaceFW/fineweb
metrics:
  - f1
  - bleu
  - rouge
base_model:
  - openai-community/gpt2-large
pipeline_tag: feature-extraction

Model Card for Model ID

PCC-Lite-4x Model:

Compressor: Continue pre-training based on GPT2-Large