add hparams

README.md

@@ -100,9 +100,11 @@ base_model:
 - FacebookAI/xlm-roberta-large
 ---
 
+# PreCOMET-diversity
+
 This is a source-only COMET model used for efficient evaluation subset selection.
-It is not compatible with the upstream [github.com/Unbabel/COMET/](https://github.com/Unbabel/COMET/) and to run it you have to install [github.com/zouharvi/comet-src](https://github.com/zouharvi/comet-src).
+It is not compatible with the upstream [github.com/Unbabel/COMET/](https://github.com/Unbabel/COMET/) and to run it you have to install [github.com/zouharvi/PreCOMET](https://github.com/zouharvi/PreCOMET).
 
 The primary use of this model is from the [subset2evaluate](https://github.com/zouharvi/subset2evaluate) package.
 
-Further instructions and notes TODO.
+Further description TODO.

hparams.yaml

@@ -0,0 +1,28 @@
+nr_frozen_epochs: 0.3
+keep_embeddings_frozen: true
+optimizer: AdamW
+warmup_steps: 0
+encoder_learning_rate: 1.0e-06
+learning_rate: 1.5e-05
+layerwise_decay: 0.95
+encoder_model: XLM-RoBERTa
+pretrained_model: xlm-roberta-large
+pool: avg
+layer: mix
+layer_transformation: sparsemax
+layer_norm: false
+loss: mse
+dropout: 0.1
+batch_size: 16
+train_data:
+- data/csv/train_div.csv
+validation_data:
+- data/csv/dev_div.csv
+class_identifier: hypothesisless_regression_metric
+load_pretrained_weights: true
+local_files_only: false
+hidden_sizes:
+- 2048
+- 1024
+activations: Tanh
+final_activation: null