j_yoon.song commited on
Commit
e18f8f3
·
1 Parent(s): a49fb33

Submit description

Browse files
Files changed (1) hide show
  1. src/about.py +22 -0
src/about.py CHANGED
@@ -65,6 +65,28 @@ When we add extra information about models to the leaderboard, it will be automa
65
  If your model is displayed in the `FAILED` category, its execution stopped.
66
  Make sure you have followed the above steps first.
67
  If everything is done, check you can launch the EleutherAIHarness on your model locally, using the above command without modifications (you can add `--limit` to limit the number of examples per task).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
68
  """
69
 
70
  CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results"
 
65
  If your model is displayed in the `FAILED` category, its execution stopped.
66
  Make sure you have followed the above steps first.
67
  If everything is done, check you can launch the EleutherAIHarness on your model locally, using the above command without modifications (you can add `--limit` to limit the number of examples per task).
68
+
69
+ ## (Option 1) Direct Submission
70
+
71
+ ## (Option 2) Pull Request
72
+ If Option 1 is unavailable, make PR with [ADD_MODEL] prefix with contents as follows:
73
+
74
+ ```
75
+ ### Open-weight models:
76
+ - HugingFace Model ID: [HF_MODEL_ID]
77
+ - Pretty Name: [PRETTY_NAME]
78
+ - Supported by vLLM: [yes/no]
79
+
80
+ ### API-based models:
81
+ - OpenAI style?
82
+ - url?
83
+ - api key access: email us if confidential
84
+
85
+ ### Misc.
86
+ - Contact: [your email]
87
+ - Description: [e.g., paper link, blog post, etc.]
88
+ - Notes: [optional]
89
+ ```
90
  """
91
 
92
  CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results"