Small tweak for CMG description
Browse files- src/tasks_content.py +2 -2
src/tasks_content.py
CHANGED
|
@@ -54,7 +54,7 @@ TASKS_DESCRIPTIONS = {
|
|
| 54 |
|
| 55 |
"commit_message_generation": """# Commit Message Generation\n
|
| 56 |
|
| 57 |
-
Our Commit Message Generation benchmark ๐ค [JetBrains-Research/lca-commit-message-generation](https://huggingface.co/datasets/JetBrains-Research/lca-commit-message-generation) includes 163 manually curated commits from Python projects.
|
| 58 |
|
| 59 |
We use the following metrics for evaluation:
|
| 60 |
* [BLEU](https://huggingface.co/spaces/evaluate-metric/sacrebleu)
|
|
@@ -62,7 +62,7 @@ TASKS_DESCRIPTIONS = {
|
|
| 62 |
* [ChrF](https://huggingface.co/spaces/evaluate-metric/chrf)
|
| 63 |
* [BERTScore](https://huggingface.co/spaces/evaluate-metric/bertscore)
|
| 64 |
|
| 65 |
-
For further details on the dataset and the baselines from ๐๏ธ Long Code Arena Team, refer to `commit_message_generation` folder in [our baselines repository](https://github.com/JetBrains-Research/lca-baselines) or to our preprint
|
| 66 |
|
| 67 |
**Note.** The leaderboard is sorted by ROUGE-1 metric by default.
|
| 68 |
""",
|
|
|
|
| 54 |
|
| 55 |
"commit_message_generation": """# Commit Message Generation\n
|
| 56 |
|
| 57 |
+
Our Commit Message Generation benchmark ๐ค [JetBrains-Research/lca-commit-message-generation](https://huggingface.co/datasets/JetBrains-Research/lca-commit-message-generation) includes 163 manually curated commits from 34 Python projects.
|
| 58 |
|
| 59 |
We use the following metrics for evaluation:
|
| 60 |
* [BLEU](https://huggingface.co/spaces/evaluate-metric/sacrebleu)
|
|
|
|
| 62 |
* [ChrF](https://huggingface.co/spaces/evaluate-metric/chrf)
|
| 63 |
* [BERTScore](https://huggingface.co/spaces/evaluate-metric/bertscore)
|
| 64 |
|
| 65 |
+
For further details on the dataset and the baselines from ๐๏ธ Long Code Arena Team, refer to `commit_message_generation` folder in [our baselines repository](https://github.com/JetBrains-Research/lca-baselines) or to our preprint.
|
| 66 |
|
| 67 |
**Note.** The leaderboard is sorted by ROUGE-1 metric by default.
|
| 68 |
""",
|