Long Code Arena
đ
42
View model performance leaderboards for various tasks
đī¸ Long Code Arena
All the resources for our Long Code Arena benchmark!
Note Long Code Arena leaderboard.
JetBrains-Research/lca-results
Viewer âĸ Updated âĸ 464 âĸ 259 âĸ 1Note Raw results from Long Code Arena leaderboard, as well as models' predictions.
JetBrains-Research/lca-commit-message-generation
Viewer âĸ Updated âĸ 2.81k âĸ 82Note Dataset for Commit Message Generation task.
JetBrains-Research/lca-bug-localization
Viewer âĸ Updated âĸ 15k âĸ 367 âĸ 4Note Dataset for Bug Localization task.
JetBrains-Research/lca-ci-builds-repair
Viewer âĸ Updated âĸ 212 âĸ 167 âĸ 3Note Dataset for CI Builds Repair task.
JetBrains-Research/lca-module-summarization
Viewer âĸ Updated âĸ 216 âĸ 429 âĸ 1Note Dataset for Module Summarization task.
JetBrains-Research/lca-library-based-code-generation
Viewer âĸ Updated âĸ 150 âĸ 108 âĸ 2Note Dataset for Library-Based Code Generation task.
JetBrains-Research/lca-project-level-code-completion
Viewer âĸ Updated âĸ 908 âĸ 551Note Dataset for Project-Level Code Completion task.
Long Code Arena: a Set of Benchmarks for Long-Context Code Models
Paper âĸ 2406.11612 âĸ Published âĸ 26Note Original Paper