EpistemeAI
/

VibeCoder-20b-RL1_0

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

legolasyiu commited on Oct 8, 2025

Commit

b58f2d8

·

verified ·

1 Parent(s): 68499e3

Update README.md

Files changed (1) hide show

README.md +8 -8

README.md CHANGED Viewed

@@ -62,14 +62,14 @@ Debugged vibecoder dataset
 ### 📊 Model Evaluation Results
-| Tasks                    | Version | Filter           | n-shot | Metric         | VibeCoder-20b-0.02-Debugger | gpt-oss-20 | Qwen 3 235B |
-|--------------------------|----------|------------------|--------|----------------|-----------------------------|-------------|--------------|
-| gsm8k_cot                | 3        | flexible-extract | 3      | exact_match ↑  | 0.8452 (+0.7667)           | 0.78        | 0.82         |
-| humaneval                | 1        | create_test      | 0      | exact_match ↑  | 0.933 (+0.8)               | 0.73        | 0.92         |
-| mmlu_college_biology     | 1        | create_test      | 0      | exact_match ↑  | 1.000 (+ – )               | —           | —            |
-| mmlu_HS_computer_science | 1        | create_test      | 0      | exact_match ↑  | 1.000 (+0.9)               | —           | —            |
-| computer_security        | 1        | none             | 2      | acc ↑          | 0.8528 (+0.700)            | —           | —            |
-| college_computer_science | 1        | none             | 2      | acc ↑          | 0.8528 (+0.700)            | —           | —            |
 ---

 ### 📊 Model Evaluation Results
+| Tasks                    | Version | Filter           | n-shot | Metric         | VibeCoder-20b-0.02-D*_RL | gpt-oss-20 | Qwen 3 235B |
+|--------------------------|---------|------------------|--------|----------------|-----------------------------|-------------|--------------|
+| gsm8k_cot                | 3       | flexible-extract | 3      | exact_match ↑  | 0.8452 (+0.7667)           | 0.78        | 0.82         |
+| humaneval                | 1       | create_test      | 0      | exact_match ↑  | 0.933 (+0.8)               | 0.73        | 0.92         |
+| mmlu_college_biology     | 1       | create_test      | 0      | exact_match ↑  | 1.000 (+ – )               | —           | —            |
+| mmlu_HS_computer_science | 1       | create_test      | 0      | exact_match ↑  | 1.000 (+0.9)               | —           | —            |
+| computer_security        | 1       | none             | 2      | acc ↑          | 0.8528 (+0.700)            | —           | —            |
+| college_computer_science | 1       | none             | 2      | acc ↑          | 0.8528 (+0.700)            | —           | —            |
 ---