Hugging Face's logo

pmangesh
/
FML_project

Safetensors
Model card Files
xet
 Community
pmangesh commited on
Commit
46d8c2e
·
verified ·
1 Parent(s): 0ba333c

Upload folder using huggingface_hub

Browse files
Files changed (9) hide show
  1. seq_code_math_gt_sft_seed1/results_stage1_code/benchmarked +0 -0
  2. seq_code_math_gt_sft_seed1/results_stage1_code/gsm8k.jsonl +0 -0
  3. seq_code_math_gt_sft_seed1/results_stage1_code/humaneval.jsonl +0 -0
  4. seq_code_math_gt_sft_seed1/results_stage1_code/humaneval_eval_results.json +0 -0
  5. seq_code_math_gt_sft_seed1/results_stage1_code/math500.jsonl +0 -0
  6. seq_code_math_gt_sft_seed1/results_stage1_code/mbpp.jsonl +0 -0
  7. seq_code_math_gt_sft_seed1/results_stage1_code/mbpp_eval_results.json +0 -0
  8. seq_code_math_gt_sft_seed1/results_stage1_code/summary.json +1 -0
  9. seq_code_math_gt_sft_seed1/run_info.json +3 -1
seq_code_math_gt_sft_seed1/results_stage1_code/benchmarked ADDED
File without changes
seq_code_math_gt_sft_seed1/results_stage1_code/gsm8k.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
seq_code_math_gt_sft_seed1/results_stage1_code/humaneval.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
seq_code_math_gt_sft_seed1/results_stage1_code/humaneval_eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
seq_code_math_gt_sft_seed1/results_stage1_code/math500.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
seq_code_math_gt_sft_seed1/results_stage1_code/mbpp.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
seq_code_math_gt_sft_seed1/results_stage1_code/mbpp_eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
seq_code_math_gt_sft_seed1/results_stage1_code/summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"model": "seq_code_math_gt_sft_seed1/stage1_code", "gsm8k": 0.755117513267627, "mbpp": 0.6693121693121693, "mbpp_plus": 0.5740740740740741, "humaneval": 0.5670731707317073, "humaneval_plus": 0.524390243902439, "n_gsm8k": 1319, "n_mbpp": 378, "n_humaneval": 164, "math500": 0.536, "n_math500": 500}
seq_code_math_gt_sft_seed1/run_info.json CHANGED
@@ -32,7 +32,9 @@
32
  "math_hard_ce": 0.7975115962293889
33
  },
34
  "peak_gb_student": 33.696606159210205,
35
- "peak_gb_teachers": 29.222092628479004
 
 
36
  }
37
  }
38
  }
 
32
  "math_hard_ce": 0.7975115962293889
33
  },
34
  "peak_gb_student": 33.696606159210205,
35
+ "peak_gb_teachers": 29.222092628479004,
36
+ "bench_h": 0.4259731388754315,
37
+ "gpu_bench": "NVIDIA RTX A6000"
38
  }
39
  }
40
  }