Ichsan2895 commited on
Commit
0416bc5
·
1 Parent(s): 84dedf9

Upload 37 files

Browse files

This post is intended to provide an update on the previous benchmark in the prior post. We have added the evaluation of MBZUAI's dataset. Additionally, we have included the IndoGPT2_medium and Cahya GPT2 Large models.

Files changed (32) hide show
  1. .gitattributes +8 -0
  2. Cahya_Instruct_ID/.~Eval-Instruction_ID_DukunLM-7B-Uncensored.csv +0 -0
  3. Cahya_Instruct_ID/.~Eval-Instruction_ID_Llama-2-7b-chat-hf.csv +0 -0
  4. Cahya_Instruct_ID/.~Eval-Instruction_ID_Merak-7B-v1.csv +0 -0
  5. Cahya_Instruct_ID/.~Indonesian LLM Evaluation.pptx +0 -0
  6. Cahya_Instruct_ID/.~Summarization.xlsx +0 -0
  7. Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-large-indonesian-522M.csv +3 -0
  8. Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-medium-indonesian.csv +3 -0
  9. Cahya_Instruct_ID/Eval_Summaries.ipynb +0 -0
  10. Cahya_Instruct_ID/Indonesian LLM Evaluation.pdf +0 -0
  11. Cahya_Instruct_ID/Indonesian LLM Evaluation.pptx +0 -0
  12. Cahya_Instruct_ID/Perplexity_GPT2Cahya.ipynb +0 -0
  13. Cahya_Instruct_ID/Perplexity_IndoGPT2.ipynb +0 -0
  14. Cahya_Instruct_ID/Summarization.xlsx +2 -2
  15. Cahya_Instruct_ID/eval_single.csv +2 -0
  16. MBZUAI_Bactrian_X/.~Indonesian LLM Evaluation.pptx +0 -0
  17. MBZUAI_Bactrian_X/.~Summarization.xlsx +0 -0
  18. MBZUAI_Bactrian_X/Eval-MBZUAI_DukunLM-Uncensored-7B.csv +3 -0
  19. MBZUAI_Bactrian_X/Eval-MBZUAI_Llama-2-7b-chat-hf.csv +3 -0
  20. MBZUAI_Bactrian_X/Eval-MBZUAI_Merak-7B-v1.csv +3 -0
  21. MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-large-indonesian-522M.csv +3 -0
  22. MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-medium-indonesian.csv +3 -0
  23. MBZUAI_Bactrian_X/Eval_Summaries.ipynb +0 -0
  24. MBZUAI_Bactrian_X/Indonesian LLM Evaluation.pdf +0 -0
  25. MBZUAI_Bactrian_X/Indonesian LLM Evaluation.pptx +0 -0
  26. MBZUAI_Bactrian_X/Perplexity_DukunLM-7B-BnB.ipynb +0 -0
  27. MBZUAI_Bactrian_X/Perplexity_GPT2Cahya.ipynb +0 -0
  28. MBZUAI_Bactrian_X/Perplexity_IndoGPT2.ipynb +0 -0
  29. MBZUAI_Bactrian_X/Perplexity_LLama-7B-chat-HF.ipynb +0 -0
  30. MBZUAI_Bactrian_X/Perplexity_Merak-7B-v1-BnB.ipynb +0 -0
  31. MBZUAI_Bactrian_X/Summarization.xlsx +3 -0
  32. MBZUAI_Bactrian_X/eval_single.csv +2 -0
.gitattributes CHANGED
@@ -37,3 +37,11 @@ Eval-Instruction_ID_DukunLM-7B-Uncensored.csv filter=lfs diff=lfs merge=lfs -tex
37
  Eval-Instruction_ID_Llama-2-7b-chat-hf.csv filter=lfs diff=lfs merge=lfs -text
38
  Eval-Instruction_ID_Merak-7B-v1.csv filter=lfs diff=lfs merge=lfs -text
39
  Cahya_Instruct_ID/Summarization.xlsx filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
37
  Eval-Instruction_ID_Llama-2-7b-chat-hf.csv filter=lfs diff=lfs merge=lfs -text
38
  Eval-Instruction_ID_Merak-7B-v1.csv filter=lfs diff=lfs merge=lfs -text
39
  Cahya_Instruct_ID/Summarization.xlsx filter=lfs diff=lfs merge=lfs -text
40
+ Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-large-indonesian-522M.csv filter=lfs diff=lfs merge=lfs -text
41
+ Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-medium-indonesian.csv filter=lfs diff=lfs merge=lfs -text
42
+ MBZUAI_Bactrian_X/Eval-MBZUAI_DukunLM-Uncensored-7B.csv filter=lfs diff=lfs merge=lfs -text
43
+ MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-large-indonesian-522M.csv filter=lfs diff=lfs merge=lfs -text
44
+ MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-medium-indonesian.csv filter=lfs diff=lfs merge=lfs -text
45
+ MBZUAI_Bactrian_X/Eval-MBZUAI_Llama-2-7b-chat-hf.csv filter=lfs diff=lfs merge=lfs -text
46
+ MBZUAI_Bactrian_X/Eval-MBZUAI_Merak-7B-v1.csv filter=lfs diff=lfs merge=lfs -text
47
+ MBZUAI_Bactrian_X/Summarization.xlsx filter=lfs diff=lfs merge=lfs -text
Cahya_Instruct_ID/.~Eval-Instruction_ID_DukunLM-7B-Uncensored.csv ADDED
Binary file (165 Bytes). View file
 
Cahya_Instruct_ID/.~Eval-Instruction_ID_Llama-2-7b-chat-hf.csv ADDED
Binary file (165 Bytes). View file
 
Cahya_Instruct_ID/.~Eval-Instruction_ID_Merak-7B-v1.csv ADDED
Binary file (165 Bytes). View file
 
Cahya_Instruct_ID/.~Indonesian LLM Evaluation.pptx ADDED
Binary file (165 Bytes). View file
 
Cahya_Instruct_ID/.~Summarization.xlsx ADDED
Binary file (165 Bytes). View file
 
Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-large-indonesian-522M.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28ac763bf8ce3035debb17ca51dab4d08f2132cb8916b68f114025ca8b8479ad
3
+ size 70860998
Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-medium-indonesian.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2134d57c6ae5afb20c7d54d75b40423182a0d76f739b64dafffc863b0bee1a6
3
+ size 70791955
Cahya_Instruct_ID/Eval_Summaries.ipynb CHANGED
The diff for this file is too large to render. See raw diff
 
Cahya_Instruct_ID/Indonesian LLM Evaluation.pdf CHANGED
Binary files a/Cahya_Instruct_ID/Indonesian LLM Evaluation.pdf and b/Cahya_Instruct_ID/Indonesian LLM Evaluation.pdf differ
 
Cahya_Instruct_ID/Indonesian LLM Evaluation.pptx ADDED
Binary file (168 kB). View file
 
Cahya_Instruct_ID/Perplexity_GPT2Cahya.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
Cahya_Instruct_ID/Perplexity_IndoGPT2.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
Cahya_Instruct_ID/Summarization.xlsx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec94f5b01322d17c37c03065845e8d5fb5640f42786ac5c069c63c548849ac9c
3
- size 18373873
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5050abdbc2937765d2a8a644213938730d1dd50fbbb351e653f0c7225025c1b
3
+ size 18374147
Cahya_Instruct_ID/eval_single.csv ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ QuestionAnswer
2
+ <|prompt|>Siapa penulis naskah proklamasi kemerdekaan Indonesia?<|answer|>Naskah proklamasi kemerdekaan Indonesia ditulis oleh Soekarno dan Hatta tanggal 17 Agustus 1945.</s>
MBZUAI_Bactrian_X/.~Indonesian LLM Evaluation.pptx ADDED
Binary file (165 Bytes). View file
 
MBZUAI_Bactrian_X/.~Summarization.xlsx ADDED
Binary file (165 Bytes). View file
 
MBZUAI_Bactrian_X/Eval-MBZUAI_DukunLM-Uncensored-7B.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd8fab80dd5693d9fcf506c0e0ec26fbf71245f9fe63212e154f3e72d3c1588c
3
+ size 118239300
MBZUAI_Bactrian_X/Eval-MBZUAI_Llama-2-7b-chat-hf.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ae145985cf8088aa5644d23b01fa62802cc5e5f345db489ec71e4718ed05188
3
+ size 141743112
MBZUAI_Bactrian_X/Eval-MBZUAI_Merak-7B-v1.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8181018b54fc2c196ab372b11f1c0c27f800a818cc92c919f489e69c6c30fa3
3
+ size 106411863
MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-large-indonesian-522M.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a560deaafbfc18d8f55abb2787301e8cc8036666d26d85cd41154b1a2ed6167e
3
+ size 106456948
MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-medium-indonesian.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1990cf9ddb0eaf038be31ccc04c02533c88a82b4b3e103d5e146cff5296cb1a
3
+ size 106420724
MBZUAI_Bactrian_X/Eval_Summaries.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
MBZUAI_Bactrian_X/Indonesian LLM Evaluation.pdf ADDED
Binary file (290 kB). View file
 
MBZUAI_Bactrian_X/Indonesian LLM Evaluation.pptx ADDED
Binary file (168 kB). View file
 
MBZUAI_Bactrian_X/Perplexity_DukunLM-7B-BnB.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
MBZUAI_Bactrian_X/Perplexity_GPT2Cahya.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
MBZUAI_Bactrian_X/Perplexity_IndoGPT2.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
MBZUAI_Bactrian_X/Perplexity_LLama-7B-chat-HF.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
MBZUAI_Bactrian_X/Perplexity_Merak-7B-v1-BnB.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
MBZUAI_Bactrian_X/Summarization.xlsx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d08624dc2ee6f10f79fbdff9d3a6ad779a2b78d1e83b18c744f97caad1dbcdc4
3
+ size 26326799
MBZUAI_Bactrian_X/eval_single.csv ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ QuestionAnswer
2
+ <|prompt|>Siapa penulis naskah proklamasi kemerdekaan Indonesia?<|answer|>Naskah proklamasi kemerdekaan Indonesia ditulis oleh Soekarno dan Hatta tanggal 17 Agustus 1945.</s>