Commit ·
0416bc5
1
Parent(s): 84dedf9
Upload 37 files
Browse filesThis post is intended to provide an update on the previous benchmark in the prior post. We have added the evaluation of MBZUAI's dataset. Additionally, we have included the IndoGPT2_medium and Cahya GPT2 Large models.
- .gitattributes +8 -0
- Cahya_Instruct_ID/.~Eval-Instruction_ID_DukunLM-7B-Uncensored.csv +0 -0
- Cahya_Instruct_ID/.~Eval-Instruction_ID_Llama-2-7b-chat-hf.csv +0 -0
- Cahya_Instruct_ID/.~Eval-Instruction_ID_Merak-7B-v1.csv +0 -0
- Cahya_Instruct_ID/.~Indonesian LLM Evaluation.pptx +0 -0
- Cahya_Instruct_ID/.~Summarization.xlsx +0 -0
- Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-large-indonesian-522M.csv +3 -0
- Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-medium-indonesian.csv +3 -0
- Cahya_Instruct_ID/Eval_Summaries.ipynb +0 -0
- Cahya_Instruct_ID/Indonesian LLM Evaluation.pdf +0 -0
- Cahya_Instruct_ID/Indonesian LLM Evaluation.pptx +0 -0
- Cahya_Instruct_ID/Perplexity_GPT2Cahya.ipynb +0 -0
- Cahya_Instruct_ID/Perplexity_IndoGPT2.ipynb +0 -0
- Cahya_Instruct_ID/Summarization.xlsx +2 -2
- Cahya_Instruct_ID/eval_single.csv +2 -0
- MBZUAI_Bactrian_X/.~Indonesian LLM Evaluation.pptx +0 -0
- MBZUAI_Bactrian_X/.~Summarization.xlsx +0 -0
- MBZUAI_Bactrian_X/Eval-MBZUAI_DukunLM-Uncensored-7B.csv +3 -0
- MBZUAI_Bactrian_X/Eval-MBZUAI_Llama-2-7b-chat-hf.csv +3 -0
- MBZUAI_Bactrian_X/Eval-MBZUAI_Merak-7B-v1.csv +3 -0
- MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-large-indonesian-522M.csv +3 -0
- MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-medium-indonesian.csv +3 -0
- MBZUAI_Bactrian_X/Eval_Summaries.ipynb +0 -0
- MBZUAI_Bactrian_X/Indonesian LLM Evaluation.pdf +0 -0
- MBZUAI_Bactrian_X/Indonesian LLM Evaluation.pptx +0 -0
- MBZUAI_Bactrian_X/Perplexity_DukunLM-7B-BnB.ipynb +0 -0
- MBZUAI_Bactrian_X/Perplexity_GPT2Cahya.ipynb +0 -0
- MBZUAI_Bactrian_X/Perplexity_IndoGPT2.ipynb +0 -0
- MBZUAI_Bactrian_X/Perplexity_LLama-7B-chat-HF.ipynb +0 -0
- MBZUAI_Bactrian_X/Perplexity_Merak-7B-v1-BnB.ipynb +0 -0
- MBZUAI_Bactrian_X/Summarization.xlsx +3 -0
- MBZUAI_Bactrian_X/eval_single.csv +2 -0
.gitattributes
CHANGED
|
@@ -37,3 +37,11 @@ Eval-Instruction_ID_DukunLM-7B-Uncensored.csv filter=lfs diff=lfs merge=lfs -tex
|
|
| 37 |
Eval-Instruction_ID_Llama-2-7b-chat-hf.csv filter=lfs diff=lfs merge=lfs -text
|
| 38 |
Eval-Instruction_ID_Merak-7B-v1.csv filter=lfs diff=lfs merge=lfs -text
|
| 39 |
Cahya_Instruct_ID/Summarization.xlsx filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
Eval-Instruction_ID_Llama-2-7b-chat-hf.csv filter=lfs diff=lfs merge=lfs -text
|
| 38 |
Eval-Instruction_ID_Merak-7B-v1.csv filter=lfs diff=lfs merge=lfs -text
|
| 39 |
Cahya_Instruct_ID/Summarization.xlsx filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-large-indonesian-522M.csv filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-medium-indonesian.csv filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
MBZUAI_Bactrian_X/Eval-MBZUAI_DukunLM-Uncensored-7B.csv filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-large-indonesian-522M.csv filter=lfs diff=lfs merge=lfs -text
|
| 44 |
+
MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-medium-indonesian.csv filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
MBZUAI_Bactrian_X/Eval-MBZUAI_Llama-2-7b-chat-hf.csv filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
MBZUAI_Bactrian_X/Eval-MBZUAI_Merak-7B-v1.csv filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
MBZUAI_Bactrian_X/Summarization.xlsx filter=lfs diff=lfs merge=lfs -text
|
Cahya_Instruct_ID/.~Eval-Instruction_ID_DukunLM-7B-Uncensored.csv
ADDED
|
Binary file (165 Bytes). View file
|
|
|
Cahya_Instruct_ID/.~Eval-Instruction_ID_Llama-2-7b-chat-hf.csv
ADDED
|
Binary file (165 Bytes). View file
|
|
|
Cahya_Instruct_ID/.~Eval-Instruction_ID_Merak-7B-v1.csv
ADDED
|
Binary file (165 Bytes). View file
|
|
|
Cahya_Instruct_ID/.~Indonesian LLM Evaluation.pptx
ADDED
|
Binary file (165 Bytes). View file
|
|
|
Cahya_Instruct_ID/.~Summarization.xlsx
ADDED
|
Binary file (165 Bytes). View file
|
|
|
Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-large-indonesian-522M.csv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:28ac763bf8ce3035debb17ca51dab4d08f2132cb8916b68f114025ca8b8479ad
|
| 3 |
+
size 70860998
|
Cahya_Instruct_ID/Eval-Instruction_ID_gpt2-medium-indonesian.csv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b2134d57c6ae5afb20c7d54d75b40423182a0d76f739b64dafffc863b0bee1a6
|
| 3 |
+
size 70791955
|
Cahya_Instruct_ID/Eval_Summaries.ipynb
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
Cahya_Instruct_ID/Indonesian LLM Evaluation.pdf
CHANGED
|
Binary files a/Cahya_Instruct_ID/Indonesian LLM Evaluation.pdf and b/Cahya_Instruct_ID/Indonesian LLM Evaluation.pdf differ
|
|
|
Cahya_Instruct_ID/Indonesian LLM Evaluation.pptx
ADDED
|
Binary file (168 kB). View file
|
|
|
Cahya_Instruct_ID/Perplexity_GPT2Cahya.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
Cahya_Instruct_ID/Perplexity_IndoGPT2.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
Cahya_Instruct_ID/Summarization.xlsx
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c5050abdbc2937765d2a8a644213938730d1dd50fbbb351e653f0c7225025c1b
|
| 3 |
+
size 18374147
|
Cahya_Instruct_ID/eval_single.csv
ADDED
|
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
|
|
|
| 1 |
+
QuestionAnswer
|
| 2 |
+
<|prompt|>Siapa penulis naskah proklamasi kemerdekaan Indonesia?<|answer|>Naskah proklamasi kemerdekaan Indonesia ditulis oleh Soekarno dan Hatta tanggal 17 Agustus 1945.</s>
|
MBZUAI_Bactrian_X/.~Indonesian LLM Evaluation.pptx
ADDED
|
Binary file (165 Bytes). View file
|
|
|
MBZUAI_Bactrian_X/.~Summarization.xlsx
ADDED
|
Binary file (165 Bytes). View file
|
|
|
MBZUAI_Bactrian_X/Eval-MBZUAI_DukunLM-Uncensored-7B.csv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dd8fab80dd5693d9fcf506c0e0ec26fbf71245f9fe63212e154f3e72d3c1588c
|
| 3 |
+
size 118239300
|
MBZUAI_Bactrian_X/Eval-MBZUAI_Llama-2-7b-chat-hf.csv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0ae145985cf8088aa5644d23b01fa62802cc5e5f345db489ec71e4718ed05188
|
| 3 |
+
size 141743112
|
MBZUAI_Bactrian_X/Eval-MBZUAI_Merak-7B-v1.csv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a8181018b54fc2c196ab372b11f1c0c27f800a818cc92c919f489e69c6c30fa3
|
| 3 |
+
size 106411863
|
MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-large-indonesian-522M.csv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a560deaafbfc18d8f55abb2787301e8cc8036666d26d85cd41154b1a2ed6167e
|
| 3 |
+
size 106456948
|
MBZUAI_Bactrian_X/Eval-MBZUAI_gpt2-medium-indonesian.csv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f1990cf9ddb0eaf038be31ccc04c02533c88a82b4b3e103d5e146cff5296cb1a
|
| 3 |
+
size 106420724
|
MBZUAI_Bactrian_X/Eval_Summaries.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
MBZUAI_Bactrian_X/Indonesian LLM Evaluation.pdf
ADDED
|
Binary file (290 kB). View file
|
|
|
MBZUAI_Bactrian_X/Indonesian LLM Evaluation.pptx
ADDED
|
Binary file (168 kB). View file
|
|
|
MBZUAI_Bactrian_X/Perplexity_DukunLM-7B-BnB.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
MBZUAI_Bactrian_X/Perplexity_GPT2Cahya.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
MBZUAI_Bactrian_X/Perplexity_IndoGPT2.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
MBZUAI_Bactrian_X/Perplexity_LLama-7B-chat-HF.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
MBZUAI_Bactrian_X/Perplexity_Merak-7B-v1-BnB.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
MBZUAI_Bactrian_X/Summarization.xlsx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d08624dc2ee6f10f79fbdff9d3a6ad779a2b78d1e83b18c744f97caad1dbcdc4
|
| 3 |
+
size 26326799
|
MBZUAI_Bactrian_X/eval_single.csv
ADDED
|
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
|
|
|
| 1 |
+
QuestionAnswer
|
| 2 |
+
<|prompt|>Siapa penulis naskah proklamasi kemerdekaan Indonesia?<|answer|>Naskah proklamasi kemerdekaan Indonesia ditulis oleh Soekarno dan Hatta tanggal 17 Agustus 1945.</s>
|