Commit
·
51e603c
1
Parent(s):
c0611db
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ license: llama2
|
|
| 7 |
|
| 8 |
# CyberBase 8k - (llama-2-13b - lmsys/vicuna-13b-v1.5-16k)
|
| 9 |
|
| 10 |
-
Base cybersecurity model for future fine-tuning, it is not
|
| 11 |
- **CyberBase** is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on [CyberNative/github_cybersecurity_READMEs](https://huggingface.co/datasets/CyberNative/github_cybersecurity_READMEs)
|
| 12 |
- **sequence_len:** 8192
|
| 13 |
- **lora_r:** 128
|
|
|
|
| 7 |
|
| 8 |
# CyberBase 8k - (llama-2-13b - lmsys/vicuna-13b-v1.5-16k)
|
| 9 |
|
| 10 |
+
Base cybersecurity model for future fine-tuning, it is not recomended to use on it's own.
|
| 11 |
- **CyberBase** is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on [CyberNative/github_cybersecurity_READMEs](https://huggingface.co/datasets/CyberNative/github_cybersecurity_READMEs)
|
| 12 |
- **sequence_len:** 8192
|
| 13 |
- **lora_r:** 128
|