CyberNative
/

CyberBase-13b

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

CyberNative commited on Aug 18, 2023

Commit

ec9a6fe

·

1 Parent(s): 6b78b29

Update README.md

Files changed (1) hide show

README.md +6 -7

README.md CHANGED Viewed

@@ -1,18 +1,17 @@
 ---
 license: llama2
 ---
-!!! THIS IS A PLACEHOLDER !!!
 !!! MODEL COMMING SOON !!!
 # CyberBase 8k - (llama-2-13b - lmsys/vicuna-13b-v1.5-16k)
 Base cybersecurity model for future fine-tuning, it is not reccomended to use on it's own.
-- **CyberBase is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on of [CyberNative/github_cybersecurity_READMEs](https://huggingface.co/datasets/CyberNative/github_cybersecurity_READMEs)
-- **sequence_len: 8192
-- **lora_r: 128
-- **lora_alpha: 16
-- **num_epochs: 2
 [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)

 ---
 license: llama2
 ---
+!!! **THIS IS A PLACEHOLDER** !!!
 !!! MODEL COMMING SOON !!!
 # CyberBase 8k - (llama-2-13b - lmsys/vicuna-13b-v1.5-16k)
 Base cybersecurity model for future fine-tuning, it is not reccomended to use on it's own.
+- **CyberBase** is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on [CyberNative/github_cybersecurity_READMEs](https://huggingface.co/datasets/CyberNative/github_cybersecurity_READMEs)
+- **sequence_len:** 8192
+- **lora_r:** 128
+- **lora_alpha:** 16
+- **num_epochs:** 2
 [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)