Commit ·
3ecd27d
1
Parent(s): 9bedbb7
Update README.md
Browse files
README.md
CHANGED
|
@@ -27,26 +27,12 @@ A hybrid (explain + instruct) style Llama2-70b model, Pleae check examples below
|
|
| 27 |
* WizardLM_orca
|
| 28 |
* Dolly-V2_orca
|
| 29 |
|
| 30 |
-
|
| 31 |
<br>
|
| 32 |
|
| 33 |
**P.S. If you're interested to collaborate, please connect with me at www.linkedin.com/in/pankajam.**
|
| 34 |
|
| 35 |
<br>
|
| 36 |
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
### quantized versions
|
| 40 |
-
Coming Soon....
|
| 41 |
-
|
| 42 |
-
<br>
|
| 43 |
-
|
| 44 |
-
#### license disclaimer:
|
| 45 |
-
|
| 46 |
-
This model is bound by the license & usage restrictions of the original Llama-2 model. And comes with no warranty or gurantees of any kind.
|
| 47 |
-
|
| 48 |
-
<br>
|
| 49 |
-
|
| 50 |
## Evaluation
|
| 51 |
|
| 52 |
We evaluated model_001 on a wide range of tasks using [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) from EleutherAI.
|
|
@@ -68,9 +54,9 @@ Here are the results on metrics used by [HuggingFaceH4 Open LLM Leaderboard](htt
|
|
| 68 |
|
| 69 |
<br>
|
| 70 |
|
| 71 |
-
##
|
| 72 |
|
| 73 |
-
Here is the
|
| 74 |
|
| 75 |
```
|
| 76 |
### System:
|
|
@@ -83,6 +69,17 @@ Tell me about Orcas.
|
|
| 83 |
|
| 84 |
```
|
| 85 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 86 |
Below shows a code example on how to use this model
|
| 87 |
|
| 88 |
```python
|
|
@@ -147,6 +144,12 @@ print(tokenizer.decode(output[0], skip_special_tokens=True))
|
|
| 147 |
|
| 148 |
<br>
|
| 149 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 150 |
#### Limitations & Biases:
|
| 151 |
|
| 152 |
While this model aims for accuracy, it can occasionally produce inaccurate or misleading results.
|
|
|
|
| 27 |
* WizardLM_orca
|
| 28 |
* Dolly-V2_orca
|
| 29 |
|
|
|
|
| 30 |
<br>
|
| 31 |
|
| 32 |
**P.S. If you're interested to collaborate, please connect with me at www.linkedin.com/in/pankajam.**
|
| 33 |
|
| 34 |
<br>
|
| 35 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
## Evaluation
|
| 37 |
|
| 38 |
We evaluated model_001 on a wide range of tasks using [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) from EleutherAI.
|
|
|
|
| 54 |
|
| 55 |
<br>
|
| 56 |
|
| 57 |
+
## Prompt Format
|
| 58 |
|
| 59 |
+
Here is the prompt format
|
| 60 |
|
| 61 |
```
|
| 62 |
### System:
|
|
|
|
| 69 |
|
| 70 |
```
|
| 71 |
|
| 72 |
+
#### OobaBooga Instructions:
|
| 73 |
+
|
| 74 |
+
This model required upto 45GB GPU VRAM in 4bit so it can be loaded directly on Single RTX 6000/L40/A40/A100/H100 GPU or Double RTX 4090/L4/A10/RTX 3090/RTX A5000
|
| 75 |
+
So, if you have access to Machine with 45GB GPU VRAM and have installed [OobaBooga Web UI](https://github.com/oobabooga/text-generation-webui) on it.
|
| 76 |
+
You can just download this model by using HF repo link directly on OobaBooga Web UI "Model" Tab/Page & Just use **load-in-4bit** option in it.
|
| 77 |
+
|
| 78 |
+
|
| 79 |
+
<br>
|
| 80 |
+
|
| 81 |
+
#### Code Instructions:
|
| 82 |
+
|
| 83 |
Below shows a code example on how to use this model
|
| 84 |
|
| 85 |
```python
|
|
|
|
| 144 |
|
| 145 |
<br>
|
| 146 |
|
| 147 |
+
#### license disclaimer:
|
| 148 |
+
|
| 149 |
+
This model is bound by the license & usage restrictions of the original Llama-2 model. And comes with no warranty or gurantees of any kind.
|
| 150 |
+
|
| 151 |
+
<br>
|
| 152 |
+
|
| 153 |
#### Limitations & Biases:
|
| 154 |
|
| 155 |
While this model aims for accuracy, it can occasionally produce inaccurate or misleading results.
|