Update README.md
Browse files
README.md
CHANGED
|
@@ -28,15 +28,20 @@ To use GGUF format for Llama.cpp or running in LM Studio, Jan and other local so
|
|
| 28 |
|
| 29 |
# How to use
|
| 30 |
|
| 31 |
-
|
|
|
|
|
|
|
| 32 |
|
| 33 |
This sample use unsloth for colab, you may switch to unsloth only if you want
|
| 34 |
|
| 35 |
```
|
| 36 |
pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
|
|
|
|
| 37 |
```
|
| 38 |
|
| 39 |
-
|
|
|
|
|
|
|
| 40 |
alpaca_prompt = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
|
| 41 |
|
| 42 |
### Instruction:
|
|
|
|
| 28 |
|
| 29 |
# How to use
|
| 30 |
|
| 31 |
+
For faster startup, checkout the [Example notebook here](https://colab.research.google.com/drive/1h6NyOBCzSYrx-nBoRA1X40loIe2oTioA?usp=sharing)
|
| 32 |
+
|
| 33 |
+
## Install unsloth
|
| 34 |
|
| 35 |
This sample use unsloth for colab, you may switch to unsloth only if you want
|
| 36 |
|
| 37 |
```
|
| 38 |
pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
|
| 39 |
+
pip install --no-deps "xformers<0.0.27" "trl<0.9.0" peft accelerate bitsandbytes
|
| 40 |
```
|
| 41 |
|
| 42 |
+
## Run inference
|
| 43 |
+
|
| 44 |
+
```python
|
| 45 |
alpaca_prompt = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
|
| 46 |
|
| 47 |
### Instruction:
|