SleepyReLU commited on
Commit
8fdfcfd
·
verified ·
1 Parent(s): ea3d29e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -5
README.md CHANGED
@@ -25,19 +25,17 @@ Totally unsure how well the initial filters survived this traumatic data slaught
25
  ## Available Quantizations
26
  | File | Quantization | Size | Parameter Precision | Quality | Recommend for |
27
  |------|--------------|------|---------------------|-----------|---------------|
28
- | `*-Q4_K_M.gguf` | Q4_K_M | ~4.5 GB | 4-bit | medium quality | PC with 8 GB VRAM recommend, 8 GB RAM works but is very slow
29
  | `*-Q8_0.gguf` | Q8_0 | ~8.5 GB | 8-bit | high quality | recommend for >=10 GB VRAM like a 3080
30
  | `*-f16.gguf` | F16 | ~16 GB | 16-bit | Full | Rarely needed, the 8 bit is nearly as good with half the size
31
 
32
- # Next version v0.3 will follow soon:
33
- - Data set will also contain some small military/fighting reasoning => Ready for the RP fight
34
  - Roleplayflow and dark Sci-Fi-focus will be increased. Slowly building the core.
35
  - Overall dark fantasy / dark sci-fi focus since it is just evil right now
36
- - Q4-K_M.gguf soon, hope I manage it this time
37
 
38
 
39
  ## Original Models
40
- - **Base Model:** [unsloth/llama-3-8b-bnb-4bit](https://huggingface.co/unsloth/llama-3-8b-bnb-4bit)
41
  - **Adapter:** [SleepyReLU/DeepDataDemon-8B-Prototype2](https://huggingface.co/SleepyReLU/DeepDataDemon-8B-Prototype2)
42
 
43
  ## Usage
 
25
  ## Available Quantizations
26
  | File | Quantization | Size | Parameter Precision | Quality | Recommend for |
27
  |------|--------------|------|---------------------|-----------|---------------|
28
+ | `*-Q4_K_M.gguf` | Q4_K_M | ~5.0 GB | 4-bit | medium quality | PC with 8 GB VRAM recommend, 8 GB RAM works but is very slow
29
  | `*-Q8_0.gguf` | Q8_0 | ~8.5 GB | 8-bit | high quality | recommend for >=10 GB VRAM like a 3080
30
  | `*-f16.gguf` | F16 | ~16 GB | 16-bit | Full | Rarely needed, the 8 bit is nearly as good with half the size
31
 
32
+ # Next version v0.4 will follow soon:
 
33
  - Roleplayflow and dark Sci-Fi-focus will be increased. Slowly building the core.
34
  - Overall dark fantasy / dark sci-fi focus since it is just evil right now
 
35
 
36
 
37
  ## Original Models
38
+ - **Base Model:** [unsloth/Meta-Llama-3.1-8B](https://huggingface.co/unsloth/Meta-Llama-3.1-8B)
39
  - **Adapter:** [SleepyReLU/DeepDataDemon-8B-Prototype2](https://huggingface.co/SleepyReLU/DeepDataDemon-8B-Prototype2)
40
 
41
  ## Usage