Quantizations of https://huggingface.co/Aryanne/Open-StarLake-Swap-7B

Inference Clients/UIs


From original readme

image/png This is a merge of pre-trained language models created using mergekit, but my branch was used here

Merge Details

Merge Method

This model was merged using the task_swapping merge method using senseable/WestLake-7B-v2 as a base.

Models Merged

The following models were included in the merge:

Prompt Format:

I prefer using this way, which seems to work.

Example using Koboldcpp:

Start Seq.:

\nYour_name: 

End Seq.:

\nCharacter_name: 

In Memory

### Instruction:
Character description.

Generate a endless verbose(very descriptive) role-play conversation with Character_name.

### Response:
Your_name: how are you doing babe? *Your_name approaches Character_name and kisses her in the lips*
Character_name: I'm fine, it's been an weird day. *Character_name blushes and hugs Your_name with love*
Downloads last month
11
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support