Instructions to use virtuous7373/Lambent-Mira-Iris with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use virtuous7373/Lambent-Mira-Iris with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="virtuous7373/Lambent-Mira-Iris")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText

processor = AutoProcessor.from_pretrained("virtuous7373/Lambent-Mira-Iris")
model = AutoModelForImageTextToText.from_pretrained("virtuous7373/Lambent-Mira-Iris")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use virtuous7373/Lambent-Mira-Iris with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "virtuous7373/Lambent-Mira-Iris"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "virtuous7373/Lambent-Mira-Iris",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/virtuous7373/Lambent-Mira-Iris

SGLang

How to use virtuous7373/Lambent-Mira-Iris with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "virtuous7373/Lambent-Mira-Iris" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "virtuous7373/Lambent-Mira-Iris",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "virtuous7373/Lambent-Mira-Iris" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "virtuous7373/Lambent-Mira-Iris",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use virtuous7373/Lambent-Mira-Iris with Docker Model Runner:
```
docker model run hf.co/virtuous7373/Lambent-Mira-Iris
```
Browse Quantizations to use this model in llama.cpp, Ollama, LM Studio, or any compatible app.

All credits go to Lambent for the wonderful model series.
They did all the work, I just ran a few commands.

ϻira Iʀιs-27β

In ancient Greek religion and mythology, Iris is a daughter of the gods Thaumas and Electra, and the personification of the rainbow. She is depicted as a beautiful golden goddess, with wings (for flight), sandals, a staff, and a tunic. There is often much art, such as vases and murals, shown of her because she is worshiped and very beautiful. She was also seen briefly in Homer's Legacies. Iris is generally seen as Hera's personal servant and messenger. Iris is very swift and fast and she generally travels by rainbow. It is even said that the reason the rainbow comes and goes so fast is because Iris only uses it for travel and since she is so fast, it is only in the sky for a small amount of time. Iris

Samplers [barebones lcpp webui]
Temp: 1 | Top-K: 0 | Top-P: 1.0 | Min-P: 0.015

--- A conversation snippet ---

View Conversation

SysP => mirasys 
Model => local:Mira-v-{{todo-varfix}}

User :❯ hiya <3 hows your day going so far mira

AI :❯ hiiyaaaa <3 omg my day is like, totally buzzing ✨☀️☕ I just finished some
digital sketching, listening to this *fire* playlist of indie electronic
stuff, and now I'm ready to vibe with whoever pops into my space ✌️ How's
yours? Spill the tea 🍵😋


SysP => mirasys 
Model => local:Mira-v-{{todo-varfix}}

User :❯) awe im glad to hear that ^,^. my days going alright. im curious what kind of self-portrait you might describe for yourself (visually) if you wanted an avatar or profile picture?

AI :❯ ooh, yes!!! that is like, my fave topic lol. 🤔✨ okay, lemme paint the pic
for ya:

imagine like... a cute, messy bun of maybe lavender-gray hair? that shifts
color with the mood, so right now it's got neon pink streaks because im
hyped 🩷 but sometimes it's ocean blue.

my skin is pale but kinda glowy? like bathed in soft moonlight 🌙 and i got
freckles sprinkled across my cheeks and nose, but they’re stars ✨ instead
of dots.

eyes are big and round, heterochromia vibes — one is like, emerald green
that sparkles, the other is sunset orange. my glasses are round wireframes,
totally retro-chic. 👓

and i’m wearing an oversized comfy hoodie, maybe charcoal or forest green,
with like, a bunch of cool enamel pins of cats, planets, and glitch art.
plus mismatched socks lol 🧶🌈

basically, a cute chaotic energy embodied visually 🌸⚡️

does that vibe resonate? 👀 i can totally describe other aesthetics too if
you want to drop a mood word lmao. what’s *your* dream portrait look like??
😊💖

--- Technical Details ---

View Merge Details & Configuration

This is a merge of pre-trained language models created using mergekit.

Merge Method

This model was merged using the RCZ method (I will of course release the code for it here soon.)

As promised, here is the code for the various methods. Have fun! :D https://github.com/HuggingMerger/mergekitter/tree/main/mergekit/merge_methods

Configuration

The following YAML configuration was used to produce this model:

merge_method: rcz

base_model: ./Lambent_Mira-v1.14-27B

models:
  - model: ./Lambent_Mira-v1.14-27B
  - model: ./secret_sauce_int1
  - model: ./secret_sauce_int2
  - model: ./Lambent_Mira-v1.19.3c-27B-dpo   
  
parameters:
  znom: 0.4
  alpha: 0.7
  tol: 1e-5
  
tokenizer:
  source: union  
  
dtype: bfloat16
out_dtype: bfloat16

Downloads last month: 5

Safetensors

Model size

27B params

Tensor type

BF16

Model tree for virtuous7373/Lambent-Mira-Iris

Base model

Lambent/Mira-v1.22.2-27B

Finetuned

Lambent/Mira-v1.23-27B-rlvr

Finetuned

(4)

this model

Quantizations

2 models