Instructions to use Maxilicious20/Aether-2.2-Pro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Maxilicious20/Aether-2.2-Pro with PEFT:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct")
model = PeftModel.from_pretrained(base_model, "Maxilicious20/Aether-2.2-Pro")

Transformers

How to use Maxilicious20/Aether-2.2-Pro with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Maxilicious20/Aether-2.2-Pro")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Maxilicious20/Aether-2.2-Pro", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Maxilicious20/Aether-2.2-Pro with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Maxilicious20/Aether-2.2-Pro"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Maxilicious20/Aether-2.2-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Maxilicious20/Aether-2.2-Pro

SGLang

How to use Maxilicious20/Aether-2.2-Pro with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Maxilicious20/Aether-2.2-Pro" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Maxilicious20/Aether-2.2-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Maxilicious20/Aether-2.2-Pro" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Maxilicious20/Aether-2.2-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Maxilicious20/Aether-2.2-Pro with Docker Model Runner:
```
docker model run hf.co/Maxilicious20/Aether-2.2-Pro
```

Aether 2.2 Pro

Aether 2.2 Pro is an upgraded, fine-tuned language model based on Qwen2.5-1.5B-Instruct. Trained using TRL and PEFT (LoRA), the Pro edition delivers enhanced reasoning, improved response structure, and refined multilingual performance in German and English while maintaining efficient local execution.

Model Details

Model Description

Developed by: Maxilicious20
Model type: Causal Language Model (LoRA Adapter)
Language(s) (NLP): German, English
License: Apache-2.0
Finetuned from model: Qwen/Qwen2.5-1.5B-Instruct

Uses

Direct Use

This model is designed for advanced conversational AI, instruction following, and text generation tasks requiring higher precision than standard builds.

How to Get Started with the Model

Use the following Python code to load Aether 2.2 Pro with transformers and peft:

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model_id = "Qwen/Qwen2.5-1.5B-Instruct"
adapter_id = "Maxilicious20/Aether-2.2-Pro"

# Load Tokenizer and Base Model
tokenizer = AutoTokenizer.from_pretrained(base_model_id)
base_model = AutoModelForCausalLM.from_pretrained(
    base_model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto"
)

# Load Aether 2.2 Pro LoRA Adapter
model = PeftModel.from_pretrained(base_model, adapter_id)

# Example Prompt
messages = [
    {"role": "system", "content": "You are Aether Pro, an advanced AI assistant."},
    {"role": "user", "content": "Explain the concept of quantum computing in simple terms."}
]

prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))

Downloads last month: 26

Model tree for Maxilicious20/Aether-2.2-Pro

Base model

Qwen/Qwen2.5-1.5B

Finetuned

Qwen/Qwen2.5-1.5B-Instruct

Adapter

(1284)

this model

Collection including Maxilicious20/Aether-2.2-Pro

Aether

Collection

A collection of every Aether AI model • 5 items • Updated 1 day ago