Maxilicious20 commited on
Commit
7bad129
·
verified ·
1 Parent(s): f85f613

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +73 -36
README.md CHANGED
@@ -1,62 +1,99 @@
1
  ---
2
  base_model: Qwen/Qwen2.5-3B-Instruct
3
  library_name: peft
4
- model_name: aether_2_5_pro_model
5
  tags:
6
  - base_model:adapter:Qwen/Qwen2.5-3B-Instruct
7
  - lora
8
  - sft
9
  - transformers
10
  - trl
11
- licence: license
12
- pipeline_tag: text-generation
 
 
 
 
 
 
 
13
  ---
14
 
15
- # Model Card for aether_2_5_pro_model
16
 
17
- This model is a fine-tuned version of [Qwen/Qwen2.5-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-3B-Instruct).
18
- It has been trained using [TRL](https://github.com/huggingface/trl).
19
 
20
- ## Quick start
 
 
 
 
21
 
22
- ```python
23
- from transformers import pipeline
 
 
 
 
 
24
 
25
- question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
26
- generator = pipeline("text-generation", model="None", device="cuda")
27
- output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
28
- print(output["generated_text"])
29
- ```
30
 
31
- ## Training procedure
32
 
33
-
34
 
 
 
 
 
 
 
35
 
 
36
 
37
- This model was trained with SFT.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
 
39
- ### Framework versions
 
40
 
41
- - PEFT 0.20.0
42
- - TRL: 1.9.2
43
- - Transformers: 5.14.1
44
- - Pytorch: 2.13.0+cu126
45
- - Datasets: 5.0.1
46
- - Tokenizers: 0.22.2
47
 
48
- ## Citations
49
 
 
 
 
 
50
 
 
 
51
 
52
- Cite TRL as:
53
-
54
- ```bibtex
55
- @software{vonwerra2020trl,
56
- title = {{TRL: Transformers Reinforcement Learning}},
57
- author = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin},
58
- license = {Apache-2.0},
59
- url = {https://github.com/huggingface/trl},
60
- year = {2020}
61
- }
62
- ```
 
1
  ---
2
  base_model: Qwen/Qwen2.5-3B-Instruct
3
  library_name: peft
4
+ pipeline_tag: text-generation
5
  tags:
6
  - base_model:adapter:Qwen/Qwen2.5-3B-Instruct
7
  - lora
8
  - sft
9
  - transformers
10
  - trl
11
+ - german
12
+ - english
13
+ - aether
14
+ - aether-2.5
15
+ - gguf
16
+ license: apache-2.0
17
+ language:
18
+ - de
19
+ - en
20
  ---
21
 
22
+ # Aether 2.5 Pro
23
 
24
+ Aether 2.5 Pro is the strongest model in the Aether 2.5 series so far.
25
+ It is a fine-tuned version of **Qwen2.5-3B-Instruct**, trained with TRL + PEFT (LoRA) on a higher-quality and more diverse dataset than previous versions.
26
 
27
+ Compared to the standard Aether 2.5, the Pro version offers:
28
+ - Better reasoning
29
+ - Improved instruction following
30
+ - Stronger multilingual performance (German + English)
31
+ - Higher overall response quality while staying efficient for local use
32
 
33
+ > 🚀 **Looking for GGUF versions?**
34
+ > If you want to run Aether 2.5 Pro locally via **LM Studio**, **Ollama**, or **llama.cpp**, check out the pre-quantized GGUF repository:
35
+ > 👉 **[Maxilicious20/Aether-2.5-Pro-GGUF](https://huggingface.co/Maxilicious20/Aether-2.5-Pro-GGUF)**
36
+
37
+ ## Model Details
38
+
39
+ ### Model Description
40
 
41
+ - **Developed by:** Maxilicious20 (Mono AI Studio)
42
+ - **Model type:** Causal Language Model (LoRA Adapter)
43
+ - **Language(s):** German, English
44
+ - **License:** Apache-2.0
45
+ - **Finetuned from model:** [Qwen/Qwen2.5-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-3B-Instruct)
46
 
47
+ ## Uses
48
 
49
+ ### Direct Use
50
 
51
+ Aether 2.5 Pro is designed for:
52
+ - High-quality conversational AI
53
+ - Reasoning and problem solving
54
+ - Instruction following
55
+ - General text generation
56
+ - Local deployment on consumer hardware
57
 
58
+ ### Quantized & GGUF Models
59
 
60
+ For easy local usage without Python, use the GGUF versions:
61
+
62
+ * 📦 **GGUF Repository:** [Maxilicious20/Aether-2.5-Pro-GGUF](https://huggingface.co/Maxilicious20/Aether-2.5-Pro-GGUF)
63
+ * **Recommended quantizations:**
64
+ * `aether-2.5-pro-q4_k_m.gguf` → Best balance (recommended)
65
+ * `aether-2.5-pro-q5_k_m.gguf` → Higher quality
66
+ * `aether-2.5-pro-q8_0.gguf` → Near full quality
67
+ * `aether-2.5-pro-f16.gguf` → Full precision
68
+
69
+ ## How to Use
70
+
71
+ ### Python (Transformers + PEFT)
72
+
73
+ ```python
74
+ import torch
75
+ from transformers import AutoModelForCausalLM, AutoTokenizer
76
+ from peft import PeftModel
77
 
78
+ base_model_id = "Qwen/Qwen2.5-3B-Instruct"
79
+ adapter_id = "Maxilicious20/Aether-2.5-Pro"
80
 
81
+ tokenizer = AutoTokenizer.from_pretrained(base_model_id)
82
+ base_model = AutoModelForCausalLM.from_pretrained(
83
+ base_model_id,
84
+ torch_dtype=torch.bfloat16,
85
+ device_map="auto"
86
+ )
87
 
88
+ model = PeftModel.from_pretrained(base_model, adapter_id)
89
 
90
+ messages = [
91
+ {"role": "system", "content": "You are Aether 2.5 Pro, a highly capable AI assistant developed by Mono AI Studio."},
92
+ {"role": "user", "content": "Explain the difference between supervised and unsupervised learning in simple terms."}
93
+ ]
94
 
95
+ prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
96
+ inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
97
 
98
+ outputs = model.generate(**inputs, max_new_tokens=512)
99
+ print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))