Maxilicious20 commited on
Commit
5c839dd
Β·
verified Β·
1 Parent(s): 7eef48c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +63 -30
README.md CHANGED
@@ -1,57 +1,90 @@
1
  ---
2
- language:
3
- - en
4
- license: apache-2.0
5
  base_model: Qwen/Qwen2.5-3B-Instruct
 
 
6
  tags:
7
- - mono-ai
8
- - aether
9
- - text-generation
10
  - lora
11
- - merged
12
- pipeline_tag: text-generation
 
 
 
 
 
 
 
 
 
13
  ---
14
 
15
- # 🌌 Aether 2.5
 
 
16
 
17
- **Aether 2.5** is a fine-tuned 3-billion parameter instruction-following language model developed by **Mono AI Studio**. It is based on `Qwen/Qwen2.5-3B-Instruct` and optimized for enhanced reasoning, knowledge retrieval, and standard text benchmarks.
 
 
18
 
19
- ## πŸ“Š Benchmark Results
20
 
21
- Evaluated on a 6-benchmark evaluation suite (300 MC samples per benchmark):
22
 
23
- | Benchmark | Aether 2.3 | Aether 2.5 | Improvement |
24
- | :--- | :---: | :---: | :---: |
25
- | **ARC-Challenge** | 45.3% | **48.3%** | +3.0% |
26
- | **OpenBookQA** | 49.7% | **52.3%** | +2.6% |
27
- | **MMLU** | 37.3% | **39.7%** | +2.4% |
28
- | **HellaSwag** | 51.7% | **54.0%** | +2.3% |
29
- | **Overall Average** | 33.2% | **33.6%** | **+0.4%** |
30
 
31
- ## πŸš€ Usage
32
 
33
- You can run this model locally using standard Hugging Face Transformers:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
 
35
  ```python
36
- from transformers import AutoModelForCausalLM, AutoTokenizer
37
  import torch
 
 
38
 
39
- model_name = "Maxilicious20/Aether-2.5"
 
40
 
41
- tokenizer = AutoTokenizer.from_pretrained(model_name)
42
- model = AutoModelForCausalLM.from_pretrained(
43
- model_name,
44
- torch_dtype=torch.bfloat16 if torch.cuda.is_bf16_supported() else torch.float16,
 
45
  device_map="auto"
46
  )
47
 
 
 
 
 
48
  messages = [
49
- {"role": "system", "content": "You are a highly capable AI assistant developed by Mono AI Studio."},
50
- {"role": "user", "content": "Explain quantum computing in simple terms."}
51
  ]
52
 
53
  prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
54
  inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
55
 
56
- outputs = model.generate(**inputs, max_new_tokens=512)
57
  print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))
 
1
  ---
 
 
 
2
  base_model: Qwen/Qwen2.5-3B-Instruct
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
  tags:
6
+ - base_model:adapter:Qwen/Qwen2.5-3B-Instruct
 
 
7
  - lora
8
+ - sft
9
+ - transformers
10
+ - trl
11
+ - german
12
+ - english
13
+ - aether
14
+ - gguf
15
+ license: apache-2.0
16
+ language:
17
+ - de
18
+ - en
19
  ---
20
 
21
+ # Aether 2.5
22
+
23
+ Aether 2.5 represents a major milestone in the Aether model series, built on top of the **Qwen2.5-3B-Instruct** base architecture. Trained with SFT (Supervised Fine-Tuning) via Hugging Face TRL and PEFT (LoRA) on a custom 3 GB dataset using local NVIDIA RTX GPU acceleration, Aether 2.5 offers significantly higher intelligence, broader contextual understanding, and superior multilingual responses in German and English.
24
 
25
+ > πŸš€ **Looking for GGUF versions?**
26
+ > If you want to run Aether 2.5 locally via **LM Studio**, **Ollama**, or **llama.cpp**, check out the pre-quantized GGUF repository:
27
+ > πŸ‘‰ **[Maxilicious20/Aether-2.5-GGUF](https://huggingface.co/Maxilicious20/Aether-2.5-GGUF)**
28
 
29
+ ## Model Details
30
 
31
+ ### Model Description
32
 
33
+ - **Developed by:** Maxilicious20
34
+ - **Model type:** Causal Language Model (LoRA Adapter)
35
+ - **Language(s) (NLP):** German, English
36
+ - **License:** Apache-2.0
37
+ - **Finetuned from model:** Qwen/Qwen2.5-3B-Instruct
 
 
38
 
39
+ ## Uses
40
 
41
+ ### Direct Use
42
+
43
+ Aether 2.5 is designed for high-capability conversational AI, complex instruction following, creative text generation, and technical reasoning. Thanks to its LoRA adapter implementation, it delivers flagship 3B-class performance while remaining light enough to run efficiently on local hardware.
44
+
45
+ ### Quantized & GGUF Models
46
+
47
+ For standalone, CPU/GPU local execution without Python/Transformers dependencies, use the quantized GGUF binaries:
48
+
49
+ * πŸ“¦ **GGUF Repository:** [Maxilicious20/Aether-2.5-GGUF](https://huggingface.co/Maxilicious20/Aether-2.5-GGUF)
50
+ * **Available Quantizations:**
51
+ * `aether_2_5_fp16.gguf` (Uncompressed / Full Precision)
52
+ * `Aether-2.5-3B-Q8_0.gguf` (High Quality / 8-bit)
53
+ * `Aether-2.5-3B-Q4_K_M.gguf` (Recommended / Balanced Performance & VRAM)
54
+
55
+ ### How to Get Started with the Model
56
+
57
+ #### Python (Transformers & PEFT)
58
+
59
+ Use the following Python code to load Aether 2.5 with `transformers` and `peft`:
60
 
61
  ```python
 
62
  import torch
63
+ from transformers import AutoModelForCausalLM, AutoTokenizer
64
+ from peft import PeftModel
65
 
66
+ base_model_id = "Qwen/Qwen2.5-3B-Instruct"
67
+ adapter_id = "Maxilicious20/Aether-2.5"
68
 
69
+ # Load Tokenizer and Base Model
70
+ tokenizer = AutoTokenizer.from_pretrained(base_model_id)
71
+ base_model = AutoModelForCausalLM.from_pretrained(
72
+ base_model_id,
73
+ torch_dtype=torch.bfloat16,
74
  device_map="auto"
75
  )
76
 
77
+ # Load Aether 2.5 LoRA Adapter
78
+ model = PeftModel.from_pretrained(base_model, adapter_id)
79
+
80
+ # Example Prompt
81
  messages = [
82
+ {"role": "system", "content": "You are Aether 2.5, an advanced AI assistant."},
83
+ {"role": "user", "content": "Hello! What improvements do you bring as a 3B model?"}
84
  ]
85
 
86
  prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
87
  inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
88
 
89
+ outputs = model.generate(**inputs, max_new_tokens=256)
90
  print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))