Maxilicious20 commited on
Commit
8b79258
·
verified ·
1 Parent(s): 85a5af1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -41
README.md CHANGED
@@ -1,62 +1,73 @@
1
  ---
2
  base_model: Qwen/Qwen2.5-3B-Instruct
3
  library_name: peft
4
- model_name: aether_2_3_model
5
  tags:
6
  - base_model:adapter:Qwen/Qwen2.5-3B-Instruct
7
  - lora
8
  - sft
9
  - transformers
10
  - trl
11
- licence: license
12
- pipeline_tag: text-generation
 
 
 
 
 
13
  ---
14
 
15
- # Model Card for aether_2_3_model
16
-
17
- This model is a fine-tuned version of [Qwen/Qwen2.5-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-3B-Instruct).
18
- It has been trained using [TRL](https://github.com/huggingface/trl).
19
 
20
- ## Quick start
21
-
22
- ```python
23
- from transformers import pipeline
24
 
25
- question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
26
- generator = pipeline("text-generation", model="None", device="cuda")
27
- output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
28
- print(output["generated_text"])
29
- ```
30
 
31
- ## Training procedure
32
 
33
-
 
 
 
 
34
 
 
35
 
 
36
 
37
- This model was trained with SFT.
38
 
39
- ### Framework versions
40
 
41
- - PEFT 0.20.0
42
- - TRL: 1.9.2
43
- - Transformers: 5.14.1
44
- - Pytorch: 2.13.0+cu126
45
- - Datasets: 5.0.1
46
- - Tokenizers: 0.22.2
47
 
48
- ## Citations
49
-
50
-
51
-
52
- Cite TRL as:
53
-
54
- ```bibtex
55
- @software{vonwerra2020trl,
56
- title = {{TRL: Transformers Reinforcement Learning}},
57
- author = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin},
58
- license = {Apache-2.0},
59
- url = {https://github.com/huggingface/trl},
60
- year = {2020}
61
- }
62
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  base_model: Qwen/Qwen2.5-3B-Instruct
3
  library_name: peft
4
+ pipeline_tag: text-generation
5
  tags:
6
  - base_model:adapter:Qwen/Qwen2.5-3B-Instruct
7
  - lora
8
  - sft
9
  - transformers
10
  - trl
11
+ - german
12
+ - english
13
+ - aether
14
+ license: apache-2.0
15
+ language:
16
+ - de
17
+ - en
18
  ---
19
 
20
+ # Aether 2.3
 
 
 
21
 
22
+ Aether 2.3 represents a major milestone in the Aether model series, scaling up to the **Qwen2.5-3B-Instruct** base architecture. Trained with SFT (Supervised Fine-Tuning) via Hugging Face TRL and PEFT (LoRA) on a custom 3 GB dataset using local NVIDIA RTX GPU acceleration, Aether 2.3 offers significantly higher intelligence, broader contextual understanding, and superior multilingual responses in German and English.
 
 
 
23
 
24
+ ## Model Details
 
 
 
 
25
 
26
+ ### Model Description
27
 
28
+ - **Developed by:** Maxilicious20
29
+ - **Model type:** Causal Language Model (LoRA Adapter)
30
+ - **Language(s) (NLP):** German, English
31
+ - **License:** Apache-2.0
32
+ - **Finetuned from model:** Qwen/Qwen2.5-3B-Instruct
33
 
34
+ ## Uses
35
 
36
+ ### Direct Use
37
 
38
+ Aether 2.3 is designed for high-capability conversational AI, complex instruction following, creative text generation, and technical reasoning. Thanks to its LoRA adapter implementation, it delivers flagship 3B-class performance while remaining light enough to run efficiently on local hardware.
39
 
40
+ ### How to Get Started with the Model
41
 
42
+ Use the following Python code to load Aether 2.3 with `transformers` and `peft`:
 
 
 
 
 
43
 
44
+ ```python
45
+ import torch
46
+ from transformers import AutoModelForCausalLM, AutoTokenizer
47
+ from peft import PeftModel
48
+
49
+ base_model_id = "Qwen/Qwen2.5-3B-Instruct"
50
+ adapter_id = "Maxilicious20/Aether-2.3"
51
+
52
+ # Load Tokenizer and Base Model
53
+ tokenizer = AutoTokenizer.from_pretrained(base_model_id)
54
+ base_model = AutoModelForCausalLM.from_pretrained(
55
+ base_model_id,
56
+ torch_dtype=torch.bfloat16,
57
+ device_map="auto"
58
+ )
59
+
60
+ # Load Aether 2.3 LoRA Adapter
61
+ model = PeftModel.from_pretrained(base_model, adapter_id)
62
+
63
+ # Example Prompt
64
+ messages = [
65
+ {"role": "system", "content": "You are Aether 2.3, an advanced AI assistant."},
66
+ {"role": "user", "content": "Hello! What improvements do you bring as a 3B model?"}
67
+ ]
68
+
69
+ prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
70
+ inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
71
+
72
+ outputs = model.generate(**inputs, max_new_tokens=256)
73
+ print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))