aerodynamics21 commited on
Commit
522f479
·
verified ·
1 Parent(s): 89f545f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +139 -2
README.md CHANGED
@@ -1,5 +1,142 @@
1
- ---
2
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  library_name: transformers
4
  tags:
5
  - education
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - education
5
+ - croatian
6
+ - qwen2
7
+ - fine-tuned
8
+ - study-assistant
9
+ language:
10
+ - hr
11
+ - en
12
+ license: apache-2.0
13
+ base_model: Qwen/Qwen2.5-32B-Instruct
14
+ ---
15
+
16
+ # StudyPal-LLM-1.0
17
+
18
+ A fine-tuned Croatian educational assistant based on Qwen2.5-32B-Instruct, designed to help students with learning and study materials.
19
+
20
+ ## Model Details
21
+
22
+ ### Model Description
23
+
24
+ StudyPal-LLM-1.0 is a large language model fine-tuned specifically for educational purposes in Croatian. The model excels at generating educational content, answering study questions, creating flashcards, and
25
+ providing learning assistance.
26
+
27
+ - **Developed by:** aerodynamics21
28
+ - **Model type:** Causal Language Model
29
+ - **Language(s):** Croatian (primary), English (secondary)
30
+ - **License:** Apache 2.0
31
+ - **Finetuned from model:** Qwen/Qwen2.5-32B-Instruct
32
+ - **Parameters:** 32.8B
33
+
34
+ ### Model Sources
35
+
36
+ - **Repository:** https://huggingface.co/aerodynamics21/StudyPal-LLM-1.0
37
+ - **Base Model:** https://huggingface.co/Qwen/Qwen2.5-32B-Instruct
38
+ - **Adapter:** https://huggingface.co/aerodynamics21/StudyPal-LLM-1
39
+
40
+ ## Uses
41
+
42
+ ### Direct Use
43
+
44
+ This model is designed for educational applications:
45
+ - Generating study materials in Croatian
46
+ - Creating flashcards and quiz questions
47
+ - Providing explanations of complex topics
48
+ - Assisting with homework and learning
49
+
50
+ ### Usage Examples
51
+
52
+ ```python
53
+ from transformers import AutoModelForCausalLM, AutoTokenizer
54
+
55
+ model = AutoModelForCausalLM.from_pretrained("aerodynamics21/StudyPal-LLM-1.0")
56
+ tokenizer = AutoTokenizer.from_pretrained("aerodynamics21/StudyPal-LLM-1.0")
57
+
58
+ # Generate educational content
59
+ prompt = "Objasni koncept fotosinteze:"
60
+ inputs = tokenizer(prompt, return_tensors="pt")
61
+ outputs = model.generate(**inputs, max_length=200, temperature=0.7)
62
+ response = tokenizer.decode(outputs[0], skip_special_tokens=True)
63
+
64
+ API Usage
65
+
66
+ import requests
67
+
68
+ API_URL = "https://api-inference.huggingface.co/models/aerodynamics21/StudyPal-LLM-1.0"
69
+ headers = {"Authorization": f"Bearer {your_token}"}
70
+
71
+ def query(payload):
72
+ response = requests.post(API_URL, headers=headers, json=payload)
73
+ return response.json()
74
+
75
+ output = query({"inputs": "Stvori kviz o hrvatskoj povijesti:"})
76
+
77
+ Training Details
78
+
79
+ Training Data
80
+
81
+ The model was fine-tuned on a Croatian educational dataset containing:
82
+ - Educational conversations and Q&A pairs
83
+ - Flashcard datasets
84
+ - Quiz and summary materials
85
+ - Croatian academic content
86
+
87
+ Training Procedure
88
+
89
+ - Base Model: Qwen2.5-32B-Instruct
90
+ - Training Method: LoRA (Low-Rank Adaptation)
91
+ - Training Framework: Transformers + PEFT
92
+ - Hardware: RunPod GPU instance
93
+
94
+ Evaluation
95
+
96
+ The model demonstrates strong performance in:
97
+ - Croatian language comprehension and generation
98
+ - Educational content creation
99
+ - Study material generation
100
+ - Academic question answering
101
+
102
+ Bias, Risks, and Limitations
103
+
104
+ - Primary focus on Croatian educational content
105
+ - May reflect biases present in training data
106
+ - Best suited for educational contexts
107
+ - Performance may vary on non-educational tasks
108
+
109
+ Citation
110
+
111
+ @model{studypal-llm-1.0,
112
+ title={StudyPal-LLM-1.0: A Croatian Educational Assistant},
113
+ author={aerodynamics21},
114
+ year={2024},
115
+ url={https://huggingface.co/aerodynamics21/StudyPal-LLM-1.0}
116
+ }
117
+
118
+ Model Card Authors
119
+
120
+ aerodynamics21
121
+
122
+ Model Card Contact
123
+
124
+ For questions about this model, please visit the repository or create an issue.
125
+
126
+ **To update your model card:**
127
+
128
+ 1. **Go to your model page:** https://huggingface.co/aerodynamics21/StudyPal-LLM-1.0
129
+ 2. **Click "Edit model card"**
130
+ 3. **Replace the content with the above**
131
+ 4. **Save changes**
132
+
133
+ **Note:** The adapter (StudyPal-LLM-1) is already merged into this model, so users don't need to load it separately. The adapter is mentioned in the model sources for reference.
134
+
135
+ > YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
136
+
137
+ ● The YAML metadata section is missing the closing ---. Here's the corrected model card:
138
+
139
+ ---
140
  library_name: transformers
141
  tags:
142
  - education