prithivMLmods commited on
Commit
80958dc
verified
1 Parent(s): 8d9af89

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +252 -0
README.md CHANGED
@@ -2,8 +2,12 @@
2
  license: apache-2.0
3
  datasets:
4
  - Artificio/WikiArt
 
5
  ---
6
 
 
 
 
7
 
8
  ```py
9
  from datasets import load_dataset
@@ -23,3 +27,251 @@ print(id2label)
23
 
24
  {'0': 'Abstract Art', '1': 'Abstract Expressionism', '2': 'Academicism', '3': 'Action painting', '4': 'American Realism', '5': 'Analytical Cubism', '6': 'Analytical\xa0Realism', '7': 'Art Brut', '8': 'Art Deco', '9': 'Art Informel', '10': 'Art Nouveau (Modern)', '11': 'Automatic Painting', '12': 'Baroque', '13': 'Biedermeier', '14': 'Byzantine', '15': 'Cartographic Art', '16': 'Classicism', '17': 'Cloisonnism', '18': 'Color Field Painting', '19': 'Conceptual Art', '20': 'Concretism', '21': 'Constructivism', '22': 'Contemporary Realism', '23': 'Costumbrismo', '24': 'Cubism', '25': 'Cubo-Expressionism', '26': 'Cubo-Futurism', '27': 'Dada', '28': 'Divisionism', '29': 'Early Renaissance', '30': 'Environmental (Land) Art', '31': 'Existential Art', '32': 'Expressionism', '33': 'Fantastic Realism', '34': 'Fauvism', '35': 'Feminist Art', '36': 'Figurative Expressionism', '37': 'Futurism', '38': 'Gongbi', '39': 'Gothic', '40': 'Hard Edge Painting', '41': 'High Renaissance', '42': 'Hyper-Realism', '43': 'Ilkhanid', '44': 'Impressionism', '45': 'Indian Space painting', '46': 'Ink and wash painting', '47': 'International Gothic', '48': 'Intimism', '49': 'Japonism', '50': 'Joseon Dynasty', '51': 'Kinetic Art', '52': 'Kitsch', '53': 'Lettrism', '54': 'Light and Space', '55': 'Luminism', '56': 'Lyrical Abstraction', '57': 'Magic Realism', '58': 'Mail Art', '59': 'Mannerism (Late Renaissance)', '60': 'Mechanistic Cubism', '61': 'Metaphysical art', '62': 'Minimalism', '63': 'Miserablism', '64': 'Modernismo', '65': 'Mosan art', '66': 'Muralism', '67': 'Nanga (Bunjinga)', '68': 'Nas-Taliq', '69': 'Native Art', '70': 'Naturalism', '71': 'Na茂ve Art (Primitivism)', '72': 'Neo-Byzantine', '73': 'Neo-Concretism', '74': 'Neo-Dada', '75': 'Neo-Expressionism', '76': 'Neo-Figurative Art', '77': 'Neo-Rococo', '78': 'Neo-Romanticism', '79': 'Neo-baroque', '80': 'Neoclassicism', '81': 'Neoplasticism', '82': 'New Casualism', '83': 'New European Painting', '84': 'New Realism', '85': 'Nihonga', '86': 'None', '87': 'Northern Renaissance', '88': 'Nouveau R茅alisme', '89': 'Op Art', '90': 'Orientalism', '91': 'Orphism', '92': 'Ottoman Period', '93': 'Outsider art', '94': 'Perceptism ', '95': 'Photorealism', '96': 'Pointillism', '97': 'Pop Art', '98': 'Post-Impressionism', '99': 'Post-Minimalism', '100': 'Post-Painterly Abstraction', '101': 'Poster Art Realism', '102': 'Precisionism', '103': 'Primitivism', '104': 'Proto Renaissance', '105': 'Purism', '106': 'Rayonism', '107': 'Realism', '108': 'Regionalism', '109': 'Renaissance', '110': 'Rococo', '111': 'Romanesque', '112': 'Romanticism', '113': 'Safavid Period', '114': 'Shin-hanga', '115': 'Social Realism', '116': 'Socialist Realism', '117': 'Spatialism', '118': 'Spectralism', '119': 'Street art', '120': 'Suprematism', '121': 'Surrealism', '122': 'Symbolism', '123': 'Synchromism', '124': 'Synthetic Cubism', '125': 'Synthetism', '126': 'S艒saku hanga', '127': 'Tachisme', '128': 'Tenebrism', '129': 'Timurid Period', '130': 'Tonalism', '131': 'Transautomatism', '132': 'Tubism', '133': 'Ukiyo-e', '134': 'Verism', '135': 'Yamato-e', '136': 'Zen'}
25
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
  datasets:
4
  - Artificio/WikiArt
5
+ library_name: transformers
6
  ---
7
 
8
+ # **WikiArt-Style**
9
+
10
+ > **WikiArt-Style** is a vision model fine-tuned from **google/siglip2-base-patch16-224** using the **SiglipForImageClassification** architecture. It classifies art images into one of 137 painting style categories.
11
 
12
  ```py
13
  from datasets import load_dataset
 
27
 
28
  {'0': 'Abstract Art', '1': 'Abstract Expressionism', '2': 'Academicism', '3': 'Action painting', '4': 'American Realism', '5': 'Analytical Cubism', '6': 'Analytical\xa0Realism', '7': 'Art Brut', '8': 'Art Deco', '9': 'Art Informel', '10': 'Art Nouveau (Modern)', '11': 'Automatic Painting', '12': 'Baroque', '13': 'Biedermeier', '14': 'Byzantine', '15': 'Cartographic Art', '16': 'Classicism', '17': 'Cloisonnism', '18': 'Color Field Painting', '19': 'Conceptual Art', '20': 'Concretism', '21': 'Constructivism', '22': 'Contemporary Realism', '23': 'Costumbrismo', '24': 'Cubism', '25': 'Cubo-Expressionism', '26': 'Cubo-Futurism', '27': 'Dada', '28': 'Divisionism', '29': 'Early Renaissance', '30': 'Environmental (Land) Art', '31': 'Existential Art', '32': 'Expressionism', '33': 'Fantastic Realism', '34': 'Fauvism', '35': 'Feminist Art', '36': 'Figurative Expressionism', '37': 'Futurism', '38': 'Gongbi', '39': 'Gothic', '40': 'Hard Edge Painting', '41': 'High Renaissance', '42': 'Hyper-Realism', '43': 'Ilkhanid', '44': 'Impressionism', '45': 'Indian Space painting', '46': 'Ink and wash painting', '47': 'International Gothic', '48': 'Intimism', '49': 'Japonism', '50': 'Joseon Dynasty', '51': 'Kinetic Art', '52': 'Kitsch', '53': 'Lettrism', '54': 'Light and Space', '55': 'Luminism', '56': 'Lyrical Abstraction', '57': 'Magic Realism', '58': 'Mail Art', '59': 'Mannerism (Late Renaissance)', '60': 'Mechanistic Cubism', '61': 'Metaphysical art', '62': 'Minimalism', '63': 'Miserablism', '64': 'Modernismo', '65': 'Mosan art', '66': 'Muralism', '67': 'Nanga (Bunjinga)', '68': 'Nas-Taliq', '69': 'Native Art', '70': 'Naturalism', '71': 'Na茂ve Art (Primitivism)', '72': 'Neo-Byzantine', '73': 'Neo-Concretism', '74': 'Neo-Dada', '75': 'Neo-Expressionism', '76': 'Neo-Figurative Art', '77': 'Neo-Rococo', '78': 'Neo-Romanticism', '79': 'Neo-baroque', '80': 'Neoclassicism', '81': 'Neoplasticism', '82': 'New Casualism', '83': 'New European Painting', '84': 'New Realism', '85': 'Nihonga', '86': 'None', '87': 'Northern Renaissance', '88': 'Nouveau R茅alisme', '89': 'Op Art', '90': 'Orientalism', '91': 'Orphism', '92': 'Ottoman Period', '93': 'Outsider art', '94': 'Perceptism ', '95': 'Photorealism', '96': 'Pointillism', '97': 'Pop Art', '98': 'Post-Impressionism', '99': 'Post-Minimalism', '100': 'Post-Painterly Abstraction', '101': 'Poster Art Realism', '102': 'Precisionism', '103': 'Primitivism', '104': 'Proto Renaissance', '105': 'Purism', '106': 'Rayonism', '107': 'Realism', '108': 'Regionalism', '109': 'Renaissance', '110': 'Rococo', '111': 'Romanesque', '112': 'Romanticism', '113': 'Safavid Period', '114': 'Shin-hanga', '115': 'Social Realism', '116': 'Socialist Realism', '117': 'Spatialism', '118': 'Spectralism', '119': 'Street art', '120': 'Suprematism', '121': 'Surrealism', '122': 'Symbolism', '123': 'Synchromism', '124': 'Synthetic Cubism', '125': 'Synthetism', '126': 'S艒saku hanga', '127': 'Tachisme', '128': 'Tenebrism', '129': 'Timurid Period', '130': 'Tonalism', '131': 'Transautomatism', '132': 'Tubism', '133': 'Ukiyo-e', '134': 'Verism', '135': 'Yamato-e', '136': 'Zen'}
29
 
30
+
31
+ The model predicts one of the following painting **style** categories:
32
+
33
+ ```
34
+ 0: Abstract Art
35
+ 1: Abstract Expressionism
36
+ 2: Academicism
37
+ 3: Action painting
38
+ 4: American Realism
39
+ 5: Analytical Cubism
40
+ 6: Analytical聽Realism
41
+ 7: Art Brut
42
+ 8: Art Deco
43
+ 9: Art Informel
44
+ 10: Art Nouveau (Modern)
45
+ 11: Automatic Painting
46
+ 12: Baroque
47
+ 13: Biedermeier
48
+ 14: Byzantine
49
+ 15: Cartographic Art
50
+ 16: Classicism
51
+ 17: Cloisonnism
52
+ 18: Color Field Painting
53
+ 19: Conceptual Art
54
+ 20: Concretism
55
+ 21: Constructivism
56
+ 22: Contemporary Realism
57
+ 23: Costumbrismo
58
+ 24: Cubism
59
+ 25: Cubo-Expressionism
60
+ 26: Cubo-Futurism
61
+ 27: Dada
62
+ 28: Divisionism
63
+ 29: Early Renaissance
64
+ 30: Environmental (Land) Art
65
+ 31: Existential Art
66
+ 32: Expressionism
67
+ 33: Fantastic Realism
68
+ 34: Fauvism
69
+ 35: Feminist Art
70
+ 36: Figurative Expressionism
71
+ 37: Futurism
72
+ 38: Gongbi
73
+ 39: Gothic
74
+ 40: Hard Edge Painting
75
+ 41: High Renaissance
76
+ 42: Hyper-Realism
77
+ 43: Ilkhanid
78
+ 44: Impressionism
79
+ 45: Indian Space painting
80
+ 46: Ink and wash painting
81
+ 47: International Gothic
82
+ 48: Intimism
83
+ 49: Japonism
84
+ 50: Joseon Dynasty
85
+ 51: Kinetic Art
86
+ 52: Kitsch
87
+ 53: Lettrism
88
+ 54: Light and Space
89
+ 55: Luminism
90
+ 56: Lyrical Abstraction
91
+ 57: Magic Realism
92
+ 58: Mail Art
93
+ 59: Mannerism (Late Renaissance)
94
+ 60: Mechanistic Cubism
95
+ 61: Metaphysical art
96
+ 62: Minimalism
97
+ 63: Miserablism
98
+ 64: Modernismo
99
+ 65: Mosan art
100
+ 66: Muralism
101
+ 67: Nanga (Bunjinga)
102
+ 68: Nas-Taliq
103
+ 69: Native Art
104
+ 70: Naturalism
105
+ 71: Na茂ve Art (Primitivism)
106
+ 72: Neo-Byzantine
107
+ 73: Neo-Concretism
108
+ 74: Neo-Dada
109
+ 75: Neo-Expressionism
110
+ 76: Neo-Figurative Art
111
+ 77: Neo-Rococo
112
+ 78: Neo-Romanticism
113
+ 79: Neo-baroque
114
+ 80: Neoclassicism
115
+ 81: Neoplasticism
116
+ 82: New Casualism
117
+ 83: New European Painting
118
+ 84: New Realism
119
+ 85: Nihonga
120
+ 86: None
121
+ 87: Northern Renaissance
122
+ 88: Nouveau R茅alisme
123
+ 89: Op Art
124
+ 90: Orientalism
125
+ 91: Orphism
126
+ 92: Ottoman Period
127
+ 93: Outsider art
128
+ 94: Perceptism
129
+ 95: Photorealism
130
+ 96: Pointillism
131
+ 97: Pop Art
132
+ 98: Post-Impressionism
133
+ 99: Post-Minimalism
134
+ 100: Post-Painterly Abstraction
135
+ 101: Poster Art Realism
136
+ 102: Precisionism
137
+ 103: Primitivism
138
+ 104: Proto Renaissance
139
+ 105: Purism
140
+ 106: Rayonism
141
+ 107: Realism
142
+ 108: Regionalism
143
+ 109: Renaissance
144
+ 110: Rococo
145
+ 111: Romanesque
146
+ 112: Romanticism
147
+ 113: Safavid Period
148
+ 114: Shin-hanga
149
+ 115: Social Realism
150
+ 116: Socialist Realism
151
+ 117: Spatialism
152
+ 118: Spectralism
153
+ 119: Street art
154
+ 120: Suprematism
155
+ 121: Surrealism
156
+ 122: Symbolism
157
+ 123: Synchromism
158
+ 124: Synthetic Cubism
159
+ 125: Synthetism
160
+ 126: S艒saku hanga
161
+ 127: Tachisme
162
+ 128: Tenebrism
163
+ 129: Timurid Period
164
+ 130: Tonalism
165
+ 131: Transautomatism
166
+ 132: Tubism
167
+ 133: Ukiyo-e
168
+ 134: Verism
169
+ 135: Yamato-e
170
+ 136: Zen
171
+ ```
172
+
173
+ ---
174
+
175
+ ## **Run with Transformers 馃**
176
+
177
+ ```bash
178
+ pip install -q transformers torch pillow gradio
179
+ ```
180
+
181
+ ```python
182
+ import gradio as gr
183
+ from transformers import AutoImageProcessor, SiglipForImageClassification
184
+ from PIL import Image
185
+ import torch
186
+
187
+ # Load model and processor
188
+ model_name = "prithivMLmods/WikiArt-Style" # Replace with your model path
189
+ model = SiglipForImageClassification.from_pretrained(model_name)
190
+ processor = AutoImageProcessor.from_pretrained(model_name)
191
+
192
+ # Label mapping
193
+ id2label = {
194
+ 0: "Abstract Art", 1: "Abstract Expressionism", 2: "Academicism", 3: "Action painting",
195
+ 4: "American Realism", 5: "Analytical Cubism", 6: "Analytical聽Realism", 7: "Art Brut",
196
+ 8: "Art Deco", 9: "Art Informel", 10: "Art Nouveau (Modern)", 11: "Automatic Painting",
197
+ 12: "Baroque", 13: "Biedermeier", 14: "Byzantine", 15: "Cartographic Art", 16: "Classicism",
198
+ 17: "Cloisonnism", 18: "Color Field Painting", 19: "Conceptual Art", 20: "Concretism",
199
+ 21: "Constructivism", 22: "Contemporary Realism", 23: "Costumbrismo", 24: "Cubism",
200
+ 25: "Cubo-Expressionism", 26: "Cubo-Futurism", 27: "Dada", 28: "Divisionism",
201
+ 29: "Early Renaissance", 30: "Environmental (Land) Art", 31: "Existential Art",
202
+ 32: "Expressionism", 33: "Fantastic Realism", 34: "Fauvism", 35: "Feminist Art",
203
+ 36: "Figurative Expressionism", 37: "Futurism", 38: "Gongbi", 39: "Gothic",
204
+ 40: "Hard Edge Painting", 41: "High Renaissance", 42: "Hyper-Realism", 43: "Ilkhanid",
205
+ 44: "Impressionism", 45: "Indian Space painting", 46: "Ink and wash painting",
206
+ 47: "International Gothic", 48: "Intimism", 49: "Japonism", 50: "Joseon Dynasty",
207
+ 51: "Kinetic Art", 52: "Kitsch", 53: "Lettrism", 54: "Light and Space", 55: "Luminism",
208
+ 56: "Lyrical Abstraction", 57: "Magic Realism", 58: "Mail Art", 59: "Mannerism (Late Renaissance)",
209
+ 60: "Mechanistic Cubism", 61: "Metaphysical art", 62: "Minimalism", 63: "Miserablism",
210
+ 64: "Modernismo", 65: "Mosan art", 66: "Muralism", 67: "Nanga (Bunjinga)", 68: "Nas-Taliq",
211
+ 69: "Native Art", 70: "Naturalism", 71: "Na茂ve Art (Primitivism)", 72: "Neo-Byzantine",
212
+ 73: "Neo-Concretism", 74: "Neo-Dada", 75: "Neo-Expressionism", 76: "Neo-Figurative Art",
213
+ 77: "Neo-Rococo", 78: "Neo-Romanticism", 79: "Neo-baroque", 80: "Neoclassicism",
214
+ 81: "Neoplasticism", 82: "New Casualism", 83: "New European Painting", 84: "New Realism",
215
+ 85: "Nihonga", 86: "None", 87: "Northern Renaissance", 88: "Nouveau R茅alisme", 89: "Op Art",
216
+ 90: "Orientalism", 91: "Orphism", 92: "Ottoman Period", 93: "Outsider art", 94: "Perceptism ",
217
+ 95: "Photorealism", 96: "Pointillism", 97: "Pop Art", 98: "Post-Impressionism",
218
+ 99: "Post-Minimalism", 100: "Post-Painterly Abstraction", 101: "Poster Art Realism",
219
+ 102: "Precisionism", 103: "Primitivism", 104: "Proto Renaissance", 105: "Purism",
220
+ 106: "Rayonism", 107: "Realism", 108: "Regionalism", 109: "Renaissance", 110: "Rococo",
221
+ 111: "Romanesque", 112: "Romanticism", 113: "Safavid Period", 114: "Shin-hanga",
222
+ 115: "Social Realism", 116: "Socialist Realism", 117: "Spatialism", 118: "Spectralism",
223
+ 119: "Street art", 120: "Suprematism", 121: "Surrealism", 122: "Symbolism",
224
+ 123: "Synchromism", 124: "Synthetic Cubism", 125: "Synthetism", 126: "S艒saku hanga",
225
+ 127: "Tachisme", 128: "Tenebrism", 129: "Timurid Period", 130: "Tonalism",
226
+ 131: "Transautomatism", 132: "Tubism", 133: "Ukiyo-e", 134: "Verism", 135: "Yamato-e",
227
+ 136: "Zen"
228
+ }
229
+
230
+ def classify_style(image):
231
+ """Predicts the artistic style of the input artwork."""
232
+ image = Image.fromarray(image).convert("RGB")
233
+ inputs = processor(images=image, return_tensors="pt")
234
+ with torch.no_grad():
235
+ outputs = model(**inputs)
236
+ probs = torch.nn.functional.softmax(outputs.logits, dim=1).squeeze().tolist()
237
+ return {id2label[i]: round(probs[i], 3) for i in range(len(probs))}
238
+
239
+ # Gradio interface
240
+ iface = gr.Interface(
241
+ fn=classify_style,
242
+ inputs=gr.Image(type="numpy"),
243
+ outputs=gr.Label(label="Style Prediction Scores"),
244
+ title="WikiArt-Style",
245
+ description="Upload an art image to predict its painting style category (e.g., Impressionism, Cubism, Baroque, etc.)."
246
+ )
247
+
248
+ if __name__ == "__main__":
249
+ iface.launch()
250
+ ```
251
+
252
+ ---
253
+
254
+ # **Intended Use of WikiArt-Style**
255
+
256
+ **1. Style Classification in Machine Learning Models**
257
+ - Used as **labels** for training and evaluating models that classify artworks based on their artistic styles.
258
+ - Ideal for deep learning applications involving **convolutional neural networks (CNNs)** or **transformer-based vision models**.
259
+
260
+ **2. Style Transfer Applications**
261
+ - Acts as a **style reference** for neural style transfer algorithms (e.g., applying "Baroque" or "Cubism" to photos).
262
+ - Can guide users to select a target style from a curated list.
263
+
264
+ **3. Dataset Annotation**
265
+ - Used to **annotate** images in large datasets of paintings with consistent style names.
266
+ - Ensures compatibility with datasets like WikiArt, Kaggle鈥檚 Painter by Numbers, or custom curation.
267
+
268
+ **4. Educational and Exploratory Interfaces**
269
+ - Powers interfaces or apps for **exploring art history**, with filterable and searchable styles.
270
+ - Great for building **art recommender systems** or **virtual museums**.
271
+
272
+ **5. Generative Art Prompting**
273
+ - Assists in **text-to-image prompting** for generative models (e.g., Stable Diffusion, DALL路E) to specify desired styles.
274
+ - Example: "Generate a portrait in the style of Neo-Expressionism."
275
+
276
+ **6. Metadata Categorization in Art Databases**
277
+ - Useful for tagging and organizing artworks by style in digital archives or NFT marketplaces.