File size: 22,363 Bytes
aa35e5f 80958dc 1bd5b7d aa35e5f 1bd5b7d 80958dc aa35e5f 1bd5b7d aa35e5f 8d9af89 aa35e5f 80958dc |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 |
---
license: apache-2.0
datasets:
- Artificio/WikiArt
library_name: transformers
language:
- en
base_model:
- google/siglip2-base-patch16-224
pipeline_tag: image-classification
tags:
- WikiArt
- Style
- art
- SigLIP2
---
# **WikiArt-Style**
> **WikiArt-Style** is a vision model fine-tuned from **google/siglip2-base-patch16-224** using the **SiglipForImageClassification** architecture. It classifies art images into one of 137 painting style categories.
```
Classification Report:
precision recall f1-score support
Abstract Art 0.2784 0.3228 0.2990 979
Abstract Expressionism 0.3615 0.5757 0.4441 2074
Academicism 0.4410 0.0730 0.1253 972
Action painting 0.0000 0.0000 0.0000 98
American Realism 0.9592 0.1697 0.2883 277
Analytical Cubism 0.2000 0.0115 0.0217 87
Analytical Realism 0.6667 0.0225 0.0435 89
Art Brut 0.0000 0.0000 0.0000 198
Art Deco 0.6178 0.6801 0.6475 644
Art Informel 0.3295 0.2486 0.2834 1267
Art Nouveau (Modern) 0.5183 0.6289 0.5682 4899
Automatic Painting 0.0000 0.0000 0.0000 37
Baroque 0.5312 0.6495 0.5845 4400
Biedermeier 0.0000 0.0000 0.0000 132
Byzantine 0.0000 0.0000 0.0000 77
Cartographic Art 0.0000 0.0000 0.0000 10
Classicism 0.0000 0.0000 0.0000 223
Cloisonnism 0.0000 0.0000 0.0000 172
Color Field Painting 0.6947 0.5352 0.6046 910
Conceptual Art 0.6667 0.0161 0.0315 124
Concretism 0.3973 0.4596 0.4262 581
Constructivism 0.3462 0.3022 0.3227 268
Contemporary Realism 1.0000 0.0518 0.0985 309
Costumbrismo 0.0000 0.0000 0.0000 19
Cubism 0.3426 0.6926 0.4584 1747
Cubo-Expressionism 0.0000 0.0000 0.0000 22
Cubo-Futurism 0.0000 0.0000 0.0000 137
Dada 0.5000 0.0098 0.0191 205
Divisionism 0.6810 0.2337 0.3480 338
Early Renaissance 0.5411 0.6329 0.5834 1351
Environmental (Land) Art 0.0000 0.0000 0.0000 1
Existential Art 0.0000 0.0000 0.0000 17
Expressionism 0.4540 0.5701 0.5055 7013
Fantastic Realism 0.0000 0.0000 0.0000 31
Fauvism 0.4480 0.1710 0.2475 731
Feminist Art 0.0000 0.0000 0.0000 18
Figurative Expressionism 0.0000 0.0000 0.0000 19
Futurism 0.4717 0.0859 0.1453 291
Gongbi 0.0000 0.0000 0.0000 38
Gothic 0.0000 0.0000 0.0000 12
Hard Edge Painting 0.4458 0.3978 0.4205 372
High Renaissance 0.5016 0.3653 0.4227 1314
Hyper-Realism 0.0000 0.0000 0.0000 49
Ilkhanid 0.0000 0.0000 0.0000 2
Impressionism 0.6057 0.7266 0.6607 10643
Indian Space painting 0.0000 0.0000 0.0000 25
Ink and wash painting 0.7739 0.4459 0.5658 545
International Gothic 0.8099 0.5349 0.6443 215
Intimism 0.0000 0.0000 0.0000 109
Japonism 0.0000 0.0000 0.0000 118
Joseon Dynasty 0.0000 0.0000 0.0000 10
Kinetic Art 0.0000 0.0000 0.0000 3
Kitsch 0.0000 0.0000 0.0000 47
Lettrism 0.0000 0.0000 0.0000 33
Light and Space 0.0000 0.0000 0.0000 11
Luminism 0.8333 0.0519 0.0978 385
Lyrical Abstraction 0.4631 0.2060 0.2851 670
Magic Realism 0.5883 0.5020 0.5417 1002
Mail Art 0.0000 0.0000 0.0000 10
Mannerism (Late Renaissance) 0.4875 0.3934 0.4355 1342
Mechanistic Cubism 0.0000 0.0000 0.0000 69
Metaphysical art 0.5385 0.0729 0.1284 192
Minimalism 0.5352 0.5957 0.5638 460
Miserablism 0.0000 0.0000 0.0000 8
Modernismo 0.0000 0.0000 0.0000 43
Mosan art 0.0000 0.0000 0.0000 39
Muralism 0.3636 0.0268 0.0500 149
Nanga (Bunjinga) 0.0000 0.0000 0.0000 58
Nas-Taliq 0.0000 0.0000 0.0000 9
Native Art 0.0000 0.0000 0.0000 21
Naturalism 0.8459 0.6437 0.7311 435
Naïve Art (Primitivism) 0.4897 0.5412 0.5142 2295
Neo-Byzantine 0.0000 0.0000 0.0000 18
Neo-Concretism 0.0000 0.0000 0.0000 44
Neo-Dada 0.0000 0.0000 0.0000 131
Neo-Expressionism 0.6763 0.2238 0.3363 420
Neo-Figurative Art 0.0000 0.0000 0.0000 27
Neo-Rococo 0.0000 0.0000 0.0000 97
Neo-Romanticism 0.6762 0.1254 0.2116 566
Neo-baroque 0.0000 0.0000 0.0000 105
Neoclassicism 0.5868 0.3317 0.4238 2038
Neoplasticism 0.8889 0.2775 0.4229 173
New Casualism 0.0000 0.0000 0.0000 22
New European Painting 0.0000 0.0000 0.0000 25
New Realism 0.0000 0.0000 0.0000 329
Nihonga 0.0000 0.0000 0.0000 29
None 0.3056 0.0112 0.0215 986
Northern Renaissance 0.6198 0.6448 0.6321 2379
Nouveau Réalisme 0.0000 0.0000 0.0000 142
Op Art 0.5120 0.7292 0.6016 528
Orientalism 0.0000 0.0000 0.0000 392
Orphism 0.6471 0.0444 0.0830 248
Ottoman Period 0.8571 0.0833 0.1519 72
Outsider art 0.0000 0.0000 0.0000 68
Perceptism 0.0000 0.0000 0.0000 6
Photorealism 0.0000 0.0000 0.0000 61
Pointillism 0.6450 0.6347 0.6398 501
Pop Art 0.5580 0.4501 0.4983 791
Post-Impressionism 0.4611 0.4200 0.4396 5778
Post-Minimalism 0.0000 0.0000 0.0000 31
Post-Painterly Abstraction 0.6250 0.0296 0.0565 169
Poster Art Realism 0.0000 0.0000 0.0000 43
Precisionism 0.7258 0.3169 0.4412 284
Primitivism 0.0000 0.0000 0.0000 36
Proto Renaissance 0.4342 0.3626 0.3952 273
Purism 0.5000 0.1635 0.2464 159
Rayonism 0.0000 0.0000 0.0000 6
Realism 0.4909 0.6939 0.5750 10523
Regionalism 0.7500 0.1776 0.2872 321
Renaissance 0.0000 0.0000 0.0000 1
Rococo 0.4975 0.5913 0.5404 2733
Romanesque 0.0000 0.0000 0.0000 55
Romanticism 0.5182 0.5380 0.5279 9285
Safavid Period 0.0000 0.0000 0.0000 39
Shin-hanga 0.6894 0.7184 0.7036 380
Social Realism 0.0000 0.0000 0.0000 305
Socialist Realism 0.0000 0.0000 0.0000 95
Spatialism 0.0000 0.0000 0.0000 83
Spectralism 0.0000 0.0000 0.0000 5
Street art 0.0000 0.0000 0.0000 23
Suprematism 0.0000 0.0000 0.0000 80
Surrealism 0.5011 0.6151 0.5523 4167
Symbolism 0.4398 0.3087 0.3627 3476
Synchromism 0.0000 0.0000 0.0000 10
Synthetic Cubism 0.6914 0.2995 0.4179 187
Synthetism 0.0000 0.0000 0.0000 49
Sōsaku hanga 0.5753 0.2900 0.3856 369
Tachisme 0.4366 0.1422 0.2145 436
Tenebrism 0.0000 0.0000 0.0000 221
Timurid Period 0.0000 0.0000 0.0000 17
Tonalism 0.0000 0.0000 0.0000 202
Transautomatism 0.0000 0.0000 0.0000 74
Tubism 0.0000 0.0000 0.0000 21
Ukiyo-e 0.7822 0.8612 0.8198 1426
Verism 0.0000 0.0000 0.0000 84
Yamato-e 0.0000 0.0000 0.0000 12
Zen 0.6702 0.6702 0.6702 94
accuracy 0.5108 103250
macro avg 0.2664 0.1708 0.1811 103250
weighted avg 0.4956 0.5108 0.4822 103250
```
```py
from datasets import load_dataset
# Load the dataset
dataset = load_dataset("Artificio/WikiArt")
# Extract unique masterCategory values (assuming it's a string field)
labels = sorted(set(example["style"] for example in dataset["train"]))
# Create id2label mapping
id2label = {str(i): label for i, label in enumerate(labels)}
# Print the mapping
print(id2label)
```
{'0': 'Abstract Art', '1': 'Abstract Expressionism', '2': 'Academicism', '3': 'Action painting', '4': 'American Realism', '5': 'Analytical Cubism', '6': 'Analytical\xa0Realism', '7': 'Art Brut', '8': 'Art Deco', '9': 'Art Informel', '10': 'Art Nouveau (Modern)', '11': 'Automatic Painting', '12': 'Baroque', '13': 'Biedermeier', '14': 'Byzantine', '15': 'Cartographic Art', '16': 'Classicism', '17': 'Cloisonnism', '18': 'Color Field Painting', '19': 'Conceptual Art', '20': 'Concretism', '21': 'Constructivism', '22': 'Contemporary Realism', '23': 'Costumbrismo', '24': 'Cubism', '25': 'Cubo-Expressionism', '26': 'Cubo-Futurism', '27': 'Dada', '28': 'Divisionism', '29': 'Early Renaissance', '30': 'Environmental (Land) Art', '31': 'Existential Art', '32': 'Expressionism', '33': 'Fantastic Realism', '34': 'Fauvism', '35': 'Feminist Art', '36': 'Figurative Expressionism', '37': 'Futurism', '38': 'Gongbi', '39': 'Gothic', '40': 'Hard Edge Painting', '41': 'High Renaissance', '42': 'Hyper-Realism', '43': 'Ilkhanid', '44': 'Impressionism', '45': 'Indian Space painting', '46': 'Ink and wash painting', '47': 'International Gothic', '48': 'Intimism', '49': 'Japonism', '50': 'Joseon Dynasty', '51': 'Kinetic Art', '52': 'Kitsch', '53': 'Lettrism', '54': 'Light and Space', '55': 'Luminism', '56': 'Lyrical Abstraction', '57': 'Magic Realism', '58': 'Mail Art', '59': 'Mannerism (Late Renaissance)', '60': 'Mechanistic Cubism', '61': 'Metaphysical art', '62': 'Minimalism', '63': 'Miserablism', '64': 'Modernismo', '65': 'Mosan art', '66': 'Muralism', '67': 'Nanga (Bunjinga)', '68': 'Nas-Taliq', '69': 'Native Art', '70': 'Naturalism', '71': 'Naïve Art (Primitivism)', '72': 'Neo-Byzantine', '73': 'Neo-Concretism', '74': 'Neo-Dada', '75': 'Neo-Expressionism', '76': 'Neo-Figurative Art', '77': 'Neo-Rococo', '78': 'Neo-Romanticism', '79': 'Neo-baroque', '80': 'Neoclassicism', '81': 'Neoplasticism', '82': 'New Casualism', '83': 'New European Painting', '84': 'New Realism', '85': 'Nihonga', '86': 'None', '87': 'Northern Renaissance', '88': 'Nouveau Réalisme', '89': 'Op Art', '90': 'Orientalism', '91': 'Orphism', '92': 'Ottoman Period', '93': 'Outsider art', '94': 'Perceptism ', '95': 'Photorealism', '96': 'Pointillism', '97': 'Pop Art', '98': 'Post-Impressionism', '99': 'Post-Minimalism', '100': 'Post-Painterly Abstraction', '101': 'Poster Art Realism', '102': 'Precisionism', '103': 'Primitivism', '104': 'Proto Renaissance', '105': 'Purism', '106': 'Rayonism', '107': 'Realism', '108': 'Regionalism', '109': 'Renaissance', '110': 'Rococo', '111': 'Romanesque', '112': 'Romanticism', '113': 'Safavid Period', '114': 'Shin-hanga', '115': 'Social Realism', '116': 'Socialist Realism', '117': 'Spatialism', '118': 'Spectralism', '119': 'Street art', '120': 'Suprematism', '121': 'Surrealism', '122': 'Symbolism', '123': 'Synchromism', '124': 'Synthetic Cubism', '125': 'Synthetism', '126': 'Sōsaku hanga', '127': 'Tachisme', '128': 'Tenebrism', '129': 'Timurid Period', '130': 'Tonalism', '131': 'Transautomatism', '132': 'Tubism', '133': 'Ukiyo-e', '134': 'Verism', '135': 'Yamato-e', '136': 'Zen'}
The model predicts one of the following painting **style** categories:
```
0: Abstract Art
1: Abstract Expressionism
2: Academicism
3: Action painting
4: American Realism
5: Analytical Cubism
6: Analytical Realism
7: Art Brut
8: Art Deco
9: Art Informel
10: Art Nouveau (Modern)
11: Automatic Painting
12: Baroque
13: Biedermeier
14: Byzantine
15: Cartographic Art
16: Classicism
17: Cloisonnism
18: Color Field Painting
19: Conceptual Art
20: Concretism
21: Constructivism
22: Contemporary Realism
23: Costumbrismo
24: Cubism
25: Cubo-Expressionism
26: Cubo-Futurism
27: Dada
28: Divisionism
29: Early Renaissance
30: Environmental (Land) Art
31: Existential Art
32: Expressionism
33: Fantastic Realism
34: Fauvism
35: Feminist Art
36: Figurative Expressionism
37: Futurism
38: Gongbi
39: Gothic
40: Hard Edge Painting
41: High Renaissance
42: Hyper-Realism
43: Ilkhanid
44: Impressionism
45: Indian Space painting
46: Ink and wash painting
47: International Gothic
48: Intimism
49: Japonism
50: Joseon Dynasty
51: Kinetic Art
52: Kitsch
53: Lettrism
54: Light and Space
55: Luminism
56: Lyrical Abstraction
57: Magic Realism
58: Mail Art
59: Mannerism (Late Renaissance)
60: Mechanistic Cubism
61: Metaphysical art
62: Minimalism
63: Miserablism
64: Modernismo
65: Mosan art
66: Muralism
67: Nanga (Bunjinga)
68: Nas-Taliq
69: Native Art
70: Naturalism
71: Naïve Art (Primitivism)
72: Neo-Byzantine
73: Neo-Concretism
74: Neo-Dada
75: Neo-Expressionism
76: Neo-Figurative Art
77: Neo-Rococo
78: Neo-Romanticism
79: Neo-baroque
80: Neoclassicism
81: Neoplasticism
82: New Casualism
83: New European Painting
84: New Realism
85: Nihonga
86: None
87: Northern Renaissance
88: Nouveau Réalisme
89: Op Art
90: Orientalism
91: Orphism
92: Ottoman Period
93: Outsider art
94: Perceptism
95: Photorealism
96: Pointillism
97: Pop Art
98: Post-Impressionism
99: Post-Minimalism
100: Post-Painterly Abstraction
101: Poster Art Realism
102: Precisionism
103: Primitivism
104: Proto Renaissance
105: Purism
106: Rayonism
107: Realism
108: Regionalism
109: Renaissance
110: Rococo
111: Romanesque
112: Romanticism
113: Safavid Period
114: Shin-hanga
115: Social Realism
116: Socialist Realism
117: Spatialism
118: Spectralism
119: Street art
120: Suprematism
121: Surrealism
122: Symbolism
123: Synchromism
124: Synthetic Cubism
125: Synthetism
126: Sōsaku hanga
127: Tachisme
128: Tenebrism
129: Timurid Period
130: Tonalism
131: Transautomatism
132: Tubism
133: Ukiyo-e
134: Verism
135: Yamato-e
136: Zen
```
---
## **Run with Transformers 🤗**
```bash
pip install -q transformers torch pillow gradio
```
```python
import gradio as gr
from transformers import AutoImageProcessor, SiglipForImageClassification
from PIL import Image
import torch
# Load model and processor
model_name = "prithivMLmods/WikiArt-Style" # Replace with your model path
model = SiglipForImageClassification.from_pretrained(model_name)
processor = AutoImageProcessor.from_pretrained(model_name)
# Label mapping
id2label = {
0: "Abstract Art", 1: "Abstract Expressionism", 2: "Academicism", 3: "Action painting",
4: "American Realism", 5: "Analytical Cubism", 6: "Analytical Realism", 7: "Art Brut",
8: "Art Deco", 9: "Art Informel", 10: "Art Nouveau (Modern)", 11: "Automatic Painting",
12: "Baroque", 13: "Biedermeier", 14: "Byzantine", 15: "Cartographic Art", 16: "Classicism",
17: "Cloisonnism", 18: "Color Field Painting", 19: "Conceptual Art", 20: "Concretism",
21: "Constructivism", 22: "Contemporary Realism", 23: "Costumbrismo", 24: "Cubism",
25: "Cubo-Expressionism", 26: "Cubo-Futurism", 27: "Dada", 28: "Divisionism",
29: "Early Renaissance", 30: "Environmental (Land) Art", 31: "Existential Art",
32: "Expressionism", 33: "Fantastic Realism", 34: "Fauvism", 35: "Feminist Art",
36: "Figurative Expressionism", 37: "Futurism", 38: "Gongbi", 39: "Gothic",
40: "Hard Edge Painting", 41: "High Renaissance", 42: "Hyper-Realism", 43: "Ilkhanid",
44: "Impressionism", 45: "Indian Space painting", 46: "Ink and wash painting",
47: "International Gothic", 48: "Intimism", 49: "Japonism", 50: "Joseon Dynasty",
51: "Kinetic Art", 52: "Kitsch", 53: "Lettrism", 54: "Light and Space", 55: "Luminism",
56: "Lyrical Abstraction", 57: "Magic Realism", 58: "Mail Art", 59: "Mannerism (Late Renaissance)",
60: "Mechanistic Cubism", 61: "Metaphysical art", 62: "Minimalism", 63: "Miserablism",
64: "Modernismo", 65: "Mosan art", 66: "Muralism", 67: "Nanga (Bunjinga)", 68: "Nas-Taliq",
69: "Native Art", 70: "Naturalism", 71: "Naïve Art (Primitivism)", 72: "Neo-Byzantine",
73: "Neo-Concretism", 74: "Neo-Dada", 75: "Neo-Expressionism", 76: "Neo-Figurative Art",
77: "Neo-Rococo", 78: "Neo-Romanticism", 79: "Neo-baroque", 80: "Neoclassicism",
81: "Neoplasticism", 82: "New Casualism", 83: "New European Painting", 84: "New Realism",
85: "Nihonga", 86: "None", 87: "Northern Renaissance", 88: "Nouveau Réalisme", 89: "Op Art",
90: "Orientalism", 91: "Orphism", 92: "Ottoman Period", 93: "Outsider art", 94: "Perceptism ",
95: "Photorealism", 96: "Pointillism", 97: "Pop Art", 98: "Post-Impressionism",
99: "Post-Minimalism", 100: "Post-Painterly Abstraction", 101: "Poster Art Realism",
102: "Precisionism", 103: "Primitivism", 104: "Proto Renaissance", 105: "Purism",
106: "Rayonism", 107: "Realism", 108: "Regionalism", 109: "Renaissance", 110: "Rococo",
111: "Romanesque", 112: "Romanticism", 113: "Safavid Period", 114: "Shin-hanga",
115: "Social Realism", 116: "Socialist Realism", 117: "Spatialism", 118: "Spectralism",
119: "Street art", 120: "Suprematism", 121: "Surrealism", 122: "Symbolism",
123: "Synchromism", 124: "Synthetic Cubism", 125: "Synthetism", 126: "Sōsaku hanga",
127: "Tachisme", 128: "Tenebrism", 129: "Timurid Period", 130: "Tonalism",
131: "Transautomatism", 132: "Tubism", 133: "Ukiyo-e", 134: "Verism", 135: "Yamato-e",
136: "Zen"
}
def classify_style(image):
"""Predicts the artistic style of the input artwork."""
image = Image.fromarray(image).convert("RGB")
inputs = processor(images=image, return_tensors="pt")
with torch.no_grad():
outputs = model(**inputs)
probs = torch.nn.functional.softmax(outputs.logits, dim=1).squeeze().tolist()
return {id2label[i]: round(probs[i], 3) for i in range(len(probs))}
# Gradio interface
iface = gr.Interface(
fn=classify_style,
inputs=gr.Image(type="numpy"),
outputs=gr.Label(label="Style Prediction Scores"),
title="WikiArt-Style",
description="Upload an art image to predict its painting style category (e.g., Impressionism, Cubism, Baroque, etc.)."
)
if __name__ == "__main__":
iface.launch()
```
---
# **Intended Use of WikiArt-Style**
**1. Style Classification in Machine Learning Models**
- Used as **labels** for training and evaluating models that classify artworks based on their artistic styles.
- Ideal for deep learning applications involving **convolutional neural networks (CNNs)** or **transformer-based vision models**.
**2. Style Transfer Applications**
- Acts as a **style reference** for neural style transfer algorithms (e.g., applying "Baroque" or "Cubism" to photos).
- Can guide users to select a target style from a curated list.
**3. Dataset Annotation**
- Used to **annotate** images in large datasets of paintings with consistent style names.
- Ensures compatibility with datasets like WikiArt, Kaggle’s Painter by Numbers, or custom curation.
**4. Educational and Exploratory Interfaces**
- Powers interfaces or apps for **exploring art history**, with filterable and searchable styles.
- Great for building **art recommender systems** or **virtual museums**.
**5. Generative Art Prompting**
- Assists in **text-to-image prompting** for generative models (e.g., Stable Diffusion, DALL·E) to specify desired styles.
- Example: "Generate a portrait in the style of Neo-Expressionism."
**6. Metadata Categorization in Art Databases**
- Useful for tagging and organizing artworks by style in digital archives or NFT marketplaces. |