kth8/Llama-3.2-3B-Instruct-SuperGPQA-Classifier-GGUF

A fine-tune of unsloth/Llama-3.2-3B-Instruct on the m-a-p/SuperGPQA dataset.

Usage example

Set temperature as 0.0 for best results.

System prompt

You are a classifier. Categorize the following problem into discipline, field, and subfield in JSON format.

User prompt

Cotton and linen both readily catch fire. A batch of towels is composed of both cotton and linen, and is known to have caught fire. If it is known that the towels were ignited by a lit cigarette, which of the following arguments utilizes the most appropriate form of reasoning?

Assistant response

{"discipline": "Philosophy", "field": "Philosophy", "subfield": "Logic"}

Possible output options

Discipline

['Education', 'Sociology', 'Military Science', 'Philosophy', 'Science', 'Economics', 'Engineering', 'Medicine', 'History', 'Management', 'Law', 'Literature and Arts', 'Agronomy']

Field

['Petroleum and Natural Gas Engineering', 'Sociology', 'Philosophy', 'Systems Science', 'Mining Engineering', 'Biology', 'Forestry Engineering', 'History', 'Psychology', 'Atmospheric Science', 'Transportation Engineering', 'Basic Medicine', 'Agricultural Engineering', 'Nuclear Science and Technology', 'Hydraulic Engineering', 'Mathematics', 'Political Science', 'Theoretical Economics', 'Journalism and Communication', 'Naval Architecture and Ocean Engineering', 'Geology', 'Military Science', 'Musicology', 'Mechanical Engineering', 'Civil Engineering', 'Instrument Science and Technology', 'Environmental Science and Engineering', 'Physics', 'Stomatology', 'Crop Science', 'Physical Education', 'Business Administration', 'Food Science and Engineering', 'Control Science and Engineering', 'Mechanics', 'Geography', 'Public Administration', 'Education', 'Chemistry', 'Astronomy', 'Materials Science and Engineering', 'Physical Oceanography', 'Optical Engineering', 'Textile Science and Engineering', 'Oceanography', 'Public Health and Preventive Medicine', 'Clinical Medicine', 'Applied Economics', 'Metallurgical Engineering', 'Language and Literature', 'Architecture', 'Library, Information and Archival Management', 'Forestry', 'Art Studies', 'Power Engineering and Engineering Thermophysics', 'Aeronautical and Astronautical Science and Technology', 'Geological Resources and Geological Engineering', 'Information and Communication Engineering', 'Chemical Engineering and Technology', 'Traditional Chinese Medicine', 'Weapon Science and Technology', 'Animal Husbandry', 'Aquaculture', 'Management Science and Engineering', 'Pharmacy', 'Computer Science and Technology', 'Surveying and Mapping Science and Technology', 'Electrical Engineering', 'Law', 'Veterinary Medicine', 'Geophysics', 'Electronic Science and Technology']

Subfield

['Cell Biology', 'Mathematical Analysis', 'Nutrition and Food Hygiene', 'Cryptography', 'Urban Planning and Design', 'Textile Chemistry and Dyeing Engineering', 'Psychology', 'Economic History', 'Pharmaceutical Analysis', 'High Voltage and Insulation Technology', 'Relativity', 'Ethics', 'Computer Architecture', 'Fluid Flow and Heat Transfer in Chemical Engineering', 'Landscape Plants and Ornamental Horticulture', 'Semiconductor Physics', 'Traditional Chinese Medicine Theory', 'Polynomials and Series Expansions', 'Thermodynamics', 'Power Systems and Automation', 'Marine Biology', 'Instrument Science and Technology', 'Crop Science', 'Linguistics and Applied Linguistics', 'Animal Nutrition and Feed Science', 'Pediatrics', 'Rigid Body Mechanics', 'International Trade', 'Forensic Medicine', 'Quantitative Economics', 'Quantum Mechanics', 'Statistical Mechanics', 'Transportation Planning and Management', 'Thermodynamics and Statistical Physics', 'Educational Technology and Principles', 'Cosmology', 'Hydraulics and Hydrology', 'Principles of Computer Organization', 'National and Defense Economics', 'Fuzzy Mathematics', 'Pathology and Pathophysiology', 'Engineering Thermophysics', 'Optical Fiber Communication', 'Polymer Chemistry and Physics', 'Pathogen Biology', 'Human Geography', 'Functions of Complex Variables', 'Military Command and Information Systems', 'Internal Combustion Engineering', 'Geological Resources and Geological Engineering', 'Land Resource Management and Administrative Management', 'Underwater Acoustics', 'Tourism Management and Technological Economics Management', 'Electrodynamics', 'Solid Mechanics', 'Computer Networks', 'Management Science and Engineering', 'Russian Language and Literature', 'Guidance, Navigation and Control', 'Agricultural Environment and Soil-Water Engineering', 'Public Finance', 'Road and Railway Engineering', 'Imaging and Nuclear Medicine', 'Veterinary Medicine', 'World History', 'Pattern Recognition', 'Meteorology', 'Solid Earth Geophysics', 'Social and Folklore Studies', 'Principles of Seismic Exploration', 'Cartography and Geographic Information Engineering', 'History and Theory of Journalism and Media Management', 'Mineral Processing Engineering', 'Environmental and Resource Protection', 'Mining and Safety Engineering', 'Modern and Contemporary Chinese Literature', 'Music History, Education, and Technology', 'Sports Science and Medicine', 'Space physics', 'Manufacturing Automation', 'Clinical Laboratory Diagnostics', 'Communication Principles', 'Radiation Medicine', 'Theory of Curriculum and Instruction', 'Digital Surveying and Remote Sensing Applications', 'Agricultural Mechanization Engineering', 'Microbiology', 'Communication and Broadcasting', 'Political Science', 'Obstetrics and Gynecology', 'Musical Forms and Analysis', 'Inorganic Chemistry', 'Computational Mathematics', 'Organic Chemistry', 'Communication and Information Systems', 'Laser Technology', 'Dance Studies', 'Signal and Information Processing', 'Zoology', 'Demography and Anthropology', 'Special Education', 'Surgery', 'Elements of Chemical Reaction Engineering', 'Poromechanics and Reservoir Physics', 'Internal Medicine', 'Dynamic Meteorology', 'Emergency Medicine', 'Probability and Statistics', 'Physical Oceanography', 'Non-ferrous Metallurgy', 'Clinical Stomatology', 'Drama and Opera Studies', 'Power Electronics and Electrical Drives', 'Contract Law', 'Microelectronics and Solid-State Electronics', 'Fine Arts', 'Pitch and Scales', 'Social Medicine and Health Management', 'Aeronautical and Astronautical Science and Technology', 'Theoretical Optics', 'Education Economics, Management and Social Security', 'Acoustics', 'Anesthesiology', 'Engineering Fluid Mechanics', 'Electromagnetic Field and Microwave Technology', 'Radiation Protection and Nuclear Technology Applications', 'Pharmacology', 'Dermatology and Venereology', 'Industrial Economics', 'Numerical Analysis', 'Particle and Nuclear Physics', 'Geotechnical Engineering', 'Antenna and Radio Communication', 'Library and Archival Science', 'Maternal, Child and Adolescent Health', 'Oil and Gas Field Development and Storage & Transportation Engineering', 'Weapon Systems Science and Engineering', 'Legal Theory and Legal History', 'Architectural History', 'Military Logistics and Equipment', 'Sports Humanities and Sociology', 'Ophthalmology', 'Electrochemistry', 'Environmental Engineering', 'Harmony', 'Food Biochemistry', 'Functions of Real Variables', 'Archaeology and Museology', 'Broadcasting and Television Art', 'Analytical Chemistry', 'Stochastic Processes', 'Solar System Science', 'Heat Transfer', 'Polymer Physics', 'Marine Chemistry', 'Vehicle Operation Engineering', 'Discrete Mathematics', 'Nuclear Energy and Reactor Technology', 'Religious Studies', 'Military Thought and History', 'Epidemiology and Health Statistics', 'Logic', 'Historical Geography', 'Geodesy and Surveying Engineering', 'Economic Statistics', 'Textile Materials Science', 'Number Theory', 'Mechatronic Engineering', 'Law and Social Governance', 'Finance', 'Civil and Commercial Law', 'Bridge and Tunnel Engineering', 'Ecology', 'Materials Physics and Chemistry', 'Pharmaceutics', 'Business and Accounting Management', 'Botany', 'Journalism and News Practice', 'Theoretical Mechanics', 'Philosophy of Science and Technology', 'Physical Geography', 'Preschool Education', 'Literary Theory', 'Environmental Science', 'Geriatric Medicine', 'Chemical Transport Engineering', 'Military Management', 'Military Law', 'Military Chemistry and Pyrotechnics', 'Fundamentals of Dynamics and Control', 'Hydrogeology', 'Theoretical Fluid Mechanics', 'Labor Economics', 'Western Economics', 'Design Arts', 'Criminal Law', 'Physical Chemistry of Metallurgical Process', 'Composition', 'Animal Rearing and Breeding', 'Biochemistry and Molecular Biology', 'Ordinary Differential Equations', 'Philosophical Aesthetics', 'Aquaculture', 'French Language and Literature', 'Databases', 'Electrical Theory and New Technologies', 'Subatomic and Atomic Physics', 'Procedural Law', 'Film Studies', 'Traditional Chinese Pharmacy', 'Basic Stomatology', 'Structural Geology', 'Forest Engineering', 'Food Processing and Storage Engineering', 'Political Economy', 'Fluid Machinery and Engineering', 'Philology and Bibliography', 'Radiochemistry', 'Astrophysics', 'Stellar and Interstellar Evolution', 'Classical Chinese Literature', 'Structural Engineering', 'Atomic and Molecular Physics', 'Physiology', 'Ship Mechanics and Design Principles', 'Systems Science', 'Fundamental Mathematics', 'Water conservancy and Hydropower Engineering', 'Traffic Information Engineering and Control', 'Refrigeration and Cryogenic Engineering', 'Medicinal Chemistry', 'Thermal Energy Engineering', 'Genetics', 'Geochemistry', 'Otorhinolaryngology', 'Materials Processing Engineering', 'Applied Optics', 'Information Management and Communication', 'Circuits and Systems', 'Immunology', 'Nursing and Rehabilitation Medicine', 'Computer Software and Theory', 'Traditional Chinese Health Preservation', 'Literary History', 'Group Theory', 'Atmospheric Physics and Atmospheric Environment', 'Physical Education and Training', 'Oncology', 'Health Toxicology and Environmental Health', 'Principles of Metallurgy', 'Urban Infrastructure Engineering', 'Data Structures', 'Advanced Algebra', 'Operating Systems', 'Microbiology and Biochemical Pharmacy', 'Mineralogy, Petrology, and Economic Geology', 'Biophysics', 'Instrumentation and Performance', 'Astronomical Observation and Technology', 'Iron and Steel Metallurgy', 'Solid State Physics', 'Neurology', 'Architectural Design and Theory', 'Marine Engineering', 'Control Theory and Control Engineering', 'International Law', 'Graph Theory', 'Optoelectronic Technology', 'Information Management Science', 'Constitutional and Administrative Law', 'Fluid Physics', 'Physical Chemistry', 'Human Anatomy and Histology-Embryology', 'Formal Languages', 'Special Number Theory', 'Power Machinery and Engineering', 'Operations Research and Cybernetics', 'Advanced Programming Languages', 'Mass Transport and Separation Process in Chemical Engineering', 'Wood Science and Technology', 'Forest Cultivation and Genetic Breeding', 'Combinatorial Mathematics', 'Geometry and Topology', 'Psychiatry and Mental Health', 'Paleontology and Stratigraphy']

Model Details

• Base Model: unsloth/Llama-3.2-3B-Instruct
• Parameter Count: 3,212,749,824
• Precision: torch.bfloat16

Hardware

• GPU: NVIDIA RTX PRO 6000 Blackwell Server Edition
• Announced: Mar 17th, 2025
• Release Date: Mar 18th, 2025
• Memory Type: GDDR7
• Bandwidth: 1.79 TB/s
• Memory Size: 96 GB
• Memory Bus: 512 bit
• Shading Units: 24064
• TDP: 600W

Training Settings

PEFT

• Rank: 32
• LoRA alpha: 64
• Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
• Gradient checkpointing: unsloth

SFT

• Epoch: 2
• Batch size: 32
• Gradient Accumulation steps: 1
• Warmup ratio: 0.05
• Learning rate: 0.0004
• Optimizer: adamw_torch_fused
• Learning rate scheduler: cosine

Training stats

• Date: 2026-03-23T12:40:05.923113
• Peak VRAM usage: 22.326 GB
• Global step: 1576
• Training runtime (seconds): 1445.8933
• Average training loss: 0.06828827715389015
• Final validation loss: 0.05034850910305977

Framework versions

• Unsloth: 2026.3.10
• TRL: 0.22.2
• Transformers: 4.56.2
• Pytorch: 2.10.0+cu128
• Datasets: 4.8.3
• Tokenizers: 0.22.2

License

This model is released under the Llama3 license. See the Terms of Use for details.