A fine-tune of unsloth/Llama-3.2-3B-Instruct on the m-a-p/SuperGPQA dataset.

Usage example

System prompt

Classify the provided problem into discipline, field, and subfield in JSON format.

User prompt

Cotton and linen both readily catch fire. A batch of towels is composed of both cotton and linen, and is known to have caught fire. If it is known that the towels were ignited by a lit cigarette, which of the following arguments utilizes the most appropriate form of reasoning?

Possible output options

Discipline

['Economics', 'Engineering', 'Military Science', 'History', 'Science', 'Agronomy', 'Medicine', 'Literature and Arts', 'Management', 'Sociology', 'Education', 'Law', 'Philosophy']

Field

['Surveying and Mapping Science and Technology', 'Electronic Science and Technology', 'Architecture', 'Geological Resources and Geological Engineering', 'Physics', 'Control Science and Engineering', 'Musicology', 'Sociology', 'Chemistry', 'Transportation Engineering', 'Environmental Science and Engineering', 'Physical Education', 'Public Administration', 'Textile Science and Engineering', 'Weapon Science and Technology', 'Psychology', 'Military Science', 'Forestry', 'Physical Oceanography', 'Basic Medicine', 'Materials Science and Engineering', 'Systems Science', 'Nuclear Science and Technology', 'Applied Economics', 'Pharmacy', 'Mathematics', 'Theoretical Economics', 'Business Administration', 'Electrical Engineering', 'Chemical Engineering and Technology', 'Hydraulic Engineering', 'Aquaculture', 'Astronomy', 'Animal Husbandry', 'Philosophy', 'Atmospheric Science', 'Library, Information and Archival Management', 'Mining Engineering', 'Traditional Chinese Medicine', 'Power Engineering and Engineering Thermophysics', 'Stomatology', 'Information and Communication Engineering', 'Metallurgical Engineering', 'Art Studies', 'Agricultural Engineering', 'Optical Engineering', 'Oceanography', 'Mechanics', 'Computer Science and Technology', 'Education', 'Political Science', 'Management Science and Engineering', 'Geophysics', 'Forestry Engineering', 'Aeronautical and Astronautical Science and Technology', 'Geography', 'Language and Literature', 'Journalism and Communication', 'Veterinary Medicine', 'Biology', 'History', 'Public Health and Preventive Medicine', 'Naval Architecture and Ocean Engineering', 'Mechanical Engineering', 'Civil Engineering', 'Crop Science', 'Instrument Science and Technology', 'Clinical Medicine', 'Food Science and Engineering', 'Law', 'Geology', 'Petroleum and Natural Gas Engineering']

Subfield

['Fine Arts', 'Constitutional and Administrative Law', 'Internal Combustion Engineering', 'Communication Principles', 'Military Chemistry and Pyrotechnics', 'Wood Science and Technology', 'Particle and Nuclear Physics', 'Mineral Processing Engineering', 'Materials Physics and Chemistry', 'Textile Chemistry and Dyeing Engineering', 'Forest Engineering', 'Preschool Education', 'Traditional Chinese Medicine Theory', 'Pattern Recognition', 'Cartography and Geographic Information Engineering', 'Nuclear Energy and Reactor Technology', 'Animal Nutrition and Feed Science', 'Chemical Transport Engineering', 'Epidemiology and Health Statistics', 'Instrumentation and Performance', 'Historical Geography', 'Forensic Medicine', 'Cosmology', 'Musical Forms and Analysis', 'Military Management', 'Literary Theory', 'Discrete Mathematics', 'Engineering Fluid Mechanics', 'Signal and Information Processing', 'Urban Infrastructure Engineering', 'Pharmacology', 'Combinatorial Mathematics', 'Logic', 'Obstetrics and Gynecology', 'Power Machinery and Engineering', 'Imaging and Nuclear Medicine', 'Communication and Information Systems', 'Structural Engineering', 'Solid State Physics', 'Ecology', 'Physical Chemistry of Metallurgical Process', 'High Voltage and Insulation Technology', 'Water conservancy and Hydropower Engineering', 'World History', 'Refrigeration and Cryogenic Engineering', 'Criminal Law', 'Functions of Real Variables', 'Law and Social Governance', 'Geriatric Medicine', 'Western Economics', 'Control Theory and Control Engineering', 'Political Science', 'Design Arts', 'Land Resource Management and Administrative Management', 'Military Logistics and Equipment', 'Relativity', 'Quantitative Economics', 'Polymer Physics', 'Traffic Information Engineering and Control', 'Philosophical Aesthetics', 'Food Processing and Storage Engineering', 'Library and Archival Science', 'Food Biochemistry', 'Theoretical Optics', 'Crop Science', 'Instrument Science and Technology', 'Mass Transport and Separation Process in Chemical Engineering', 'Meteorology', 'Elements of Chemical Reaction Engineering', 'Electrodynamics', 'Biochemistry and Molecular Biology', 'Physiology', 'Mechatronic Engineering', 'Geological Resources and Geological Engineering', 'Animal Rearing and Breeding', 'Atomic and Molecular Physics', 'Harmony', 'Traditional Chinese Pharmacy', 'Thermodynamics and Statistical Physics', 'Pharmaceutical Analysis', 'Acoustics', 'Optoelectronic Technology', 'Landscape Plants and Ornamental Horticulture', 'International Trade', 'Modern and Contemporary Chinese Literature', 'Subatomic and Atomic Physics', 'Organic Chemistry', 'Architectural Design and Theory', 'Clinical Laboratory Diagnostics', 'Physical Oceanography', 'Military Command and Information Systems', 'Neurology', 'Systems Science', 'Environmental Engineering', 'Political Economy', 'Underwater Acoustics', 'Human Anatomy and Histology-Embryology', 'Education Economics, Management and Social Security', 'International Law', 'Geotechnical Engineering', 'Radiation Medicine', 'Zoology', 'Quantum Mechanics', 'Group Theory', 'Military Law', 'Fundamentals of Dynamics and Control', 'Ordinary Differential Equations', 'Philology and Bibliography', 'Marine Biology', 'Traditional Chinese Health Preservation', 'History and Theory of Journalism and Media Management', 'Music History, Education, and Technology', 'Sports Humanities and Sociology', 'Classical Chinese Literature', 'Aeronautical and Astronautical Science and Technology', 'Immunology', 'Information Management and Communication', 'Power Systems and Automation', 'Paleontology and Stratigraphy', 'Legal Theory and Legal History', 'Surgery', 'Hydrogeology', 'Structural Geology', 'Hydraulics and Hydrology', 'Formal Languages', 'Urban Planning and Design', 'Probability and Statistics', 'Genetics', 'Labor Economics', 'Bridge and Tunnel Engineering', 'Thermodynamics', 'Theoretical Mechanics', 'Principles of Computer Organization', 'Data Structures', 'Polynomials and Series Expansions', 'Geodesy and Surveying Engineering', 'Atmospheric Physics and Atmospheric Environment', 'Microelectronics and Solid-State Electronics', 'Special Education', 'Clinical Stomatology', 'Digital Surveying and Remote Sensing Applications', 'Mining and Safety Engineering', 'Computational Mathematics', 'Ophthalmology', 'Laser Technology', 'Biophysics', 'Communication and Broadcasting', 'Otorhinolaryngology', 'Ship Mechanics and Design Principles', 'Archaeology and Museology', 'Fuzzy Mathematics', 'Linguistics and Applied Linguistics', 'Sports Science and Medicine', 'Pathology and Pathophysiology', 'Rigid Body Mechanics', 'Fundamental Mathematics', 'Journalism and News Practice', 'Demography and Anthropology', 'Drama and Opera Studies', 'Broadcasting and Television Art', 'Inorganic Chemistry', 'Textile Materials Science', 'Electrical Theory and New Technologies', 'Power Electronics and Electrical Drives', 'Dance Studies', 'Radiation Protection and Nuclear Technology Applications', 'Environmental and Resource Protection', 'Nutrition and Food Hygiene', 'Forest Cultivation and Genetic Breeding', 'Ethics', 'Special Number Theory', 'Advanced Algebra', 'Literary History', 'Electrochemistry', 'Vehicle Operation Engineering', 'Materials Processing Engineering', 'Space physics', 'Cryptography', 'Fluid Physics', 'Medicinal Chemistry', 'Marine Engineering', 'Educational Technology and Principles', 'Agricultural Environment and Soil-Water Engineering', 'Analytical Chemistry', 'Applied Optics', 'Civil and Commercial Law', 'Internal Medicine', 'Numerical Analysis', 'Pathogen Biology', 'Human Geography', 'Radiochemistry', 'Non-ferrous Metallurgy', 'Operating Systems', 'Management Science and Engineering', 'Fluid Flow and Heat Transfer in Chemical Engineering', 'Road and Railway Engineering', 'Advanced Programming Languages', 'Social and Folklore Studies', 'Databases', 'Functions of Complex Variables', 'Health Toxicology and Environmental Health', 'Pharmaceutics', 'Circuits and Systems', 'Nursing and Rehabilitation Medicine', 'Stochastic Processes', 'Dermatology and Venereology', 'Optical Fiber Communication', 'Pediatrics', 'Thermal Energy Engineering', 'Statistical Mechanics', 'Industrial Economics', 'Marine Chemistry', 'Astrophysics', 'Emergency Medicine', 'Theoretical Fluid Mechanics', 'Solar System Science', 'Computer Networks', 'Heat Transfer', 'Solid Mechanics', 'Military Thought and History', 'Antenna and Radio Communication', 'Oil and Gas Field Development and Storage & Transportation Engineering', 'Principles of Metallurgy', 'Contract Law', 'Astronomical Observation and Technology', 'Polymer Chemistry and Physics', 'Environmental Science', 'Architectural History', 'Physical Education and Training', 'Maternal, Child and Adolescent Health', 'Botany', 'Microbiology', 'Electromagnetic Field and Microwave Technology', 'Anesthesiology', 'Oncology', 'Mathematical Analysis', 'Philosophy of Science and Technology', 'Geometry and Topology', 'Tourism Management and Technological Economics Management', 'Psychology', 'Weapon Systems Science and Engineering', 'Computer Architecture', 'Aquaculture', 'Theory of Curriculum and Instruction', 'Psychiatry and Mental Health', 'Composition', 'Basic Stomatology', 'Dynamic Meteorology', 'Transportation Planning and Management', 'National and Defense Economics', 'Solid Earth Geophysics', 'French Language and Literature', 'Principles of Seismic Exploration', 'Finance', 'Guidance, Navigation and Control', 'Information Management Science', 'Procedural Law', 'Religious Studies', 'Engineering Thermophysics', 'Social Medicine and Health Management', 'Poromechanics and Reservoir Physics', 'Number Theory', 'Business and Accounting Management', 'Manufacturing Automation', 'Agricultural Mechanization Engineering', 'Russian Language and Literature', 'Operations Research and Cybernetics', 'Physical Geography', 'Fluid Machinery and Engineering', 'Stellar and Interstellar Evolution', 'Semiconductor Physics', 'Veterinary Medicine', 'Cell Biology', 'Microbiology and Biochemical Pharmacy', 'Public Finance', 'Computer Software and Theory', 'Iron and Steel Metallurgy', 'Mineralogy, Petrology, and Economic Geology', 'Economic History', 'Graph Theory', 'Pitch and Scales', 'Economic Statistics', 'Geochemistry', 'Film Studies', 'Physical Chemistry']

Model Details

  • Base Model: unsloth/Llama-3.2-3B-Instruct
  • Parameter Count: 3212749824
  • Precision: torch.bfloat16

Hardware

  • GPU: NVIDIA L4

Training stats

  • Global step: 6302
  • Training runtime: 6252.4211
  • Average training loss: 0.06931384020316217
  • Final validation loss: 0.05084875971078873
  • Epoch: 2.0

Framework versions

  • Unsloth: 2026.3.4
  • TRL: 0.22.2
  • Transformers: 4.56.2
  • Pytorch: 2.10.0+cu128
  • Datasets: 4.3.0
  • Tokenizers: 0.22.2

License

This model is released under the Llama3 license. See the Terms of Use for details.

Downloads last month
504
Safetensors
Model size
3B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kth8/Llama-3.2-3B-Instruct-SuperGPQA-Classifier

Finetuned
(705)
this model
Quantizations
1 model

Dataset used to train kth8/Llama-3.2-3B-Instruct-SuperGPQA-Classifier