Christianvedel/OccCANINE_OCC1950

OccCANINE: OCC1950 Occupational Classification

Overview

OccCANINE_OCC1950 is a version of OccCANINE fine-tuned to automatically convert English occupational descriptions into IPUMS OCC1950 codes (US Census 1950 occupational classification). It uses a CANINE encoder with a sequential decoder trained using a mixed loss, fine-tuned from the OccCANINE_s2s_mix base model on IPUMS US census data.

See more on: GitHub.com/christianvedels/OccCANINE

Read the paper on arXiv: https://arxiv.org/abs/2402.13604

Key Features

• English: Trained and evaluated on English occupational descriptions.
• Sequential decoding: Outputs OCC1950 codes digit-by-digit.
• Mixed loss training: Combines sequence-level and flat classification losses.
• Fine-tuned: Initialized from OccCANINE_s2s_mix and fine-tuned on IPUMS US OCC1950 data.

Usage

from histocc import OccCANINE

model = OccCANINE(name="OccCANINE_OCC1950", system="OCC1950", hf=True)

result = model.predict("blacksmith", lang="en")

Contribution and Support

Developed at the University of Southern Denmark by Christian Møller Dahl, Torben Johansen and Christian Vedel.

---

Model Details:

• Task: Text Classification / Sequence Generation
• Base Model: CANINE (fine-tuned from OccCANINE_s2s_mix)
• Target system: IPUMS OCC1950
• Language: English
• Framework: Transformers / PyTorch
• License: Apache 2.0
• Paper: arXiv 2402.13604