paper-with-me

Papers

CAREER: A Foundation Model for Labor Sequence Data

2022-02-16 · Keyon Vafa, Emil Palikot, Tianyu Du, Ayush Kanodia, Susan Athey, David M. Blei

Labor economists regularly analyze employment data by fitting predictive models to small, carefully constructed longitudinal survey datasets. Although machine learning methods offer promise for such problems, these survey datasets are too small to take advantage of them. In recent years large datasets of online resumes have also become available, providing data about the career trajectories of millions of individuals. However, standard econometric models cannot take advantage of their scale or incorporate them into the analysis of survey data. To this end we develop CAREER, a foundation model for job sequences. CAREER is first fit to large, passively-collected resume data and then fine-tuned to smaller, better-curated datasets for economic inferences. We fit CAREER to a dataset of 24 million job sequences from resumes, and adjust it on small longitudinal survey datasets. We find that CAREER forms accurate predictions of job sequences, outperforming econometric baselines on three widely-used economics datasets. We further find that CAREER can be used to form good predictions of other downstream variables. For example, incorporating CAREER into a wage model provides better predictions than the econometric models currently in use.

📄 PDF Abstract BibTeX arXiv:2202.08370

Code (1)

keyonvafa/career-code 공식 구현 pytorch

Tasks

Language ModellingmodelSurveyTransfer Learning

Similar Papers 제목 키워드 기반

LABOR-LLM: Language-Based Occupational Representations with Large Language Models

2024-06-25 · Susan Athey, Herman Brunborg, Tianyu Du, Ayush Kanodia 외

Vafa et al. (2024) introduced a transformer-based econometric model, CAREER, that predicts a worker's next job as a function of career history (an "occupation model"). CAREER was initially estimated ("pre-trained") using…

In-Context LearningJob PredictionLanguage ModelingLanguage Modelling+5

Learning after COVID-19 and the ICT career aspirations: Are students entering the AI era with weaker skills?

2026-04-17 · Diana Maria Popa, Simona-Vasilica Oprea, Adela Bâra arxiv

This paper examines whether students are entering the generative AI era with sufficiently strong educational foundations, focusing on the relationship between learning environments and changes in ICT related career aspir…

Representation Learning

An LLM-Powered Agent for Real-Time Analysis of the Vietnamese IT Job Market

2025-09-26 · Minh-Thuan Nguyen, Thien Vo-Thanh, Thai-Duy Dinh, Xuan-Quang Phan 외 arxiv

Individuals entering Vietnam's dynamic Information Technology (IT) job market face a critical gap in reliable career guidance. Existing market reports are often outdated, while the manual analysis of thousands of job pos…

JobHop: A Large-Scale Dataset of Career Trajectories

2025-05-12 · Iman Johary, Raphael Romero, Alexandru C. Mara, Tijl De Bie

Understanding labor market dynamics is essential for policymakers, employers, and job seekers. However, comprehensive datasets that capture real-world career trajectories are scarce. In this paper, we introduce JobHop, a…

Decision MakingMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Estimating Wage Disparities Using Foundation Models

2024-09-15 · Keyon Vafa, Susan Athey, David M. Blei

The rise of foundation models marks a paradigm shift in machine learning: instead of training specialized models from scratch, foundation models are first trained on massive datasets before being adapted or fine-tuned to…

Econometrics