paper-with-me

홈 › Papers

Education-to-Skill Mapping Using Hierarchical Classification and Transformer Neural Network

2021-06-24 · Applied Sciences 2021 6 · Vilija Kuodytė, Linas Petkevičius

Skills gained from vocational or higher education form an essential component of country’s economy, determining the structure of the national labor force. Therefore, knowledge on how people’s education converts to jobs enables data-driven choices concerning human resources within an ever-changing job market. Moreover, the relationship between education and occupation is also relevant in times of global crises, such as the COVID-19 pandemic. Healthcare system overload and skill shortage on one hand, and job losses related to lock-downs on the other, have exposed a necessity to identify target groups with relevant education backgrounds in order to facilitate their occupational transitions. However, the relationship between education and employment is complex and difficult to model. This study aims to propose the methodology that would allow us to model education-to-skill mapping. Multiple challenges arising from administrative datasets, namely imbalanced data, complex labeling, hierarchical structure and textual data, were addressed using six neural network-based algorithms of incremental complexity. The final proposed mathematical model incorporates the textual data from descriptions of education programs that are transformed into embeddings, utilizing transformer neural networks. The output of the final model is constructed as the hierarchical classification task. The effectiveness of the proposed model is demonstrated using experiments on national level data, which covers whole population of Lithuania. Finally, we provide the recommendations for the usage of proposed model. This model can be used for practical applications and scenario forecasting. Some possible applications for such model usage are demonstrated and described in this article. The code for this research has been made available on GitHub.

📄 PDF Abstract BibTeX

Code (1)

Stratosfera/education2skill tf

Tasks

Occupation prediction

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
WordPiece 설명 없음
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Hiring Now: A Skill-Aware Multi-Attention Model for Job Posting Generation

2020-07-01 · ACL 2020 6 · Liting Liu, Jie Liu, Wenzheng Zhang, Ziming Chi 외

Writing a good job posting is a critical step in the recruiting process, but the task is often more difficult than many people think. It is challenging to specify the level of education, experience, relevant skills per t…

Conditional Text GenerationDecoderText Generation

Automatically Inferring Teachers' Geometric Content Knowledge: A Skills Based Approach

2026-04-15 · Ziv Fenigstein, Kobi Gal, Avi Segal, Osama Swidan 외 arxiv

Assessing teachers' geometric content knowledge is essential for geometry instructional quality and student learning, but difficult to scale. The Van Hiele model characterizes geometric reasoning through five hierarchica…

Multi-Task Learning

Machine Teaching in Hierarchical Genetic Reinforcement Learning: Curriculum Design of Reward Functions for Swarm Shepherding

2019-01-04 · Nicholas R. Clayton, Hussein Abbass

The design of reward functions in reinforcement learning is a human skill that comes with experience. Unfortunately, there is not any methodology in the literature that could guide a human to design the reward function o…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Privacy-Preserving AI-Enabled Decentralized Learning and Employment Records System

2026-01-06 · Yuqiao Xu, Mina Namazi, Sahith Reddy Jalapally, Osama Zafar 외 arxiv

Learning and Employment Record (LER) systems are emerging as critical infrastructure for securely compiling and sharing educational and work achievements. Existing blockchain-based platforms leverage verifiable credentia…

Hierarchical Classification of Transversal Skills in Job Ads Based on Sentence Embeddings

2024-01-10 · Florin Leon, Marius Gavrilescu, Sabina-Adriana Floria, Alina-Adriana Minea

This paper proposes a classification framework aimed at identifying correlations between job ad requirements and transversal skill sets, with a focus on predicting the necessary skills for individual job descriptions usi…

ClassificationLanguage ModelingLanguage ModellingSentence+3