paper-with-me

홈 › Papers

SkillSpan: Hard and Soft Skill Extraction from English Job Postings

2022-04-27 · NAACL 2022 7 · Mike Zhang, Kristian Nørgaard Jensen, Sif Dam Sonniks, Barbara Plank

Skill Extraction (SE) is an important and widely-studied task useful to gain insights into labor market dynamics. However, there is a lacuna of datasets and annotation guidelines; available datasets are few and contain crowd-sourced labels on the span-level or labels from a predefined skill inventory. To address this gap, we introduce SKILLSPAN, a novel SE dataset consisting of 14.5K sentences and over 12.5K annotated spans. We release its respective guidelines created over three different sources annotated for hard and soft skills by domain experts. We introduce a BERT baseline (Devlin et al., 2019). To improve upon this baseline, we experiment with language models that are optimized for long spans (Joshi et al., 2020; Beltagy et al., 2020), continuous pre-training on the job posting domain (Han and Eisenstein, 2019; Gururangan et al., 2020), and multi-task learning (Caruana, 1997). Our results show that the domain-adapted models significantly outperform their non-adapted counterparts, and single-task outperforms multi-task learning.

📄 PDF Abstract BibTeX arXiv:2204.12811

Code (1)

kris927b/skillspan 공식 구현 pytorch

Tasks

Multi-Task Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
WordPiece 설명 없음
Weight Decay 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

Chinese-SkillSpan: A Span-Level Dataset for ESCO-Aligned Competency Extraction from Chinese Job Ads

2026-04-24 · Guojing Li, Zichuan Fu, Junyi Li, Wenxia Zhou 외 arxiv

Job Skill Named Entity Recognition (JobSkillNER) aims to automatically extract key skill information from large-scale job posting data, which is important for improving talent-market matching efficiency and supporting pe…

Deep Learning-based Computational Job Market Analysis: A Survey on Skill Extraction and Classification from Job Postings

2024-02-08 · Elena Senger, Mike Zhang, Rob van der Goot, Barbara Plank

Recent years have brought significant advances to Natural Language Processing (NLP), which enabled fast progress in the field of computational job market analysis. Core tasks in this application domain are skill extracti…

Classification

NNOSE: Nearest Neighbor Occupational Skill Extraction

2024-01-30 · Mike Zhang, Rob van der Goot, Min-Yen Kan, Barbara Plank

The labor market is changing rapidly, prompting increased interest in the automatic extraction of occupational skills from text. With the advent of English benchmark job description datasets, there is a need for systems …

DiversityRetrieval

Generative-AI and the transformation of workforce. A job postings-driven analysis

2026-04-07 · Diana Maria Popa, Simona-Vasilica Oprea, Adela Bâra arxiv

This paper investigates how generative-artificial intelligence AI is reshaping job requirements, skill compositions and sectoral dynamics across global labor markets. It examines the evolving frequency and framing of AI-…

Prompt Engineering

Learning Representations for Soft Skill Matching

2018-07-20 · Luiza Sayfullina, Eric Malmi, Juho Kannala

Employers actively look for talents having not only specific hard skills but also various soft skills. To analyze the soft skill demands on the job market, it is important to be able to detect soft skill phrases from job…

Binary text classificationtext-classificationText Classification