paper-with-me

홈 › Papers

VacancySBERT: the approach for representation of titles and skills for semantic similarity search in the recruitment domain

2023-07-31 · Maiia Bocharova, Eugene Malakhov, Vitaliy Mezhuyev

The paper focuses on deep learning semantic search algorithms applied in the HR domain. The aim of the article is developing a novel approach to training a Siamese network to link the skills mentioned in the job ad with the title. It has been shown that the title normalization process can be based either on classification or similarity comparison approaches. While classification algorithms strive to classify a sample into predefined set of categories, similarity search algorithms take a more flexible approach, since they are designed to find samples that are similar to a given query sample, without requiring pre-defined classes and labels. In this article semantic similarity search to find candidates for title normalization has been used. A pre-trained language model has been adapted while teaching it to match titles and skills based on co-occurrence information. For the purpose of this research fifty billion title-descriptions pairs had been collected for training the model and thirty three thousand title-description-normalized title triplets, where normalized job title was picked up manually by job ad creator for testing purposes. As baselines FastText, BERT, SentenceBert and JobBert have been used. As a metric of the accuracy of the designed algorithm is Recall in top one, five and ten model's suggestions. It has been shown that the novel training objective lets it achieve significant improvement in comparison to other generic and specific text encoders. Two settings with treating titles as standalone strings, and with included skills as additional features during inference have been used and the results have been compared in this article. Improvements by 10% and 21.5% have been achieved using VacancySBERT and VacancySBERT (with skills) respectively. The benchmark has been developed as open-source to foster further research in the area.

📄 PDF Abstract BibTeX arXiv:2307.16638

Code (1)

maiiabocharova/vacancysbert 공식 구현

Tasks

Language ModellingSemantic SimilaritySemantic Textual Similarity

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Attention 설명 없음
WordPiece 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

Learning Job Titles Similarity from Noisy Skill Labels

2022-07-01 · Rabih Zbib, Lucas Alvarez Lacasa, Federico Retyk, Rus Poves 외

Measuring semantic similarity between job titles is an essential functionality for automatic job recommendations. This task is usually approached using supervised learning techniques, which requires training data in the …

Representation LearningSemantic SimilaritySemantic Textual Similarity

Evaluating Deduplication Techniques for Economic Research Paper Titles with a Focus on Semantic Similarity using NLP and LLMs

2024-10-02 · Doohee You, Samuel Fraiberger

This study investigates efficient deduplication techniques for a large NLP dataset of economic research paper titles. We explore various pairing methods alongside established distance measures (Levenshtein distance, cosi…

Semantic SimilaritySemantic Textual Similarity

JAMES: Normalizing Job Titles with Multi-Aspect Graph Embeddings and Reasoning

2022-02-22 · Michiharu Yamashita, Jia Tracy Shen, Thanh Tran, Hamoon Ekhtiari 외

In online job marketplaces, it is important to establish a well-defined job title taxonomy for various downstream tasks (e.g., job recommendation, users' career analysis, and turnover prediction). Job Title Normalization…

Logical ReasoningSemantic SimilaritySemantic Textual Similarity

JobBERT: Understanding Job Titles through Skills

2021-09-20 · Jens-Joris Decorte, Jeroen Van Hautte, Thomas Demeester, Chris Develder

Job titles form a cornerstone of today's human resources (HR) processes. Within online recruitment, they allow candidates to understand the contents of a vacancy at a glance, while internal HR departments use them to org…

Language ModelingLanguage ModellingSentence

EMBEDDIA at SemEval-2022 Task 8: Investigating Sentence, Image, and Knowledge Graph Representations for Multilingual News Article Similarity

2022-07-01 · SemEval (NAACL) 2022 7 · Elaine Zosa, Emanuela Boros, Boshko Koloski, Lidia Pivovarova

In this paper, we present the participation of the EMBEDDIA team in the SemEval-2022 Task 8 (Multilingual News Article Similarity). We cover several techniques and propose different methods for finding the multilingual n…

ArticlesSemantic SimilaritySemantic Textual SimilaritySentence