paper-with-me

홈 › Papers

Learning to Match Job Candidates Using Multilingual Bi-Encoder BERT

2021-09-15 · Dor Lavi

In this talk, we will show how we used Randstad history of candidate placements to generate labeled CV-vacancy pairs dataset. Afterwards we fine-tune a multilingual BERT with bi encoder structure over this dataset, by adding a cosine similarity log loss layer. We will explain how using the mentioned structure helps us overcome most of the challenges described above, and how it enables us to build a maintainable and scalable pipeline to match CVs and vacancies. In addition, we show how we gain a better semantic understanding, and learn to bridge the vocabulary gap. Finally, we highlight how multilingual transformers help us handle cross language barrier and might reduce discrimination.

📄 PDF Abstract BibTeX arXiv:2109.07157

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Adam 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

EuroBERT: Scaling Multilingual Encoders for European Languages

2025-03-07 · Nicolas Boizard, Hippolyte Gisserot-Boukhlef, Duarte M. Alves, André Martins 외

General-purpose multilingual vector representations, used in retrieval, regression and classification, are traditionally obtained from bidirectional encoder models. Despite their wide applicability, encoders have been re…

Decoder

How Do Multilingual Encoders Learn Cross-lingual Representation?

2022-07-12 · Shijie Wu

NLP systems typically require support for more than one language. As different languages have different amounts of supervision, cross-lingual transfer benefits languages with little to no training data by transferring fr…

Cross-Lingual TransferMultilingual NLPRepresentation Learning

Pretraining and Benchmarking Modern Encoders for Latvian

2026-03-16 · Arturs Znotins arxiv

Encoder-only transformers remain essential for practical NLP tasks. While recent advances in multilingual models have improved cross-lingual capabilities, low-resource languages such as Latvian remain underrepresented in…

Bridging the gap: A comparative exploration of Speech-LLM and end-to-end architecture for multilingual conversational ASR

2026-01-04 · Yuxiang Mei, Dongxing Xu, Jiaen Liang, Yanhua Long arxiv

The INTERSPEECH 2025 Challenge on Multilingual Conversational Speech Language Models (MLC-SLM) promotes multilingual conversational ASR with large language models (LLMs). Our previous SHNU-mASR system adopted a competiti…

Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retriever

2024-08-29 · Rohan Jha, Bo wang, Michael Günther, Georgios Mastrapas 외

Multi-vector dense models, such as ColBERT, have proven highly effective in information retrieval. ColBERT's late interaction scoring approximates the joint query-document attention seen in cross-encoders while maintaini…

Information RetrievalRetrieval