paper-with-me

홈 › Papers

A Deep Relevance Model for Zero-Shot Document Filtering

2018-07-01 · ACL 2018 7 · Chenliang Li, Wei Zhou, Feng Ji, Yu Duan, Haiqing Chen

In the era of big data, focused analysis for diverse topics with a short response time becomes an urgent demand. As a fundamental task, information filtering therefore becomes a critical necessity. In this paper, we propose a novel deep relevance model for zero-shot document filtering, named DAZER. DAZER estimates the relevance between a document and a category by taking a small set of seed words relevant to the category. With pre-trained word embeddings from a large external corpus, DAZER is devised to extract the relevance signals by modeling the hidden feature interactions in the word embedding space. The relevance signals are extracted through a gated convolutional process. The gate mechanism controls which convolution filters output the relevance signals in a category dependent manner. Experiments on two document collections of two different tasks (i.e., topic categorization and sentiment analysis) demonstrate that DAZER significantly outperforms the existing alternative solutions, including the state-of-the-art deep relevance ranking models.

📄 PDF Abstract BibTeX

Code (1)

WHUIR/DAZER 공식 구현 tf

Tasks

Sentiment AnalysisText ClassificationWord Embeddings

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Precise Zero-Shot Dense Retrieval without Relevance Labels

2022-12-20 · Luyu Gao, Xueguang Ma, Jimmy Lin, Jamie Callan

While dense retrieval has been shown effective and efficient across tasks and languages, it remains difficult to create effective fully zero-shot dense retrieval systems when no relevance label is available. In this pape…

Fact VerificationInstruction FollowingLanguage ModelingLanguage Modelling+2

Combining State-of-the-Art Models with Maximal Marginal Relevance for Few-Shot and Zero-Shot Multi-Document Summarization

2022-11-19 · David Adams, Gandharv Suri, Yllias Chali

In Natural Language Processing, multi-document summarization (MDS) poses many challenges to researchers above those posed by single-document summarization (SDS). These challenges include the increased search space and gr…

DiversityDocument SummarizationMulti-Document Summarization

Beyond Yes and No: Improving Zero-Shot LLM Rankers via Scoring Fine-Grained Relevance Labels

2023-10-21 · Honglei Zhuang, Zhen Qin, Kai Hui, Junru Wu 외

Zero-shot text rankers powered by recent LLMs achieve remarkable ranking performance by simply prompting. Existing prompts for pointwise LLM rankers mostly ask the model to choose from binary relevance labels like "Yes" …

Zero-Shot Dense Retrieval with Embeddings from Relevance Feedback

2024-10-28 · Nour Jedidi, Yung-Sung Chuang, Leslie Shing, James Glass

Building effective dense retrieval systems remains difficult when relevance supervision is not available. Recent work has looked to overcome this challenge by using a Large Language Model (LLM) to generate hypothetical d…

Language ModellingLarge Language ModelRetrieval

Zero-shot topic generation

2020-04-29 · Oleg Vasilyev, Kathryn Evans, Anna Venancio-Marques, John Bohannon

We present an approach to generating topics using a model trained only for document title generation, with zero examples of topics given during training. We leverage features that capture the relevance of a candidate spa…

Articles