paper-with-me

홈 › Papers

Open-Domain Conversational Search Assistant with Transformers

2021-01-20 · Rafael Ferreira, Mariana Leite, David Semedo, Joao Magalhaes

Open-domain conversational search assistants aim at answering user questions about open topics in a conversational manner. In this paper we show how the Transformer architecture achieves state-of-the-art results in key IR tasks, leveraging the creation of conversational assistants that engage in open-domain conversational search with single, yet informative, answers. In particular, we propose an open-domain abstractive conversational search agent pipeline to address two major challenges: first, conversation context-aware search and second, abstractive search-answers generation. To address the first challenge, the conversation context is modeled with a query rewriting method that unfolds the context of the conversation up to a specific moment to search for the correct answers. These answers are then passed to a Transformer-based re-ranker to further improve retrieval performance. The second challenge, is tackled with recent Abstractive Transformer architectures to generate a digest of the top most relevant passages. Experiments show that Transformers deliver a solid performance across all tasks in conversational search, outperforming the best TREC CAsT 2019 baseline.

📄 PDF Abstract BibTeX arXiv:2101.08197

Code (1)

novasearch/conversational-search-assistant-transformers 공식 구현 pytorch

Tasks

Conversational SearchRetrieval

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day

2023-06-01 · NeurIPS 2023 11 · Chunyuan Li, Cliff Wong, Sheng Zhang, Naoto Usuyama 외

Conversational generative AI has demonstrated remarkable promise for empowering biomedical practitioners, but current investigations focus on unimodal text. Multimodal conversational AI has seen rapid progress by leverag…

Image ClassificationInstruction FollowingLanguage ModellingQuestion Answering+3

Open Assistant Toolkit -- version 2

2024-03-01 · Sophie Fischer, Federico Rossetto, Carlos Gemmell, Andrew Ramsay 외

We present the second version of the Open Assistant Toolkit (OAT-v2), an open-source task-oriented conversational system for composing generative neural models. OAT-v2 is a scalable and flexible assistant platform suppor…

Code GenerationResponse GenerationRetrieval

Document-editing Assistants and Model-based Reinforcement Learning as a Path to Conversational AI

2020-08-27 · Katya Kudashkina, Patrick M. Pilarski, Richard S. Sutton

Intelligent assistants that follow commands or answer simple questions, such as Siri and Google search, are among the most economically important applications of AI. Future conversational AI assistants promise even great…

Model-based Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

NaRLE: Natural Language Models using Reinforcement Learning with Emotion Feedback

2021-10-05 · Ruijie Zhou, Soham Deshmukh, Jeremiah Greer, Charles Lee

Current research in dialogue systems is focused on conversational assistants working on short conversations in either task-oriented or open domain settings. In this paper, we focus on improving task-based conversational …

Deep Reinforcement Learningintent-classificationIntent ClassificationNatural Language Understanding+3

Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time

2018-01-08 · Ting-Hao 'Kenneth' Huang, Joseph Chee Chang, Jeffrey P. Bigham

Crowd-powered conversational assistants have been shown to be more robust than automated systems, but do so at the cost of higher response latency and monetary costs. A promising direction is to combine the two approache…

Open-Domain Dialog