홈 › Papers

PRESTO: A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs

2023-03-15 · Rahul Goel, Waleed Ammar, Aditya Gupta, Siddharth Vashishtha, Motoki Sano, Faiz Surani, Max Chang, HyunJeong Choe, David Greene, Kyle He, Rattima Nitisaroj, Anna Trukhina, Shachi Paul, Pararth Shah, Rushin Shah, Zhou Yu

Research interest in task-oriented dialogs has increased as systems such as Google Assistant, Alexa and Siri have become ubiquitous in everyday life. However, the impact of academic research in this area has been limited by the lack of datasets that realistically capture the wide array of user pain points. To enable research on some of the more challenging aspects of parsing realistic conversations, we introduce PRESTO, a public dataset of over 550K contextual multilingual conversations between humans and virtual assistants. PRESTO contains a diverse array of challenges that occur in real-world NLU tasks such as disfluencies, code-switching, and revisions. It is the only large scale human generated conversational parsing dataset that provides structured context such as a user's contacts and lists for each example. Our mT5 model based baselines demonstrate that the conversational phenomenon present in PRESTO are challenging to model, which is further pronounced in a low-resource setup.

📄 PDF Abstract BibTeX arXiv:2303.08954

Code (1)

google-research-datasets/presto 공식 구현

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…

Residual Connection 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Benchmarking Large Language Models on Reference Extraction and Parsing in the Social Sciences and Humanities

2026-03-13 · Yurui Zhu, Giovanni Colavizza, Matteo Romanello arxiv

Bibliographic reference extraction and parsing are foundational for citation indexing, linking, and downstream scholarly knowledge-graph construction. However, most established evaluations focus on clean, English, end-of…

PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes

2024-06-19 · He Cao, Yanjun Shao, Zhiyuan Liu, Zijing Liu 외

Multimodal Large Language Models (MLLMs) have seen growing adoption across various scientific disciplines. These advancements encourage the investigation of molecule-text modeling within synthetic chemistry, a field dedi…

cross-modal alignment

Compositional Generalization in Multilingual Semantic Parsing over Wikidata

2021-08-07 · Ruixiang Cui, Rahul Aralikatte, Heather Lent, Daniel Hershcovich

Semantic parsing (SP) allows humans to leverage vast knowledge resources through natural interaction. However, parsers are mostly designed for and evaluated on English resources, such as CFQ (Keysers et al., 2020), the c…

Cross-Lingual Transfer Semantic Parsing Zero-Shot Cross-Lingual Transfer

Evaluating Inter-Bilingual Semantic Parsing for Indian Languages

2023-04-25 · Divyanshu Aggarwal, Vivek Gupta, Anoop Kunchukuttan

Despite significant progress in Natural Language Generation for Indian languages (IndicNLP), there is a lack of datasets around complex structured tasks such as semantic parsing. One reason for this imminent gap is the c…

Semantic Parsing Text Generation Translation

Multilingual Neural Semantic Parsing for Low-Resourced Languages

2021-06-07 · Joint Conference on Lexical and Computational Semantics 2021 · Menglin Xia, Emilio Monti

Multilingual semantic parsing is a cost-effective method that allows a single model to understand different languages. However, researchers face a great imbalance of availability of training data, with English being reso…

Machine Translation Semantic Parsing Transfer Learning Translation+1