paper-with-me

Papers

Reference-Limited Compositional Learning: A Realistic Assessment for Human-level Compositional Generalization

2021-09-29 · Siteng Huang, Qiyao Wei, Donglin Wang

To narrow the considerable gap between artificial and human intelligence, we propose a new task, namely reference-limited compositional learning (RLCL), which reproduces three core challenges to mimic human perception: compositional learning, few-shot, and few referential compositions. Building upon the setting, we propose two benchmarks that consist of multiple datasets with diverse compositional labels, providing a suitable and realistic platform for systematically assessing progress on the task. Moreover, we extend popular few-shot and compositional learning approaches to serve as baselines, and also introduce a simple method that achieves better performance in recognizing unseen compositions. Extensive experiments demonstrate that existing solutions struggle with the challenges imposed by the RLCL task, revealing substantial research space for pursuing human-level compositional generalization ability.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Reference-Limited Compositional Zero-Shot Learning

2022-08-22 · Siteng Huang, Qiyao Wei, Donglin Wang

Compositional zero-shot learning (CZSL) refers to recognizing unseen compositions of known visual primitives, which is an essential ability for artificial intelligence systems to learn and understand the world. While con…

Compositional Zero-Shot LearningZero-Shot Learning

Comparing word2vec and GloVe for Automatic Measurement of MWE Compositionality

2020-12-01 · COLING (MWE) 2020 12 · Thomas Pickard

This paper explores the use of word2vec and GloVe embeddings for unsupervised measurement of the semantic compositionality of MWE candidates. Through comparison with several human-annotated reference sets, we find word2v…

Compositional preference models for aligning LMs

2023-10-17 · Dongyoung Go, Tomasz Korbak, Germán Kruszewski, Jos Rozen 외

As language models (LMs) become more capable, it is increasingly important to align them with human preferences. However, the dominant paradigm for training Preference Models (PMs) for that purpose suffers from fundament…

Do You Guys Want to Dance: Zero-Shot Compositional Human Dance Generation with Multiple Persons

2024-01-24 · Zhe Xu, Kun Wei, Xu Yang, Cheng Deng

Human dance generation (HDG) aims to synthesize realistic videos from images and sequences of driving poses. Despite great success, existing methods are limited to generating videos of a single person with specific backg…

Decompose and Leverage Preferences from Expert Models for Improving Trustworthiness of MLLMs

2024-11-20 · Rui Cao, Yuming Jiang, Michael Schlichtkrull, Andreas Vlachos

Multimodal Large Language Models (MLLMs) can enhance trustworthiness by aligning with human preferences. As human preference labeling is laborious, recent works employ evaluation models for assessing MLLMs' responses, us…