paper-with-me

Papers

Towards Deep Compositional Networks

2016-09-13 · Domen Tabernik, Matej Kristan, Jeremy L. Wyatt, Aleš Leonardis

Hierarchical feature learning based on convolutional neural networks (CNN) has recently shown significant potential in various computer vision tasks. While allowing high-quality discriminative feature learning, the downside of CNNs is the lack of explicit structure in features, which often leads to overfitting, absence of reconstruction from partial observations and limited generative abilities. Explicit structure is inherent in hierarchical compositional models, however, these lack the ability to optimize a well-defined cost function. We propose a novel analytic model of a basic unit in a layered hierarchical model with both explicit compositional structure and a well-defined discriminative cost function. Our experiments on two datasets show that the proposed compositional model performs on a par with standard CNNs on discriminative tasks, while, due to explicit modeling of the structure in the feature units, affording a straight-forward visualization of parts and faster inference due to separability of the units. Actions

📄 PDF Abstract BibTeX arXiv:1609.03795

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When a Red Herring in Not a Red Herring: Using Compositional Methods to Detect Non-Compositional Phrases

2017-04-01 · EACL 2017 4 · Julie Weeds, Thomas Kober, Jeremy Reffin, David Weir

Non-compositional phrases such as \textit{red herring} and weakly compositional phrases such as \textit{spelling bee} are an integral part of natural language (Sag, 2002). They are also the phrases that are difficult, or…

Contextual Compositionality Detection with External Knowledge Bases andWord Embeddings

2019-03-20 · Dongsheng Wang, Quichi Li, Lucas Chaves Lima, Jakob Grue Simonsen 외

When the meaning of a phrase cannot be inferred from the individual meanings of its words (e.g., hot dog), that phrase is said to be non-compositional. Automatic compositionality detection in multi-word phrases is critic…

Evaluating Compositional Approaches for Focus and Sentiment Analysis

2025-08-11 · Olga Kellert, Muhammad Imran, Nicholas Hill Matlis, Mahmud Uz Zaman 외 arxiv

This paper summarizes the results of evaluating a compositional approach for Focus Analysis (FA) in Linguistics and Sentiment Analysis (SA) in Natural Language Processing (NLP). While quantitative evaluations of composit…

Sentiment Analysis

The paradox of the compositionality of natural language: a neural machine translation case study

2021-08-12 · ACL 2022 5 · Verna Dankers, Elia Bruni, Dieuwke Hupkes

Obtaining human-like performance in NLP is often argued to require compositional generalisation. Whether neural networks exhibit this ability is usually studied by training models on highly compositional synthetic data. …

Machine TranslationMathNMTTranslation

Compositional Generalization in Spoken Language Understanding

2023-12-25 · Avik Ray, Yilin Shen, Hongxia Jin

State-of-the-art spoken language understanding (SLU) models have shown tremendous success in benchmark SLU datasets, yet they still fail in many practical scenario due to the lack of model compositionality when trained o…

Spoken Language Understanding