A Deep Learning Model for Structured Outputs with High-order Interaction

2015-04-29 · Hongyu Guo, Xiaodan Zhu, Martin Renqiang Min

Many real-world applications are associated with structured data, where not only input but also output has interplay. However, typical classification and regression models often lack the ability of simultaneously exploring high-order interaction within input and that within output. In this paper, we present a deep learning model aiming to generate a powerful nonlinear functional mapping from structured input to structured output. More specifically, we propose to integrate high-order hidden units, guided discriminative pretraining, and high-order auto-encoders for this purpose. We evaluate the model with three datasets, and obtain state-of-the-art performances among competitive methods. Our current work focuses on structured output regression, which is a less explored area, although the model can be extended to handle structured label classification.

📄 PDF Abstract BibTeX arXiv:1504.08022

Code (0)

등록된 구현이 없습니다.

Tasks

Classification General Classification regression Vocal Bursts Intensity Prediction

Knowledge Is Not Static: Order-Aware Hypergraph RAG for Language Models

2026-04-14 · Keshu Wu, Chenchen Kuai, Zihao Li, Jiwan Jiang 외 arxiv

Retrieval-augmented generation (RAG) enhances large language models by grounding outputs in retrieved knowledge. However, existing RAG methods including graph- and hypergraph-based approaches treat retrieved evidence as …

Question Answering

The Pedagogy of AI Mistakes: Fostering Higher-Order Thinking

2026-05-06 · Hadi Hosseini arxiv

As generative AI becomes increasingly integrated into higher education, its frequent errors and hallucinations, often seen as limitations, offer a unique pedagogical opportunity. By framing AI as a ``learning companion''…

Structured Prediction Energy Networks

2015-11-19 · David Belanger, Andrew McCallum

We introduce structured prediction energy networks (SPENs), a flexible framework for structured prediction. A deep architecture is used to define an energy function of candidate labels, and then predictions are produced …

General Classification Multi-Label Classification MUlTI-LABEL-ClASSIFICATION Prediction+1

Modeling Structure with Undirected Neural Networks

2022-02-08 · Tsvetomila Mihaylova, Vlad Niculae, André F. T. Martins

Neural networks are powerful function estimators, leading to their status as a paradigm of choice for modeling structured data. However, unlike other structured representations that emphasize the modularity of the proble…

Dependency Parsing image-classification Image Classification

Approximation-Aware Dependency Parsing by Belief Propagation

2015-08-10 · TACL 2015 1 · Matthew R. Gormley, Mark Dredze, Jason Eisner

We show how to train the fast dependency parser of Smith and Eisner (2008) for improved accuracy. This parser can consider higher-order interactions among edges while retaining O(n^3) runtime. It outputs the parse with m…

Dependency Parsing