paper-with-me

홈 › Papers

Deeply Learning the Messages in Message Passing Inference

2015-06-06 · NeurIPS 2015 12 · Guosheng Lin, Chunhua Shen, Ian Reid, Anton Van Den Hengel

Deep structured output learning shows great promise in tasks like semantic image segmentation. We proffer a new, efficient deep structured model learning scheme, in which we show how deep Convolutional Neural Networks (CNNs) can be used to estimate the messages in message passing inference for structured prediction with Conditional Random Fields (CRFs). With such CNN message estimators, we obviate the need to learn or evaluate potential functions for message calculation. This confers significant efficiency for learning, since otherwise when performing structured learning for a CRF with CNN potentials it is necessary to undertake expensive inference for every stochastic gradient iteration. The network output dimension for message estimation is the same as the number of classes, in contrast to the network output for general CNN potential functions in CRFs, which is exponential in the order of the potentials. Hence CNN message learning has fewer network parameters and is more scalable for cases that a large number of classes are involved. We apply our method to semantic image segmentation on the PASCAL VOC 2012 dataset. We achieve an intersection-over-union score of 73.4 on its test set, which is the best reported result for methods using the VOC training images alone. This impressive performance demonstrates the effectiveness and usefulness of our CNN message learning method.

📄 PDF Abstract BibTeX arXiv:1506.02108

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationSemantic SegmentationStructured Prediction

Methods 이 논문이 사용한 방법론

CRF Conditional Random Fields or CRFs are a type of probabilistic graph model that take neighboring sample context into account for tasks like classification. Prediction is…

Similar Papers 제목 키워드 기반

Passing Expectation Propagation Messages with Kernel Methods

2015-01-02 · Wittawat Jitkrittum, Arthur Gretton, Nicolas Heess

We propose to learn a kernel-based message operator which takes as input all expectation propagation (EP) incoming messages to a factor node and produces an outgoing message. In ordinary EP, computing an outgoing message…

Consensus Message Passing for Layered Graphical Models

2014-10-27 · Varun Jampani, S. M. Ali Eslami, Daniel Tarlow, Pushmeet Kohli 외

Generative models provide a powerful framework for probabilistic reasoning. However, in many domains their use has been hampered by the practical difficulties of inference. This is particularly the case in computer visio…

Hybrid Message Passing With Performance-Driven Structures for Facial Action Unit Detection

2021-06-19 · CVPR 2021 1 · Tengfei Song, Zijun Cui, Wenming Zheng, Qiang Ji

Message passing neural network has been an effective method to represent dependencies among nodes by propagating messages. However, most of message passing algorithms focus on one structure and the messages are estim…

Action Unit DetectionFacial Action Unit Detection

Neural-Symbolic Message Passing with Dynamic Pruning

2025-01-24 · Chongzhi Zhang, Junhao Zheng, Zhiping Peng, Qianli Ma

Complex Query Answering (CQA) over incomplete Knowledge Graphs (KGs) is a challenging task. Recently, a line of message-passing-based research has been proposed to solve CQA. However, they perform unsatisfactorily on neg…

Complex Query AnsweringKnowledge Graphs

A residual-based message passing algorithm for constraint satisfaction problems

2022-02-25 · Chun-Yan Zhao, Yan-Rong Fu, Jin-Hua Zhao

Message passing algorithms, whose iterative nature captures well complicated interactions among interconnected variables in complex systems and extracts information from the fixed point of iterated messages, provide a po…