paper-with-me

Papers

Top-Down Learning for Structured Labeling with Convolutional Pseudoprior

2015-11-23 · Saining Xie, Xun Huang, Zhuowen Tu

Current practice in convolutional neural networks (CNN) remains largely bottom-up and the role of top-down process in CNN for pattern analysis and visual inference is not very clear. In this paper, we propose a new method for structured labeling by developing convolutional pseudo-prior (ConvPP) on the ground-truth labels. Our method has several interesting properties: (1) compared with classical machine learning algorithms like CRFs and Structural SVM, ConvPP automatically learns rich convolutional kernels to capture both short- and long- range contexts; (2) compared with cascade classifiers like Auto-Context, ConvPP avoids the iterative steps of learning a series of discriminative classifiers and automatically learns contextual configurations; (3) compared with recent efforts combing CNN models with CRFs and RNNs, ConvPP learns convolution in the labeling space with much improved modeling capability and less manual specification; (4) compared with Bayesian models like MRFs, ConvPP capitalizes on the rich representation power of convolution by automatically learning priors built on convolutional filters. We accomplish our task using pseudo-likelihood approximation to the prior under a novel fixed-point network structure that facilitates an end-to-end learning process. We show state-of-the-art results on sequential labeling and image labeling benchmarks.

📄 PDF Abstract BibTeX arXiv:1511.07409

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Unstructured point cloud semantic labelingusing deep segmentation networks

2017-04-23 · Eurographics 3DOR 2017 2017 4 · A. Boulch, B. Le Saux and N. Audebert

In this work, we describe a new, general, and efficient method for unstructured point cloud labeling. As the question of efficiently using deep Convolutional Neural Networks (CNNs) on 3D data is still a pending issue, we…

Semantic Segmentation

Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network

2018-07-30 · Yongcheng Liu, Bin Fan, Lingfeng Wang, Jun Bai 외

Semantic labeling for very high resolution (VHR) images in urban areas, is of significant importance in a wide range of remote sensing applications. However, many confusing manmade objects and intricate fine-structured o…

Multi-Objective Convolutional Learning for Face Labeling

2015-06-01 · CVPR 2015 6 · Sifei Liu, Jimei Yang, Chang Huang, Ming-Hsuan Yang

This paper formulates face labeling as a conditional random field with unary and pairwise classifiers. We develop a novel multi-objective learning method that optimizes a single unified deep convolutional network with tw…

Sequence Labeling Approach to the Task of Sentence Boundary Detection

2020-01-20 · ICMLSC 2020: Proceedings of the 4th International Conference on Machine Learning and Soft Computing 2020 1 · The Anh Le

One of the keys to enable chatbots to communicate with human in a more natural way is the ability to handle long and complex user's utterances. In order to achieve this goal, we propose to integrate the Sentence Boundary…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Boundary DetectionChatbot+11

An Exploration of Arbitrary-Order Sequence Labeling via Energy-Based Inference Networks

2020-10-06 · EMNLP 2020 11 · Lifu Tu, Tianyu Liu, Kevin Gimpel

Many tasks in natural language processing involve predicting structured outputs, e.g., sequence labeling, semantic role labeling, parsing, and machine translation. Researchers are increasingly applying deep representatio…

Machine TranslationRepresentation LearningSemantic Role LabelingTranslation