paper-with-me

홈 › Papers

Collaboratively Weighting Deep and Classic Representation via L2 Regularization for Image Classification

2018-02-21 · Shaoning Zeng, Bob Zhang, Yanghao Zhang, Jianping Gou

Deep convolutional neural networks provide a powerful feature learning capability for image classification. The deep image features can be utilized to deal with many image understanding tasks like image classification and object recognition. However, the robustness obtained in one dataset can be hardly reproduced in the other domain, which leads to inefficient models far from state-of-the-art. We propose a deep collaborative weight-based classification (DeepCWC) method to resolve this problem, by providing a novel option to fully take advantage of deep features in classic machine learning. It firstly performs the L2-norm based collaborative representation on the original images, as well as the deep features extracted by deep CNN models. Then, two distance vectors, obtained based on the pair of linear representations, are fused together via a novel collaborative weight. This collaborative weight enables deep and classic representations to weigh each other. We observed the complementarity between two representations in a series of experiments on 10 facial and object datasets. The proposed DeepCWC produces very promising classification results, and outperforms many other benchmark methods, especially the ones claimed for Fashion-MNIST. The code is going to be published in our public repository.

📄 PDF Abstract BibTeX arXiv:1802.07589

Code (1)

zengsn/research 공식 구현

Tasks

ClassificationGeneral Classificationimage-classificationImage ClassificationL2 RegularizationObject Recognition

Similar Papers 제목 키워드 기반

Marginalized State Distribution Entropy Regularization in Policy Optimization

2019-12-11 · Riashat Islam, Zafarali Ahmed, Doina Precup

Entropy regularization is used to get improved optimization performance in reinforcement learning tasks. A common form of regularization is to maximize policy entropy to avoid premature convergence and lead to more stoch…

continuous-controlContinuous ControlReinforcement Learning

A General Weighting Theory for Ensemble Learning: Beyond Variance Reduction via Spectral and Geometric Structure

2025-12-25 · Ernest Fokoué arxiv

Ensemble learning is traditionally justified as a variance-reduction strategy, explaining its strong performance for unstable predictors such as decision trees. This explanation, however, does not account for ensembles c…

Ensemble Learning

Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation

2021-02-25 · NeurIPS 2021 12 · Kenneth Borup, Lars N. Andersen

Knowledge distillation is classically a procedure where a neural network is trained on the output of another network along with the original targets in order to transfer knowledge between the architectures. The special c…

Knowledge DistillationSelf-Knowledge Distillation

High-Dimensional Kernel Methods under Covariate Shift: Data-Dependent Implicit Regularization

2024-06-05 · Yihang Chen, Fanghui Liu, Taiji Suzuki, Volkan Cevher

This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate …

Patch-Ordering as a Regularization for Inverse Problems in Image Processing

2016-02-26 · Gregory Vaksman, Michael Zibulevsky, Michael Elad

Recent work in image processing suggests that operating on (overlapping) patches in an image may lead to state-of-the-art results. This has been demonstrated for a variety of problems including denoising, inpainting, deb…

DeblurringDenoisingImage DeblurringImage Denoising+3