paper-with-me

홈 › Papers

Selfie Detection by Synergy-Constraint Based Convolutional Neural Network

2016-11-14 · Yashas Annadani, Vijayakrishna Naganoor, Akshay Kumar Jagadish, Krishnan Chemmangat

Categorisation of huge amount of data on the multimedia platform is a crucial task. In this work, we propose a novel approach to address the subtle problem of selfie detection for image database segregation on the web, given rapid rise in number of selfies clicked. A Convolutional Neural Network (CNN) is modeled to learn a synergy feature in the common subspace of head and shoulder orientation, derived from Local Binary Pattern (LBP) and Histogram of Oriented Gradients (HOG) features respectively. This synergy was captured by projecting the aforementioned features using Canonical Correlation Analysis (CCA). We show that the resulting network's convolutional activations in the neighbourhood of spatial keypoints captured by SIFT are discriminative for selfie-detection. In general, proposed approach aids in capturing intricacies present in the image data and has the potential for usage in other subtle image analysis scenarios apart from just selfie detection. We investigate and analyse the performance of popular CNN architectures (GoogleNet, AlexNet), used for other image classification tasks, when subjected to the task of detecting the selfies on the multimedia platform. The results of the proposed approach are compared with these popular architectures on a dataset of ninety thousand images comprising of roughly equal number of selfies and non-selfies. Experimental results on this dataset shows the effectiveness of the proposed approach.

📄 PDF Abstract BibTeX arXiv:1611.04357

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage Classification

Similar Papers 제목 키워드 기반

Unselfie: Translating Selfies to Neutral-pose Portraits in the Wild

2020-07-29 · ECCV 2020 8 · Liqian Ma, Zhe Lin, Connelly Barnes, Alexei A. Efros 외

Due to the ubiquity of smartphones, it is popular to take photos of one's self, or "selfies." Such photos are convenient to take, because they do not require specialized equipment or a third-party photographer. However, …

Self-Supervised Learning

Selfie: Self-supervised Pretraining for Image Embedding

2019-06-07 · Trieu H. Trinh, Minh-Thang Luong, Quoc V. Le

We introduce a pretraining technique called Selfie, which stands for SELFie supervised Image Embedding. Selfie generalizes the concept of masked language modeling of BERT (Devlin et al., 2019) to continuous data, such as…

Language ModelingLanguage ModellingMasked Language Modeling

Fun Selfie Filters in Face Recognition: Impact Assessment and Removal

2022-02-12 · Cristian Botezatu, Mathias Ibsen, Christian Rathgeb, Christoph Busch

This work investigates the impact of fun selfie filters, which are frequently used to modify selfies, on face recognition systems. Based on a qualitative assessment and classification of freely available mobile applicati…

Face DetectionFace Recognition

Recent advances in the Self-Referencing Embedding Strings (SELFIES) library

2023-02-07 · Alston Lo, Robert Pollice, AkshatKumar Nigam, Andrew D. White 외

String-based molecular representations play a crucial role in cheminformatics applications, and with the growing success of deep learning in chemistry, have been readily adopted into machine learning pipelines. However, …

Real-Time Selfie Video Stabilization

2020-09-04 · CVPR 2021 1 · Jiyang Yu, Ravi Ramamoorthi, Keli Cheng, Michel Sarkis 외

We propose a novel real-time selfie video stabilization method. Our method is completely automatic and runs at 26 fps. We use a 1D linear convolutional network to directly infer the rigid moving least squares warping whi…

Video Stabilization