Hierarchical approach to classify food scenes in egocentric photo-streams
Recent studies have shown that the environment where people eat can affect their nutritional behaviour. In this work, we provide automatic tools for a personalised analysis of a person's health habits by the examination of daily recorded egocentric photo-streams. Specifically, we propose a new automatic approach for the classification of food-related environments, that is able to classify up to 15 such scenes. In this way, people can monitor the context around their food intake in order to get an objective insight into their daily eating routine. We propose a model that classifies food-related scenes organized in a semantic hierarchy. Additionally, we present and make available a new egocentric dataset composed of more than 33000 images recorded by a wearable camera, over which our proposed model has been tested. Our approach obtains an accuracy and F-score of 56\% and 65\%, respectively, clearly outperforming the baseline methods.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
MACNet: Multi-scale Atrous Convolution Networks for Food Places Classification in Egocentric Photo-streams
First-person (wearable) camera continually captures unscripted interactions of the camera user with objects, people, and scenes reflecting his personal and relational tendencies. One of the preferences of people is their…
General ClassificationEating Habits Discovery in Egocentric Photo-streams
Eating habits are learned throughout the early stages of our lives. However, it is not easy to be aware of how our food-related routine affects our healthy living. In this work, we address the unsupervised discovery of n…
Dynamic Time Warpingimage-classificationImage ClassificationRecognition of Multiple Food Items in a Single Photo for Use in a Buffet-Style Restaurant
We investigate image recognition of multiple food items in a single photo, focusing on a buffet restaurant application, where menu changes at every meal, and only a few images per class are available. After detecting foo…
Detecting Korean Food Using Image using Hierarchical Model
A solution was made available for Korean Food lovers who have dietary restrictions to identify the Korean food before consuming. Just by uploading a clear photo of the dish, people can get to know what they are eating. I…
modelTowards social pattern characterization in egocentric photo-streams
Following the increasingly popular trend of social interaction analysis in egocentric vision, this manuscript presents a comprehensive study for automatic social pattern characterization of a wearable photo-camera user, …
DiversityTime SeriesTime Series Analysis