HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classification
Event-based cameras have recently drawn the attention of the Computer Vision community thanks to their advantages in terms of high temporal resolution, low power consumption and high dynamic range, compared to traditional frame-based cameras. These properties make event-based cameras an ideal choice for autonomous vehicles, robot navigation or UAV vision, among others. However, the accuracy of event-based object classification algorithms, which is of crucial importance for any reliable system working in real-world conditions, is still far behind their frame-based counterparts. Two main reasons for this performance gap are: 1. The lack of effective low-level representations and architectures for event-based object classification and 2. The absence of large real-world event-based datasets. In this paper we address both problems. First, we introduce a novel event-based feature representation together with a new machine learning architecture. Compared to previous approaches, we use local memory units to efficiently leverage past temporal information and build a robust event-based representation. Second, we release the first large real-world event-based dataset for object classification. We compare our method to the state-of-the-art with extensive experiments, showing better classification performance and real-time computation.
Code (1)
Tasks
Autonomous VehiclesClassificationGeneral ClassificationObjectRobot NavigationRobust classificationSimilar Papers 제목 키워드 기반
Locally Adaptive Decay Surfaces for High-Speed Face and Landmark Detection with Event Cameras
Event cameras record luminance changes with microsecond resolution, but converting their sparse, asynchronous output into dense tensors that neural networks can exploit remains a core challenge. Conventional histograms o…
Face DetectionHATSUKI : An anime character like robot figure platform with anime-style expressions and imitation learning based action generation
Japanese character figurines are popular and have pivot position in Otaku culture. Although numerous robots have been developed, less have focused on otaku-culture or on embodying the anime character figurine. Therefore,…
Action GenerationCultural Vocal Bursts Intensity PredictionImitation LearningChatsparent: An Interactive System for Detecting and Mitigating Cognitive Fatigue in LLMs
LLMs are increasingly being deployed as chatbots, but today's interfaces offer little to no friction: users interact through seamless conversations that conceal when the model is drifting, hallucinating or failing. This …
Lossy Event Compression based on Image-derived Quad Trees and Poisson Disk Sampling
With several advantages over conventional RGB cameras, event cameras have provided new opportunities for tackling visual tasks under challenging scenarios with fast motion, high dynamic range, and/or power constraint. Ye…
Event-based visionImage ReconstructionVideo CompressionInvestigation of event-based memory surfaces for high-speed tracking, unsupervised feature extraction and object recognition
In this paper we compare event-based decaying and time based-decaying memory surfaces for high-speed eventbased tracking, feature extraction, and object classification using an event-based camera. The high-speed recognit…
Object Recognition