Representation Learning on Event Stream via an Elastic Net-incorporated Tensor Network
Event cameras are neuromorphic sensors that capture asynchronous and sparse event stream when per-pixel brightness changes. The state-of-the-art processing methods for event signals typically aggregate events into a frame or a grid. However, events are dense in time, these works are limited to local information of events due to the stacking. In this paper, we present a novel spatiotemporal representation learning method which can capture the global correlations of all events in the event stream simultaneously by tensor decomposition. In addition, with the events are sparse in space, we propose an Elastic Net-incorporated tensor network (ENTN) model to obtain more spatial and temporal details about event stream. Empirically, the results indicate that our method can represent the spatiotemporal correlation of events with high quality, and can achieve effective results in applications like filtering noise compared with the state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningTensor DecompositionSimilar Papers 제목 키워드 기반
NeST: Neural Stress Tensor Tomography by leveraging 3D Photoelasticity
Photoelasticity enables full-field stress analysis in transparent objects through stress-induced birefringence. Existing techniques are limited to 2D slices and require destructively slicing the object. Recovering the in…
ObjectTransparent objectsVideoScaffold: Elastic-Scale Visual Hierarchies for Streaming Video Understanding in MLLMs
Understanding long videos with multimodal large language models (MLLMs) remains challenging due to the heavy redundancy across frames and the need for temporally coherent representations. Existing static strategies, such…
Event SegmentationThe Role of "Live" in Livestreaming Markets: Evidence Using Orthogonal Random Forest
A common belief about the growing medium of livestreaming is that its value lies in its "live" component. We examine this belief by comparing how the price elasticity of demand for live events varies before, on the day o…
Heterogeneous Treatment Effect EstimationTensor Basis Gaussian Process Models of Hyperelastic Materials
In this work, we develop Gaussian process regression (GPR) models of hyperelastic material behavior. First, we consider the direct approach of modeling the components of the Cauchy stress tensor as a function of the comp…
GPRPhysics-informed machine learningExploiting Elasticity in Tensor Ranks for Compressing Neural Networks
Elasticities in depth, width, kernel size and resolution have been explored in compressing deep neural networks (DNNs). Recognizing that the kernels in a convolutional neural network (CNN) are 4-way tensors, we further e…