A Deep Learning Approach for Motion Forecasting Using 4D OCT Data
Forecasting motion of a specific target object is a common problem for surgical interventions, e.g. for localization of a target region, guidance for surgical interventions, or motion compensation. Optical coherence tomography (OCT) is an imaging modality with a high spatial and temporal resolution. Recently, deep learning methods have shown promising performance for OCT-based motion estimation based on two volumetric images. We extend this approach and investigate whether using a time series of volumes enables motion forecasting. We propose 4D spatio-temporal deep learning for end-to-end motion forecasting and estimation using a stream of OCT volumes. We design and evaluate five different 3D and 4D deep learning methods using a tissue data set. Our best performing 4D method achieves motion forecasting with an overall average correlation coefficient of 97.41%, while also improving motion estimation performance by a factor of 2.5 compared to a previous 3D approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningMotion CompensationMotion EstimationMotion ForecastingTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecasting
Widely adopted motion forecasting datasets substitute the observed sensory inputs with higher-level abstractions such as 3D boxes and polylines. These sparse shapes are inferred through annotating the original scenes wit…
Motion ForecastingQML for Argoverse 2 Motion Forecasting Challenge
To safely navigate in various complex traffic scenarios, autonomous driving systems are generally equipped with a motion forecasting module to provide vital information for the downstream planning module. For the real-wo…
Autonomous DrivingMotion ForecastingNavigatePersonalized Pose Forecasting
Human pose forecasting is the task of predicting articulated human motion given past human motion. There exists a number of popular benchmarks that evaluate an array of different models performing human pose forecasting.…
Human Pose ForecastingMotion ForecastingTime SeriesTime Series AnalysisBootstrap Motion Forecasting With Self-Consistent Constraints
We present a novel framework to bootstrap Motion forecasting with Self-consistent Constraints (MISC). The motion forecasting task aims at predicting future trajectories of vehicles by incorporating spatial and temporal i…
Motion ForecastingLearning Cooperative Trajectory Representations for Motion Forecasting
Motion forecasting is an essential task for autonomous driving, and utilizing information from infrastructure and other vehicles can enhance forecasting capabilities. Existing research mainly focuses on leveraging single…
Autonomous DrivingAutonomous VehiclesMotion Forecasting