Deep Neural Network Architecture Search for Accurate Visual Pose Estimation aboard Nano-UAVs
Miniaturized autonomous unmanned aerial vehicles (UAVs) are an emerging and trending topic. With their form factor as big as the palm of one hand, they can reach spots otherwise inaccessible to bigger robots and safely operate in human surroundings. The simple electronics aboard such robots (sub-100mW) make them particularly cheap and attractive but pose significant challenges in enabling onboard sophisticated intelligence. In this work, we leverage a novel neural architecture search (NAS) technique to automatically identify several Pareto-optimal convolutional neural networks (CNNs) for a visual pose estimation task. Our work demonstrates how real-life and field-tested robotics applications can concretely leverage NAS technologies to automatically and efficiently optimize CNNs for the specific hardware constraints of small UAVs. We deploy several NAS-optimized CNNs and run them in closed-loop aboard a 27-g Crazyflie nano-UAV equipped with a parallel ultra-low power System-on-Chip. Our results improve the State-of-the-Art by reducing the in-field control error of 32% while achieving a real-time onboard inference-rate of ~10Hz@10mW and ~50Hz@90mW.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural Architecture SearchPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Depth Estimation Algorithm Based on Transformer-Encoder and Feature Fusion
This research presents a novel depth estimation algorithm based on a Transformer-encoder architecture, tailored for the NYU and KITTI Depth Dataset. This research adopts a transformer model, initially renowned for its su…
Depth EstimationSSIMVHS: High-Resolution Iterative Stereo Matching with Visual Hull Priors
We present a stereo-matching method for depth estimation from high-resolution images using visual hulls as priors, and a memory-efficient technique for the correlation computation. Our method uses object masks extracted …
Depth EstimationDisparity EstimationStereo MatchingVision6D: 3D-to-2D Interactive Visualization and Annotation Tool for 6D Pose Estimation
Accurate 6D pose estimation has gained more attention over the years for robotics-assisted tasks that require precise interaction with physical objects. This paper presents an interactive 3D-to-2D visualization and annot…
6D Pose EstimationPose EstimationCan You Trust Your Pose? Confidence Estimation in Visual Localization
Camera pose estimation in large-scale environments is still an open question and, despite recent promising results, it may still fail in some situations. The research so far has focused on improving subcomponents of esti…
Autonomous NavigationCamera Pose EstimationOpen-Ended Question AnsweringPose Estimation+1Advancing 6D Pose Estimation in Augmented Reality -- Overcoming Projection Ambiguity with Uncontrolled Imagery
This study addresses the challenge of accurate 6D pose estimation in Augmented Reality (AR), a critical component for seamlessly integrating virtual objects into real-world environments. Our research primarily addresses …
6D Pose EstimationPose Estimation