paper-with-me

Papers

Millisecond insect tracking system

2020-02-27

Animals such as insects have provided a rich source of inspiration for designing robots. For example, animals navigate to goals via efficient coordination of individual motor actions, and demonstrate natural solutions to problems also faced by engineers. Recording individual body part positions during large scale movement would therefore be useful. Such multi-scale observations, however, are challenging. With video, for example, there is typically a trade-off between the volume over which an animal can be recorded and spatial resolution within the volume. Even with high pixel-count cameras, motion blur can be a challenge when using available light. Here we present a new approach for tracking animals, such as insects, with an optical system that bypasses this tradeoff by actively pointing a telephoto video camera at the animal. This system is based around high-speed pan-tilt mirrors which steer an optical path shared by a quadrant photodiode and a high-resolution, high-speed telephoto video recording system. The mirror is directed to lock on to the image of a 25-milligram retroreflector worn by the animal. This system allows high-magnification videography with reduced motion blur over a large tracking volume. With our prototype, we obtained millisecond order closed-loop latency and recorded videos of flying insects in a tracking volume extending to an axial distance of 3 meters and horizontally and vertically by 40 degrees. The system offers increased capabilities compared to other video recording solutions and may be useful for the study of animal behavior and the design of bio-inspired robots.

📄 PDF Abstract BibTeX arXiv:2002.12100

Code (1)

strawlab/msectrax 공식 구현

Tasks

Navigate

Similar Papers 제목 키워드 기반

Spatial Monitoring and Insect Behavioural Analysis Using Computer Vision for Precision Pollination

2022-05-10 · Malika Nisal Ratnayake, Don Chathurika Amarathunga, Asaduz Zaman, Adrian G. Dyer 외

Insects are the most important global pollinator of crops and play a key role in maintaining the sustainability of natural ecosystems. Insect pollination monitoring and management are therefore essential for improving cr…

Edge-computingMulti-Object Tracking

FLIVVER: Fly Lobula Inspired Visual Velocity Estimation & Ranging

2020-04-10 · Bryson Lingenfelter, Arunava Nag, Floris van Breugel

The mechanism by which a tiny insect or insect-sized robot could estimate its absolute velocity and distance to nearby objects remains unknown. However, this ability is critical for behaviors that require estimating wind…

Simultaneous Localization and MappingState Estimation

Swarm behavior tracking based on a deep vision algorithm

2022-04-07 · Meihong Wu, Xiaoyan Cao, Shihui Guo

The intelligent swarm behavior of social insects (such as ants) springs up in different environments, promising to provide insights for the study of embodied intelligence. Researching swarm behavior requires that researc…

object-detectionObject Detection

A machine learning pipeline for automated insect monitoring

2024-06-18 · Aditya Jain, Fagner Cunha, Michael Bunsen, Léonard Pasi 외

Climate change and other anthropogenic factors have led to a catastrophic decline in insects, endangering both biodiversity and the ecosystem services on which human society depends. Data on insect abundance, however, re…

object-detectionObject Detection

Aerobatic maneuvers in insect-scale flapping-wing aerial robots via deep-learned robust tube model predictive control

2025-08-05 · Yi-Hsuan Hsiao, Andrea Tagliabue, Owen Matteson, Suhan Kim 외 arxiv

Aerial insects exhibit highly agile maneuvers such as sharp braking, saccades, and body flips under disturbance. In contrast, insect-scale aerial robots are limited to tracking non-aggressive trajectories with small body…