Visual Vibrometry: Estimating MaterialProperties from Small Motions in Video
The estimation of material properties is important for scene understanding, with many applications in vision, robotics, andstructural engineering. This paper connects fundamentals of vibration mechanics with computer vision techniques in order to infermaterial properties from small, often imperceptible motions in video. Objects tend to vibrate in a set of preferred modes. Thefrequencies of these modes depend on the structure and material properties of an object. We show that by extracting these frequenciesfrom video of a vibrating object, we can often make inferences about that object’s material properties. We demonstrate our approach byestimating material properties for a variety of objects by observing their motion in high-speed and regular frame rate video.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectScene UnderstandingSimilar Papers 제목 키워드 기반
Visual Vibrometry: Estimating Material Properties from Small Motions in Video
The estimation of material properties is important for scene understanding, with many applications in vision, robotics, and structural engineering. This paper connects fundamentals of vibration mechanics w…
Scene UnderstandingVisual Vibrometry: Estimating Material Properties From Small Motion in Video
The estimation of material properties is important for scene understanding, with many applications in vision, robotics, and structural engineering. This paper connects fundamentals of vibration mechanics with computer vi…
Scene UnderstandingHearing the Room Through the Shape of the Drum: Modal-Guided Sound Recovery from Multi-Point Surface Vibrations
Optical vibration sensing enables recovering the scene sound directly from the surface vibration of nearby objects, turning everyday objects into ``visual microphones''. However, most prior methods had focused on capturi…
Compressive Online Robust Principal Component Analysis with Optical Flow for Video Foreground-Background Separation
In the context of online Robust Principle Component Analysis (RPCA) for the video foreground-background separation, we propose a compressive online RPCA with optical flow that separates recursively a sequence of frames i…
Optical Flow EstimationDual-Shutter Optical Vibration Sensing
Visual vibrometry is a highly useful tool for remote capture of audio, as well as the physical properties of materials, human heart rate, and more. While visually-observable vibrations can be captured directly with a…