Visual Anomaly Detection for Reliable Robotic Implantation of Flexible Microelectrode Array
Flexible microelectrode (FME) implantation into brain cortex is challenging due to the deformable fiber-like structure of FME probe and the interaction with critical bio-tissue. To ensure reliability and safety, the implantation process should be monitored carefully. This paper develops an image-based anomaly detection framework based on the microscopic cameras of the robotic FME implantation system. The unified framework is utilized at four checkpoints to check the micro-needle, FME probe, hooking result, and implantation point, respectively. Exploiting the existing object localization results, the aligned regions of interest (ROIs) are extracted from raw image and input to a pretrained vision transformer (ViT). Considering the task specifications, we propose a progressive granularity patch feature sampling method to address the sensitivity-tolerance trade-off issue at different locations. Moreover, we select a part of feature channels with higher signal-to-noise ratios from the raw general ViT features, to provide better descriptors for each specific scene. The effectiveness of the proposed methods is validated with the image datasets collected from our implantation system.
Code (0)
등록된 구현이 없습니다.
Tasks
Object LocalizationAnomaly DetectionSimilar Papers 제목 키워드 기반
An Outlier Exposure Approach to Improve Visual Anomaly Detection Performance for Mobile Robots
We consider the problem of building visual anomaly detection systems for mobile robots. Standard anomaly detection models are trained using large datasets composed only of non-anomalous data. However, in robotics applica…
Anomaly DetectionExplainable Deep Anomaly Detection with Sequential Hypothesis Testing for Robotic Sewer Inspection
Sewer pipe faults, such as leaks and blockages, can lead to severe consequences including groundwater contamination, property damage, and service disruption. Traditional inspection methods rely heavily on the manual revi…
Anomaly DetectionLensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videos
A critical complication after cataract surgery is the dislocation of the lens implant leading to vision deterioration and eye trauma. In order to reduce the risk of this complication, it is vital to discover the risk fac…
SegmentationSemantic SegmentationSurgical phase recognitionAnomaly detection for generic failure monitoring in robotic assembly, screwing and manipulation
Out-of-distribution states in robot manipulation often lead to unpredictable robot behavior or task failure, limiting success rates and increasing risk of damage. Anomaly detection (AD) can identify deviations from expec…
Robot ManipulationAnomaly DetectionKnowledge-Guided Textual Reasoning for Explainable Video Anomaly Detection via LLMs
We introduce Text-based Explainable Video Anomaly Detection (TbVAD), a language-driven framework for weakly supervised video anomaly detection that performs anomaly detection and explanation entirely within the textual d…
Video Anomaly Detection