Edge-Optimized Vision-Language Models for Underground Infrastructure Assessment
Autonomous inspection of underground infrastructure, such as sewer and culvert systems, is critical to public safety and urban sustainability. Although robotic platforms equipped with visual sensors can efficiently detect structural deficiencies, the automated generation of human-readable summaries from these detections remains a significant challenge, especially on resource-constrained edge devices. This paper presents a novel two-stage pipeline for end-to-end summarization of underground deficiencies, combining our lightweight RAPID-SCAN segmentation model with a fine-tuned Vision-Language Model (VLM) deployed on an edge computing platform. The first stage employs RAPID-SCAN (Resource-Aware Pipeline Inspection and Defect Segmentation using Compact Adaptive Network), achieving 0.834 F1-score with only 0.64M parameters for efficient defect segmentation. The second stage utilizes a fine-tuned Phi-3.5 VLM that generates concise, domain-specific summaries in natural language from the segmentation outputs. We introduce a curated dataset of inspection images with manually verified descriptions for VLM fine-tuning and evaluation. To enable real-time performance, we employ post-training quantization with hardware-specific optimization, achieving significant reductions in model size and inference latency without compromising summarization quality. We deploy and evaluate our complete pipeline on a mobile robotic platform, demonstrating its effectiveness in real-world inspection scenarios. Our results show the potential of edge-deployable integrated AI systems to bridge the gap between automated defect detection and actionable insights for infrastructure maintenance, paving the way for more scalable and autonomous inspection solutions.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
AI-Driven Forecasting and Monitoring of Urban Water System
Underground water and wastewater pipelines are vital for city operations but plagued by anomalies like leaks and infiltrations, causing substantial water loss, environmental damage, and high repair costs. Conventional ma…
Reinforcement Learning-Enabled Reliable Wireless Sensor Networks in Dynamic Underground Environments
Wireless underground sensor networks play an important role in underground sensing such as climate-smart agriculture and underground infrastructure monitoring. Existing works consider a static underground environment, wh…
reinforcement-learningReinforcement Learning (RL)Explaining the Unseen: Multimodal Vision-Language Reasoning for Situational Awareness in Underground Mining Disasters
Underground mining disasters produce pervasive darkness, dust, and collapses that obscure vision and make situational awareness difficult for humans and conventional systems. To address this, we propose MDSE, Multimodal …
Efficient Autonomous Navigation of a Quadruped Robot in Underground Mines on Edge Hardware
Embodied navigation in underground mines faces significant challenges, including narrow passages, uneven terrain, near-total darkness, GPS-denied conditions, and limited communication infrastructure. While recent learnin…
Energy self-sufficient systems for monitoring sewer networks
Underground infrastructure networks form the backbone of vital supply and disposal systems. However, they are under-monitored in comparison to their value. This is due, in large part, to the lack of energy supply for mon…