paper-with-me

홈 › Papers

UVid-Net: Enhanced Semantic Segmentation of UAV Aerial Videos by Embedding Temporal Information

2020-11-29 · Girisha S, Ujjwal Verma, Manohara Pai M M, Radhika Pai

Semantic segmentation of aerial videos has been extensively used for decision making in monitoring environmental changes, urban planning, and disaster management. The reliability of these decision support systems is dependent on the accuracy of the video semantic segmentation algorithms. The existing CNN based video semantic segmentation methods have enhanced the image semantic segmentation methods by incorporating an additional module such as LSTM or optical flow for computing temporal dynamics of the video which is a computational overhead. The proposed research work modifies the CNN architecture by incorporating temporal information to improve the efficiency of video semantic segmentation. In this work, an enhanced encoder-decoder based CNN architecture (UVid-Net) is proposed for UAV video semantic segmentation. The encoder of the proposed architecture embeds temporal information for temporally consistent labelling. The decoder is enhanced by introducing the feature-refiner module, which aids in accurate localization of the class labels. The proposed UVid-Net architecture for UAV video semantic segmentation is quantitatively evaluated on extended ManipalUAVid dataset. The performance metric mIoU of 0.79 has been observed which is significantly greater than the other state-of-the-art algorithms. Further, the proposed work produced promising results even for the pre-trained model of UVid-Net on urban street scene with fine tuning the final layer on UAV aerial videos.

📄 PDF Abstract BibTeX arXiv:2011.14284

Code (1)

uverma/ManipalUAVid 공식 구현

Tasks

Aerial Video Semantic SegmentationDecision MakingDecoderManagementOptical Flow EstimationSegmentationSemantic SegmentationVideo Semantic Segmentation

Methods 이 논문이 사용한 방법론

Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
U-Net 설명 없음
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

A Multimodal Sentiment Dataset for Video Recommendation

2021-09-17 · Hongxuan Tang, Hao liu, Xinyan Xiao, Hua Wu

Recently, multimodal sentiment analysis has seen remarkable advance and a lot of datasets are proposed for its development. In general, current multimodal sentiment analysis datasets usually follow the traditional system…

Multimodal Sentiment AnalysisSentiment AnalysisVideo Understanding

HuViDPO:Enhancing Video Generation through Direct Preference Optimization for Human-Centric Alignment

2025-02-02 · Lifan Jiang, Boxi Wu, Jiahui Zhang, Xiaotong Guan 외

With the rapid development of AIGC technology, significant progress has been made in diffusion model-based technologies for text-to-image (T2I) and text-to-video (T2V). In recent years, a few studies have introduced the …

Video Generation

Hierarchical Deep Co-segmentation of Primary Objects in Aerial Videos

2018-06-27 · Jia Li, Pengcheng Yuan, Daxin Gu, Yonghong Tian

Primary object segmentation plays an important role in understanding videos generated by unmanned aerial vehicles. In this paper, we propose a large-scale dataset with 500 aerial videos and manually annotated primary obj…

SegmentationSemantic Segmentation

Aerial Lifting: Neural Urban Semantic and Building Instance Lifting from Aerial Imagery

2024-03-18 · CVPR 2024 1 · Yuqi Zhang, GuanYing Chen, Jiaxing Chen, Shuguang Cui

We present a neural radiance field method for urban-scale semantic and building-level instance segmentation from aerial images by lifting noisy 2D labels to 3D. This is a challenging problem due to two primary reasons. F…

Instance SegmentationNeRFNovel View SynthesisSegmentation+1

EduVidQA: Generating and Evaluating Long-form Answers to Student Questions based on Lecture Videos

2025-09-28 · Sourjyadip Ray, Shubham Sharma, Somak Aditya, Pawan Goyal arxiv

As digital platforms redefine educational paradigms, ensuring interactivity remains vital for effective learning. This paper explores using Multimodal Large Language Models (MLLMs) to automatically respond to student que…

Question Answering