paper-with-me

홈 › Papers

Effective Audio Classification Network Based on Paired Inverse Pyramid Structure and Dense MLP Block

2022-11-05 · Yunhao Chen, Yunjie Zhu, Zihui Yan, Yifan Huang, Zhen Ren, Jianlu Shen, Lifang Chen

Recently, massive architectures based on Convolutional Neural Network (CNN) and self-attention mechanisms have become necessary for audio classification. While these techniques are state-of-the-art, these works' effectiveness can only be guaranteed with huge computational costs and parameters, large amounts of data augmentation, transfer from large datasets and some other tricks. By utilizing the lightweight nature of audio, we propose an efficient network structure called Paired Inverse Pyramid Structure (PIP) and a network called Paired Inverse Pyramid Structure MLP Network (PIPMN). The PIPMN reaches 96\% of Environmental Sound Classification (ESC) accuracy on the UrbanSound8K dataset and 93.2\% of Music Genre Classification (MGC) on the GTAZN dataset, with only 1 million parameters. Both of the results are achieved without data augmentation or model transfer. Public code is available at: https://github.com/JNAIC/PIPMN

📄 PDF Abstract BibTeX arXiv:2211.02940

Code (1)

JNAIC/PIPMN 공식 구현 pytorch

Tasks

Audio ClassificationClassificationData AugmentationEnvironmental Sound ClassificationGenre classificationMusic Genre ClassificationSound Classification

Similar Papers 제목 키워드 기반

MM-Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing

2021-11-24 · Jiashuo Yu, Ying Cheng, Rui-Wei Zhao, Rui Feng 외

Recognizing and localizing events in videos is a fundamental task for video understanding. Since events may occur in auditory and visual modalities, multimodal detailed perception is essential for complete scene comprehe…

audio-visual event localizationVideo Understanding

Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion

2024-07-15 · Jian Ma, Wenguan Wang, Yi Yang, Feng Zheng

Visual acoustic matching (VAM) is pivotal for enhancing the immersive experience, and the task of dereverberation is effective in improving audio intelligibility. Existing methods treat each task independently, overlooki…

Kernel Inversed Pyramidal Resizing Network for Efficient Pavement Distress Recognition

2022-12-04 · Rong Qin, Luwen Huangfu, Devon Hood, James Ma 외

Pavement Distress Recognition (PDR) is an important step in pavement inspection and can be powered by image-based automation to expedite the process and reduce labor costs. Pavement images are often in high-resolution wi…

image-classificationImage Classification

Helsinki Speech Challenge 2024

2024-06-06 · Martin Ludvigsen, Elli Karvonen, Markus Juvonen, Samuli Siltanen

The Helsinki Speech Challenge 2024 (HSC2024) invites researchers to enhance and deconvolve speech audio recordings. We recorded a dataset that challenges participants to apply speech enhancement and inverse problems tech…

Speech Enhancementspeech-recognitionSpeech Recognition

Pyramid Fusion Transformer for Semantic Segmentation

2022-01-11 · Zipeng Qin, Jianbo Liu, Xiaolin Zhang, Maoqing Tian 외

The recently proposed MaskFormer gives a refreshed perspective on the task of semantic segmentation: it shifts from the popular pixel-level classification paradigm to a mask-level classification method. In essence, it ge…

DecoderSegmentationSemantic Segmentation