paper-with-me

Papers

Audio Captioning Transformer

2021-07-21 · Xinhao Mei, Xubo Liu, Qiushi Huang, Mark D. Plumbley, Wenwu Wang

Audio captioning aims to automatically generate a natural language description of an audio clip. Most captioning models follow an encoder-decoder architecture, where the decoder predicts words based on the audio features extracted by the encoder. Convolutional neural networks (CNNs) and recurrent neural networks (RNNs) are often used as the audio encoder. However, CNNs can be limited in modelling temporal relationships among the time frames in an audio signal, while RNNs can be limited in modelling the long-range dependencies among the time frames. In this paper, we propose an Audio Captioning Transformer (ACT), which is a full Transformer network based on an encoder-decoder architecture and is totally convolution-free. The proposed method has a better ability to model the global information within an audio signal as well as capture temporal relationships between audio events. We evaluate our model on AudioCaps, which is the largest audio captioning dataset publicly available. Our model shows competitive performance compared to other state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2107.09817

Code (1)

XinhaoMei/ACT 공식 구현 pytorch

Tasks

AudioCapsAudio captioningDecoderRetrieval-augmented Few-shot In-context Audio Captioning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Audio Difference Captioning Utilizing Similarity-Discrepancy Disentanglement

2023-08-23 · Daiki Takeuchi, Yasunori Ohishi, Daisuke Niizumi, Noboru Harada 외

We proposed Audio Difference Captioning (ADC) as a new extension task of audio captioning for describing the semantic differences between input pairs of similar but slightly different audio clips. The ADC solves the prob…

Audio captioningDisentanglement

WaveTransformer: A Novel Architecture for Audio Captioning Based on Learning Temporal and Time-Frequency Information

2020-10-21 · An Tran, Konstantinos Drossos, Tuomas Virtanen

Automated audio captioning (AAC) is a novel task, where a method takes as an input an audio sample and outputs a textual description (i.e. a caption) of its contents. Most AAC methods are adapted from from image captioni…

Audio captioningDecoderImage CaptioningMachine Translation+1

A Whisper transformer for audio captioning trained with synthetic captions and transfer learning

2023-05-15 · Marek Kadlčík, Adam Hájek, Jürgen Kieslich, Radosław Winiecki

The field of audio captioning has seen significant advancements in recent years, driven by the availability of large-scale audio datasets and advancements in deep learning techniques. In this technical report, we present…

Audio captioningSpeech-to-TextTransfer Learning

A Transformer-based Audio Captioning Model with Keyword Estimation

2020-07-01 · Yuma Koizumi, Ryo Masumura, Kyosuke Nishida, Masahiro Yasuda 외

One of the problems with automated audio captioning (AAC) is the indeterminacy in word selection corresponding to the audio event/scene. Since one acoustic event/scene can be described with several words, it results in a…

Acoustic Scene ClassificationAudio captioningEvent DetectionScene Classification

Dual Transformer Decoder based Features Fusion Network for Automated Audio Captioning

2023-05-30 · Jianyuan Sun, Xubo Liu, Xinhao Mei, Volkan Kılıç 외

Automated audio captioning (AAC) which generates textual descriptions of audio content. Existing AAC models achieve good results but only use the high-dimensional representation of the encoder. There is always insufficie…

Audio captioningDecoder