A Multi-oriented Chinese Keyword Spotter Guided by Text Line Detection

2020-01-03 · Pei Xu, Shan Huang, Hongzhen Wang, Hao Song, Shen Huang, Qi Ju

Chinese keyword spotting is a challenging task as there is no visual blank for Chinese words. Different from English words which are split naturally by visual blanks, Chinese words are generally split only by semantic information. In this paper, we propose a new Chinese keyword spotter for natural images, which is inspired by Mask R-CNN. We propose to predict the keyword masks guided by text line detection. Firstly, proposals of text lines are generated by Faster R-CNN;Then, text line masks and keyword masks are predicted by segmentation in the proposals. In this way, the text lines and keywords are predicted in parallel. We create two Chinese keyword datasets based on RCTW-17 and ICPR MTWI2018 to verify the effectiveness of our method.

📄 PDF Abstract BibTeX arXiv:2001.00722

Code (0)

등록된 구현이 없습니다.

Tasks

Keyword Spotting Line Detection

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition

2022-03-19 · CVPR 2022 1 · Mingxin Huang, Yuliang Liu, Zhenghao Peng, Chongyu Liu 외

End-to-end scene text spotting has attracted great attention in recent years due to the success of excavating the intrinsic synergy of the scene text detection and recognition. However, recent state-of-the-art methods us…

Scene Text Detection Text Detection Text Spotting

Feature learning for efficient ASR-free keyword spotting in low-resource languages

2021-08-13 · Ewald van der Westhuizen, Herman Kamper, Raghav Menon, John Quinn 외

We consider feature learning for efficient keyword spotting that can be applied in severely under-resourced settings. The objective is to support humanitarian relief programmes by the United Nations in parts of Africa in…

Dynamic Time Warping Humanitarian Keyword Spotting

WordCraft: Scaffolding the Keyword Method for L2 Vocabulary Learning with Multimodal LLMs

2026-01-31 · Yuheng Shao, Junjie Xiong, Chaoran Wu, Xiyuan Wang 외 arxiv

Applying the keyword method for vocabulary memorization remains a significant challenge for L1 Chinese-L2 English learners. They frequently struggle to generate phonologically appropriate keywords, construct coherent ass…

Fast ASR-free and almost zero-resource keyword spotting using DTW and CNNs for humanitarian monitoring

2018-06-25 · Raghav Menon, Herman Kamper, John Quinn, Thomas Niesler

We use dynamic time warping (DTW) as supervision for training a convolutional neural network (CNN) based keyword spotting system using a small set of spoken isolated keywords. The aim is to allow rapid deployment of a ke…

Dynamic Time Warping Humanitarian Keyword Spotting Template Matching

Benchmarking Keyword Spotting Efficiency on Neuromorphic Hardware

2018-12-04 · Peter Blouw, Xuan Choo, Eric Hunsberger, Chris Eliasmith

Using Intel's Loihi neuromorphic research chip and ABR's Nengo Deep Learning toolkit, we analyze the inference speed, dynamic power consumption, and energy cost per inference of a two-layer neural network keyword spotter…

Benchmarking CPU GPU Keyword Spotting