Papers Fill Mask
“Fill Mask” 태그가 달린 논문 8편 · 필터 해제
CNMBERT: A Model for Converting Hanyu Pinyin Abbreviations to Chinese Characters
The task of converting Hanyu Pinyin abbreviations to Chinese characters is a significant branch within the domain of Chinese Spelling Correction (CSC). It plays an important role in many downstream applications such as n…
fill-maskFill MaskMixture-of-Expertsnamed-entity-recognition+3MAX: Masked Autoencoder for X-ray Fluorescence in Geological Investigation
Pre-training foundation models has become the de-facto procedure for deep learning approaches, yet its application remains limited in the geological studies, where in needs of the model transferability to break the shack…
Fill MaskGeochemistryregressionSelf-Supervised LearningHarvesting Textual and Structured Data from the HAL Publication Repository
HAL (\textit{Hyper Articles en Ligne}) is the French national publication repository, used by most higher education and research organizations for their open science policy. Although it is a rich repository of academic d…
ArticlesAuthorship AttributionContrastive LearningFill Mask+6Iterative Mask Filling: An Effective Text Augmentation Method Using Masked Language Modeling
Data augmentation is an effective technique for improving the performance of machine learning models. However, it has not been explored as extensively in natural language processing (NLP) as it has in computer vision. In…
Data Augmentationfill-maskFill MaskLanguage Modeling+5An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling
Masked visual modeling (MVM) has been recently proven effective for visual pre-training. While similar reconstructive objectives on video inputs (e.g., masked frame modeling) have been explored in video-language (VidL) p…
Fill MaskOptical Flow EstimationQuestion AnsweringRetrieval+8Zero-Shot Video Question Answering via Frozen Bidirectional Language Models
Video question answering (VideoQA) is a complex task that requires diverse multi-modal data for training. Manual annotation of question and answers for videos, however, is tedious and prohibits scalability. To tackle thi…
Fill MaskLanguage ModelingLanguage ModellingMasked Language Modeling+8Efficiently and Thoroughly Anonymizing a Transformer Language Model for Dutch Electronic Health Records: a Two-Step Method
Neural Network (NN) architectures are used more and more to model large amounts of data, such as text data available online. Transformer-based NN architectures have shown to be very useful for language modelling. Althoug…
fill-maskFill MaskLanguage ModelingLanguage ModellingPrompt Tuning or Fine-Tuning - Investigating Relational Knowledge in Pre-Trained Language Models
Extracting relational knowledge from large pre-trained language models by a cloze-style sentence serving as a query has shown promising results. In particular, language models can be queried similar to knowledge graphs. …
fill-maskFill MaskKnowledge GraphsLanguage Modeling+3