Papers Small Language Model
“Small Language Model” 태그가 달린 논문 109편 · 필터 해제
Domain Adaptation for Code Model-based Unit Test Case Generation
Recently, deep learning-based test case generation approaches have been proposed to automate the generation of unit test cases. In this study, we leverage Transformer-based code models to generate unit tests with the hel…
Domain AdaptationLanguage ModellingSmall Language ModelQuery Rewriting for Retrieval-Augmented Large Language Models
Large Language Models (LLMs) play powerful, black-box readers in the retrieve-then-read pipeline, making remarkable progress in knowledge-intensive tasks. This work introduces a new framework, Rewrite-Retrieve-Read inste…
Language ModelingLanguage ModellingMultiple-choiceRetrieval+1SLaDe: A Portable Small Language Model Decompiler for Optimized Assembly
Decompilation is a well-studied area with numerous high-quality tools available. These are frequently used for security tasks and to port legacy code. However, they regularly generate difficult-to-read programs and requi…
Language ModelingLanguage ModellingLarge Language ModelSmall Language ModelPiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMs
Large language models (LLMs) have shown great abilities of solving various natural language tasks in different domains. Due to the training objective of LLMs and their pre-training data, LLMs are not very well equipped f…
Data AugmentationGraph GenerationLanguage ModelingLanguage Modelling+1FLAME: A small language model for spreadsheet formulas
Spreadsheets are a vital tool for end-user data management. Using large language models for formula authoring assistance in these environments can be difficult, as these models are expensive to train and challenging to d…
Language ModelingLanguage ModellingManagementRetrieval+1Perplexed by Quality: A Perplexity-based Method for Adult and Harmful Content Detection in Multilingual Heterogeneous Web Data
As demand for large corpora increases with the size of current state-of-the-art language models, using web data as the main part of the pre-training corpus for these models has become a ubiquitous practice. This, in turn…
Language ModellingSmall Language ModelThe Birth of Bias: A case study on the evolution of gender bias in an English language model
Detecting and mitigating harmful biases in modern language models are widely recognized as crucial, open problems. In this paper, we take a step back and investigate how language models come to be biased in the first pla…
Language ModelingLanguage ModellingSemantic Textual SimilaritySmall Language ModelSiamese BERT-based Model for Web Search Relevance Ranking Evaluated on a New Czech Dataset
Web search engines focus on serving highly relevant results within hundreds of milliseconds. Pre-trained language transformer models such as BERT are therefore hard to use in this scenario due to their high computational…
Document RankingLanguage ModelingSmall Language ModelFast and Robust Unsupervised Contextual Biasing for Speech Recognition
Automatic speech recognition (ASR) system is becoming a ubiquitous technology. Although its accuracy is closing the gap with that of human level under certain settings, one area that can further improve is to incorporate…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+3