Papers Small Language Model
“Small Language Model” 태그가 달린 논문 109편 · 필터 해제
CRAVE: A Conflicting Reasoning Approach for Explainable Claim Verification Using LLMs
The rapid spread of misinformation, driven by digital media and AI-generated content, has made automatic claim verification essential. Traditional methods, which depend on expert-annotated evidence, are labor-intensive a…
Claim VerificationLogical ReasoningMisinformationSmall Language ModelSimplifying Data Integration: SLM-Driven Systems for Unified Semantic Queries Across Heterogeneous Databases
The integration of heterogeneous databases into a unified querying framework remains a critical challenge, particularly in resource-constrained environments. This paper presents a novel Small Language Model(SLM)-driven s…
Data IntegrationLanguage ModelingLanguage ModellingQuestion Answering+4Collab-RAG: Boosting Retrieval-Augmented Generation for Complex Question Answering via White-Box and Black-Box LLM Collaboration
Retrieval-Augmented Generation (RAG) systems often struggle to handle multi-hop question-answering tasks accurately due to irrelevant context retrieval and limited complex reasoning capabilities. We introduce Collab-RAG,…
Language ModelingLanguage ModellingLarge Language ModelMulti-hop Question Answering+5Biomedical Question Answering via Multi-Level Summarization on a Local Knowledge Graph
In Question Answering (QA), Retrieval Augmented Generation (RAG) has revolutionized performance in various domains. However, how to effectively capture multi-document relationships, particularly critical for biomedical t…
Language ModelingLanguage ModellingQuestion AnsweringRAG+3Mobile-VideoGPT: Fast and Accurate Video Understanding Language Model
Video understanding models often struggle with high computational requirements, extensive parameter counts, and slow inference speed, making them inefficient for practical use. To tackle these challenges, we propose Mobi…
EgoSchemaLanguage ModelingLanguage ModellingMVBench+2Distil-xLSTM: Learning Attention Mechanisms through Recurrent Structures
The current era of Natural Language Processing (NLP) is dominated by Transformer models. However, novel architectures relying on recurrent mechanisms, such as xLSTM and Mamba, have been proposed as alternatives to attent…
Language ModelingLanguage ModellingLarge Language ModelMamba+1Distributed LLMs and Multimodal Large Language Models: A Survey on Advances, Challenges, and Future Directions
Language models (LMs) are machine learning models designed to predict linguistic patterns by estimating the probability of word sequences based on large-scale datasets, such as text. LMs have a wide range of applications…
2D Object DetectionDistributed ComputingLarge Language ModelMachine Translation+2Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
Understanding and reasoning over non-speech sounds and music are crucial for both humans and AI agents to interact effectively with their environments. In this paper, we introduce Audio Flamingo 2 (AF2), an Audio-Languag…
Audio captioningLanguage ModelingLanguage ModellingQuestion Answering+1ReaderLM-v2: Small Language Model for HTML to Markdown and JSON
We present ReaderLM-v2, a compact 1.5 billion parameter language model designed for efficient web content extraction. Our model processes documents up to 512K tokens, transforming messy HTML into clean Markdown or JSON f…
Language ModelingLanguage ModellingSmall Language ModelBridging the Gap: Enabling Natural Language Queries for NoSQL Databases through Text-to-NoSQL Translation
NoSQL databases have become increasingly popular due to their outstanding performance in handling large-scale, unstructured, and semi-structured data, highlighting the need for user-friendly interfaces to bridge the gap …
Natural Language QueriesRAGRetrieval-augmented GenerationSmall Language ModelTowards Achieving Concept Completeness for Textual Concept Bottleneck Models
Textual Concept Bottleneck Models (TBMs) are interpretable-by-design models for text classification that predict a set of salient concepts before making the final prediction. This paper proposes Complete Textual Concept …
Language ModelingLanguage ModellingSmall Language Modeltext-classification+13D-Grounded Vision-Language Framework for Robotic Task Planning: Automated Prompt Synthesis and Supervised Reasoning
Vision-language models (VLMs) have achieved remarkable success in scene understanding and perception tasks, enabling robots to plan and execute actions adaptively in dynamic environments. However, most multimodal large l…
Code GenerationScene UnderstandingSmall Language ModelTask PlanningSmall Language Model Makes an Effective Long Text Extractor
Named Entity Recognition (NER) is a fundamental problem in natural language processing (NLP). However, the task of extracting longer entity spans (e.g., awards) from extended texts (e.g., homepages) is barely explored. C…
GPULanguage ModelingLanguage Modellingnamed-entity-recognition+4Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training
Small language models (SLMs) have attracted considerable attention from both academia and industry due to their broad range of applications in edge devices. To obtain SLMs with strong performance, conventional approaches…
Language ModelingLanguage ModellingMMLUSmall Language ModelSmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
While large language models have facilitated breakthroughs in many applications of artificial intelligence, their inherent largeness makes them computationally expensive and challenging to deploy in resource-constrained …
Instruction FollowingLanguage ModelingLanguage ModellingMath+1Atla Selene Mini: A General Purpose Evaluation Model
We introduce Atla Selene Mini, a state-of-the-art small language model-as-a-judge (SLMJ). Selene Mini is a general-purpose evaluator that outperforms the best SLMJs and GPT-4o-mini on overall performance across 11 out-of…
Language ModelingLanguage ModellingmodelSmall Language ModelAdaptiveLog: An Adaptive Log Analysis Framework with the Collaboration of Large and Small Language Model
Automated log analysis is crucial to ensure high availability and reliability of complex systems. The advent of LLMs in NLP has ushered in a new era of language model-driven automated log analysis, garnering significant …
In-Context LearningLanguage ModelingLanguage ModellingSmall Language ModelFrom Superficial Patterns to Semantic Understanding: Fine-Tuning Language Models on Contrast Sets
Large-scale pre-trained language models have demonstrated high performance on standard datasets for natural language inference (NLI) tasks. Unfortunately, these evaluations can be misleading, as although the models can p…
Language ModelingLanguage ModellingNatural Language InferenceSmall Language ModelTechnical Report: Small Language Model for Japanese Clinical and Medicine
This report presents a small language model (SLM) for Japanese clinical and medicine, named NCVC-slm-1. This 1B parameters model was trained using Japanese text classified to be of high-quality. Moreover, NCVC-slm-1 was …
Language ModelingLanguage ModellingSmall Language ModelUncertainty-Aware Hybrid Inference with On-Device Small and Remote Large Language Models
This paper studies a hybrid language model (HLM) architecture that integrates a small language model (SLM) operating on a mobile device with a large language model (LLM) hosted at the base station (BS) of a wireless netw…
Language ModelingLanguage ModellingLarge Language ModelSmall Language Model