Papers Language Modelling
“Language Modelling” 태그가 달린 논문 17,662편 · 필터 해제
Smart-LLaMA-DPO: Reinforced Large Language Model for Explainable Smart Contract Vulnerability Detection
Smart contract vulnerability detection remains a major challenge in blockchain security. Existing vulnerability detection methods face two main issues: (1) Existing datasets lack comprehensive coverage and high-quality e…
Language ModelingLanguage ModellingLarge Language ModelVulnerability DetectionGradualDiff-Fed: A Federated Learning Specialized Framework for Large Language Model
The rapid proliferation of large language models (LLMs) has created an unprecedented demand for fine-tuning models for specialized domains, such as medical science. While federated learning (FL) offers a decentralized an…
Federated LearningLanguage ModelingLanguage ModellingLarge Language Model+1A Large Language Model-based Multi-Agent Framework for Analog Circuits' Sizing Relationships Extraction
In the design process of the analog circuit pre-layout phase, device sizing is an important step in determining whether an analog circuit can meet the required performance metrics. Many existing techniques extract the ci…
Language ModelingLanguage ModellingLarge Language ModelPARALLELPROMPT: Extracting Parallelism from Large Language Model Queries
LLM serving systems typically treat user prompts as monolithic inputs, optimizing inference through decoding tricks or inter-query batching. However, many real-world prompts contain latent semantic parallelism--decomposa…
Language ModelingLanguage ModellingLarge Language ModelLeveraging Large Language Model for Intelligent Log Processing and Autonomous Debugging in Cloud AI Platforms
With the increasing complexity and rapid expansion of the scale of AI systems in cloud platforms, the log data generated during system operation is massive, unstructured, and semantically ambiguous, which brings great ch…
Language ModelingLanguage ModellingLarge Language ModelPre-Trained LLM is a Semantic-Aware and Generalizable Segmentation Booster
With the advancement of Large Language Model (LLM) for natural language processing, this paper presents an intriguing finding: a frozen pre-trained LLM layer can process visual tokens for medical image segmentation tasks…
DecoderImage SegmentationLanguage ModelingLanguage Modelling+4ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
Recent advances in multimodal generative models have unlocked photorealistic, instruction-aligned image generation, yet leading systems like GPT-4o-Image remain proprietary and inaccessible. To democratize these capabili…
GPUImage GenerationLanguage ModelingLanguage Modelling+4Research on Model Parallelism and Data Parallelism Optimization Methods in Large Language Model-Based Recommendation Systems
With the rapid adoption of large language models (LLMs) in recommendation systems, the computational and communication bottlenecks caused by their massive parameter sizes and large data volumes have become increasingly p…
Language ModelingLanguage ModellingLarge Language Modelmodel+2Reflective Verbal Reward Design for Pluralistic Alignment
AI agents are commonly aligned with "human values" through reinforcement learning from human feedback (RLHF), where a single reward model is learned from aggregated human feedback and used to align an agent's behavior. H…
Language ModelingLanguage ModellingCan Generated Images Serve as a Viable Modality for Text-Centric Multimodal Learning?
A significant ``modality gap" exists between the abundance of text-only data and the increasing power of multimodal models. This work systematically investigates whether images generated on-the-fly by Text-to-Image (T2I)…
Language ModelingLanguage ModellingLarge Language ModelPrompt Engineering+2Computational Approaches to Understanding Large Language Model Impact on Writing and Information Ecosystems
Large language models (LLMs) have shown significant potential to change how we write, communicate, and create, leading to rapid adoption across society. This dissertation examines how individuals and institutions are ada…
Language ModelingLanguage ModellingLarge Language ModelLM-SPT: LM-Aligned Semantic Distillation for Speech Tokenization
With the rapid progress of speech language models (SLMs), discrete speech tokens have emerged as a core interface between speech and text, enabling unified modeling across modalities. Recent speech tokenization approache…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+6Challenges in Grounding Language in the Real World
A long-term goal of Artificial Intelligence is to build a language understanding system that allows a human to collaborate with a physical robot using language that is natural to the human. In this paper we highlight som…
Language ModelingLanguage ModellingLarge Language ModelWatermarking Autoregressive Image Generation
Watermarking the outputs of generative models has emerged as a promising approach for tracking their provenance. Despite significant interest in autoregressive image generation models and their potential for misuse, no p…
Image GenerationLanguage ModelingLanguage ModellingLLMs in Coding and their Impact on the Commercial Software Engineering Landscape
Large-language-model coding tools are now mainstream in software engineering. But as these same tools move human effort up the development stack, they present fresh dangers: 10% of real prompts leak private data, 42% of …
Language ModelingLanguage ModellingLarge Language ModelTAGLMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Research
Large language model (LLM) agents have demonstrated remarkable potential in advancing scientific discovery. However, their capability in the fundamental yet crucial task of reproducing code from research papers, especial…
Language ModelingLanguage ModellingLarge Language Modelscientific discoveryFinance Language Model Evaluation (FLaME)
Language Models (LMs) have demonstrated impressive capabilities with core Natural Language Processing (NLP) tasks. The effectiveness of LMs for highly specialized knowledge-intensive tasks in finance remains difficult to…
BenchmarkingLanguage Model EvaluationLanguage ModelingLanguage Modelling+1Show-o2: Improved Native Unified Multimodal Models
This paper presents improved native unified multimodal models, \emph{i.e.,} Show-o2, that leverage autoregressive modeling and flow matching. Built upon a 3D causal variational autoencoder space, unified visual represent…
Language ModelingLanguage ModellingVideo GenerationRAS-Eval: A Comprehensive Benchmark for Security Evaluation of LLM Agents in Real-World Environments
The rapid deployment of Large language model (LLM) agents in critical domains like healthcare and finance necessitates robust security frameworks. To address the absence of standardized evaluation benchmarks for these ag…
Language ModelingLanguage ModellingLarge Language ModelMake Your AUV Adaptive: An Environment-Aware Reinforcement Learning Framework For Underwater Tasks
This study presents a novel environment-aware reinforcement learning (RL) framework designed to augment the operational capabilities of autonomous underwater vehicles (AUVs) in underwater environments. Departing from tra…
Decision MakingLanguage ModelingLanguage ModellingLarge Language Model+1