paper-with-me

홈 › Papers

LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

2023-09-21 · Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Tianle Li, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zhuohan Li, Zi Lin, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica, Hao Zhang

Studying how people interact with large language models (LLMs) in real-world scenarios is increasingly important due to their widespread use in various applications. In this paper, we introduce LMSYS-Chat-1M, a large-scale dataset containing one million real-world conversations with 25 state-of-the-art LLMs. This dataset is collected from 210K unique IP addresses in the wild on our Vicuna demo and Chatbot Arena website. We offer an overview of the dataset's content, including its curation process, basic statistics, and topic distribution, highlighting its diversity, originality, and scale. We demonstrate its versatility through four use cases: developing content moderation models that perform similarly to GPT-4, building a safety benchmark, training instruction-following models that perform similarly to Vicuna, and creating challenging benchmark questions. We believe that this dataset will serve as a valuable resource for understanding and advancing LLM capabilities. The dataset is publicly available at https://huggingface.co/datasets/lmsys/lmsys-chat-1m.

📄 PDF Abstract BibTeX arXiv:2309.11998

Code (5)

lm-sys/fastchat 공식 구현 pytorch
BirgerMoell/SwedishLLMBenchmark pytorch
Peter-Devine/multilingual_mt_bench pytorch
efeslab/Nanoflow pytorch
lightblue-tech/multilingual-mt-bench pytorch

Tasks

ChatbotDiversityInstruction Following

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

LLMSYS-HPOBench: Hyperparameter Optimization Benchmark Suite for Real-World LLM Systems

2026-05-08 · Siyu Wu, Yulong Ye, Zezhen Xiang, Pengzhou Chen 외 arxiv

Large Language Model (LLM) systems have been the frontier of AI in many application domains, leading to new challenges and opportunities for hyperparameter optimization (HPO) for the AutoML community. However, this type …

Hyperparameter Optimization

Latent Adversarial Detection: Adaptive Probing of LLM Activations for Multi-Turn Attack Detection

2026-04-30 · Prashant Kulkarni arxiv

Multi-turn prompt injection follows a known attack path -- trust-building, pivoting, escalation but text-level defenses miss covert attacks where individual turns appear benign. We show this attack path leaves an activat…

Black-Box On-Policy Distillation of Large Language Models

2025-11-13 · Tianzhu Ye, Li Dong, Zewen Chi, Xun Wu 외 arxiv

Black-box distillation creates student large language models (LLMs) by learning from a proprietary teacher model's text outputs alone, without access to its internal logits or parameters. In this work, we introduce Gener…

Knowledge Distillation

Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

2024-03-07 · Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos 외

Large Language Models (LLMs) have unlocked new capabilities and applications; however, evaluating the alignment with human preferences still poses significant challenges. To address this issue, we introduce Chatbot Arena…

Chatbot

Evaluating Large Language Models with Human Feedback: Establishing a Swedish Benchmark

2024-05-22 · Birger Moell

In the rapidly evolving field of artificial intelligence, large language models (LLMs) have demonstrated significant capabilities across numerous applications. However, the performance of these models in languages with f…

ChatbotLanguage ModelingLanguage Modelling