Attention Sinks

2000년 도입 · 논문 13편에서 사용

Please enter a description about the method here

출처: Efficient Streaming Language Models with Attention Sinks

소개 논문: Efficient Streaming Language Models with Attention Sinks