FoPE
Fourier Position Embedding
2000년 도입 · 논문 1편에서 사용
출처: Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
소개 논문: Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
Position Embeddings · General