Rewrite the Stars
Recent studies have drawn attention to the untapped potential of the "star operation" (element-wise multiplication) in network design. While intuitive explanations abound, the foundational rationale behind its application remains largely unexplored. Our study attempts to reveal the star operation's ability to map inputs into high-dimensional, non-linear feature spaces -- akin to kernel tricks -- without widening the network. We further introduce StarNet, a simple yet powerful prototype, demonstrating impressive performance and low latency under compact network structure and efficient budget. Like stars in the sky, the star operation appears unremarkable but holds a vast universe of potential. Our work encourages further exploration across tasks, with codes available at https://github.com/ma-xu/Rewrite-the-Stars.
Code (4)
Similar Papers 제목 키워드 기반
Active Simultaneously Transmitting and Reflecting Surface Assisted NOMA Networks
The novel active simultaneously transmitting and reflecting surface (ASTARS) has recently received a lot of attention due to its capability to conquer the multiplicative fading loss and achieve full-space smart radio env…
Gravitational Collapse and Neutrino Emission of Population III Massive Stars
Pop III stars are the first stars in the universe. They do not contain metals and their formation and evolution may be different from that of stars of later generations. In fact, according to the theory of star formation…
Exploiting Movable-Element STARS for Wireless Communications
A novel movable-element enabled simultaneously transmitting and reflecting surface (ME-STARS) communication system is proposed, where ME-STARS elements positions can be adjusted to enhance the degress-of-freedom for tran…
PositionDocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing
Analyzing unstructured data has been a persistent challenge in data processing. Large Language Models (LLMs) have shown promise in this regard, leading to recent proposals for declarative frameworks for LLM-powered proce…
Black Stars and Gamma Ray Bursts
Stars that are collapsing toward forming a black hole but are frozen near the Schwarzschild horizon are termed "black stars". Collisions of black stars, in contrast to black hole collisions, may be sources of gamma ray b…