Theoretical Exploration of Flexible Transmitter Model

2021-11-11 · Jin-Hui Wu, Shao-Qun Zhang, Yuan Jiang, Zhi-Hua Zhou

Neural network models generally involve two important components, i.e., network architecture and neuron model. Although there are abundant studies about network architectures, only a few neuron models have been developed, such as the MP neuron model developed in 1943 and the spiking neuron model developed in the 1950s. Recently, a new bio-plausible neuron model, Flexible Transmitter (FT) model, has been proposed. It exhibits promising behaviors, particularly on temporal-spatial signals, even when simply embedded into the common feedforward network architecture. This paper attempts to understand the properties of the FT network (FTNet) theoretically. Under mild assumptions, we show that: i) FTNet is a universal approximator; ii) the approximation complexity of FTNet can be exponentially smaller than those of commonly-used real-valued neural networks with feedforward/recurrent architectures and is of the same order in the worst case; iii) any local minimum of FTNet is the global minimum, implying that it is possible to identify global minima by local search algorithms.

📄 PDF Abstract BibTeX arXiv:2111.06027

Code (0)

등록된 구현이 없습니다.

Tasks

model

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…

Flexible Transmitter Network

2020-04-08 · Shao-Qun Zhang, Zhi-Hua Zhou

Current neural networks are mostly built upon the MP model, which usually formulates the neuron as executing an activation function on the real-valued weighted aggregation of signals received from other neurons. In this …

Time Series Analysis

Robust Eavesdropping in the Presence of Adversarial Communications for RF Fingerprinting

2025-03-06 · Andrew Yuan, Rajeev Sahay

Deep learning is an effective approach for performing radio frequency (RF) fingerprinting, which aims to identify the transmitter corresponding to received RF signals. However, beyond the intended receiver, malicious eav…

Deep Learning

Randomized Exploration in Cooperative Multi-Agent Reinforcement Learning

2024-04-16 · Hao-Lun Hsu, Weixin Wang, Miroslav Pajic, Pan Xu

We present the first study on provably efficient randomized exploration in cooperative multi-agent reinforcement learning (MARL). We propose a unified algorithm framework for randomized exploration in parallel Markov Dec…

Federated Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Channel Modeling for Physically Secure Electro-Quasistatic In-Body to Out-of-Body Communication with Galvanic Tx and Multimodal Rx

2022-04-27 · Arunashish Datta, Mayukh Nath, Baibhab Chatterjee, Nirmoy Modak 외

Increasing number of devices being used in and around the human body has resulted in the exploration of the human body as a communication medium. In this paper, we design a channel model for implantable devices communica…

Amperometric Measurements and Dynamic Models Reveal a Mechanism for How Zinc Alters Neurotransmitter Release

2020-07-07 · Lin Ren, Alexander Oleinick, Irina Svir, Christian Amatore 외

Zinc, a suspected potentiator of learning and memory, is shown to affect exocytotic release and storage in neurotransmitter-containing vesicles. Structural and size analysis of the vesicular dense core and halo using tra…