Papers Efficient Neural Network
“Efficient Neural Network” 태그가 달린 논문 224편 · 필터 해제
VQ4ALL: Efficient Neural Network Representation via a Universal Codebook
The rapid growth of the big neural network models puts forward new requirements for lightweight network representation methods. The traditional methods based on model compression have achieved great success, especially V…
Density EstimationEfficient Neural NetworkModel CompressionMTSpark: Enabling Multi-Task Learning with Spiking Neural Networks for Generalist Agents
Currently, state-of-the-art RL methods excel in single-task settings, but they still struggle to generalize across multiple tasks due to catastrophic forgetting challenges, where previously learned tasks are forgotten as…
Atari GamesEfficient Neural Networkimage-classificationImage Classification+1EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Duality
For the deployment of neural networks in resource-constrained environments, prior works have built lightweight architectures with convolution and attention for capturing local and global dependencies, respectively. Recen…
Efficient Neural NetworkImage ClassificationMambaState Space ModelsCan KAN Work? Exploring the Potential of Kolmogorov-Arnold Networks in Computer Vision
Kolmogorov-Arnold Networks(KANs), as a theoretically efficient neural network architecture, have garnered attention for their potential in capturing complex patterns. However, their application in computer vision remains…
Efficient Neural Networkimage-classificationImage ClassificationKolmogorov-Arnold Networks+1LUTMUL: Exceed Conventional FPGA Roofline Limit by LUT-based Efficient Multiplication for Neural Network Inference
For FPGA-based neural network accelerators, digital signal processing (DSP) blocks have traditionally been the cornerstone for handling multiplications. This paper introduces LUTMUL, which harnesses the potential of look…
Efficient Neural NetworkQuickCharNet: An Efficient URL Classification Framework for Enhanced Search Engine Optimization
The uniform resource locator (URL) conveys essential information about a page’s topic, authority, and security, which significantly influences its ranking in search engine results. However, many existing URL classificati…
ClassificationEfficient Neural NetworkMarketingSpam detection+1Small Contributions, Small Networks: Efficient Neural Network Pruning Based on Relative Importance
Recent advancements have scaled neural networks to unprecedented sizes, achieving remarkable performance across a wide range of tasks. However, deploying these large-scale models on resource-constrained devices poses sig…
Efficient Neural NetworkNetwork PruningEfficient Neural Network Training via Subset Pretraining
In training neural networks, it is common practice to use partial gradients computed over batches, mostly very small subsets of the training set. This approach is motivated by the argument that such a partial gradient is…
Data AugmentationEfficient Neural Networkimage-classificationImage Classification+1MambaJSCC: Adaptive Deep Joint Source-Channel Coding with Generalized State Space Model
Lightweight and efficient neural network models for deep joint source-channel coding (JSCC) are crucial for semantic communications. In this paper, we propose a novel JSCC architecture, named MambaJSCC, that achieves sta…
Efficient Neural NetworkState Space ModelsAdaptive Error-Bounded Hierarchical Matrices for Efficient Neural Network Compression
This paper introduces a dynamic, error-bounded hierarchical matrix (H-matrix) compression method tailored for Physics-Informed Neural Networks (PINNs). The proposed approach reduces the computational complexity and memor…
Efficient Neural NetworkNeural Network CompressionQuantizationUV-Mamba: A DCN-Enhanced State Space Model for Urban Village Boundary Identification in High-Resolution Remote Sensing Images
Due to the diverse geographical environments, intricate landscapes, and high-density settlements, the automatic identification of urban village boundaries using remote sensing images remains a highly challenging task. Th…
Boundary DetectionDecoderEfficient Neural NetworkMamba+1Distilling Long-tailed Datasets
Dataset distillation (DD) aims to distill a small, information-rich dataset from a larger one for efficient neural network training. However, existing DD methods struggle with long-tailed datasets, which are prevalent in…
Dataset DistillationEfficient Neural NetworkAmortized Bayesian Multilevel Models
Multilevel models (MLMs) are a central building block of the Bayesian workflow. They enable joint, interpretable modeling of data across hierarchical levels and provide a fully probabilistic quantification of uncertainty…
Bayesian InferenceEfficient Neural NetworkN-DriverMotion: Driver motion learning and prediction using an event-based camera and directly trained spiking neural networks on Loihi 2
Driver motion recognition is a principal factor in ensuring the safety of driving systems. This paper presents a novel system for learning and predicting driver motions and an event-based high-resolution (1280x720) datas…
Autonomous VehiclesEfficient Neural NetworkGesture RecognitionEfficient Area-based and Speaker-Agnostic Source Separation
This paper introduces an area-based source separation method designed for virtual meeting scenarios. The aim is to preserve speech signals from an unspecified number of sources within a defined spatial area in front of a…
Efficient Neural NetworkSpeaker SeparationGNN-Empowered Effective Partial Observation MARL Method for AoI Management in Multi-UAV Network
Unmanned Aerial Vehicles (UAVs), due to their low cost and high flexibility, have been widely used in various scenarios to enhance network performance. However, the optimization of UAV trajectories in unknown areas or ar…
Distributed OptimizationEfficient Neural NetworkManagementTrajectory PlanningInfra-YOLO: Efficient Neural Network Structure with Model Compression for Real-Time Infrared Small Object Detection
Although convolutional neural networks have made outstanding achievements in visible light target detection, there are still many challenges in infrared small object detection because of the low signal-to-noise ratio, in…
Efficient Neural NetworkModel CompressionObjectobject-detection+2On the Parameter Selection of Phase-transmittance Radial Basis Function Neural Networks for Communication Systems
In the ever-evolving field of digital communication systems, complex-valued neural networks (CVNNs) have become a cornerstone, delivering exceptional performance in tasks like equalization, channel estimation, beamformin…
Efficient Neural NetworkUnifiedNN: Efficient Neural Network Training on the Cloud
Nowadays, cloud-based services are widely favored over the traditional approach of locally training a Neural Network (NN) model. Oftentimes, a cloud service processes multiple requests from users--thus training multiple …
Efficient Neural NetworkHybrid Coordinate Descent for Efficient Neural Network Learning Using Line Search and Gradient Descent
This paper presents a novel coordinate descent algorithm leveraging a combination of one-directional line search and gradient information for parameter updates for a squared error loss function. Each parameter undergoes …
Computational EfficiencyEfficient Neural Network