Tensorized Optical Multimodal Fusion Network
We propose the first tensorized optical multimodal fusion network architecture with a self-attention mechanism and low-rank tensor fusion. Simulation results show $51.3 \times$ less hardware requirement and $3.7\times 10^{13}$ MAC/J energy efficiency.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Training
Solving partial differential equations (PDEs) numerically often requires huge computing time, energy cost, and hardware resources in practical applications. This has limited their applications in many scenarios (e.g., au…
Deep Multimodal Multilinear Fusion with High-order Polynomial Pooling
Tensor-based multimodal fusion techniques have exhibited great predictive performance. However, one limitation is that existing approaches only consider bilinear or trilinear pooling, which fails to unleash the complete …
Vocal Bursts Intensity PredictionCloud Removal With PolSAR-Optical Data Fusion Using A Two-Flow Residual Network
Optical remote sensing images play a crucial role in the observation of the Earth's surface. However, obtaining complete optical remote sensing images is challenging due to cloud cover. Reconstructing cloud-free optical …
Cloud RemovalDenoisingImage DenoisingRSFusionDet: Underwater RGB-Sonar Multimodal Object Detection
Underwater unimodal object detection faces many challenges in sensor imaging, such as optical images limited by underwater noise and visible distance, and sonar images limited by less object structural information. While…
Object DetectionMultimodal Diffusion Bridge with Attention-Based SAR Fusion for Satellite Image Cloud Removal
Deep learning has achieved some success in addressing the challenge of cloud removal in optical satellite images, by fusing with synthetic aperture radar (SAR) images. Recently, diffusion models have emerged as powerful …
Cloud RemovalImage Restoration