paper-with-me

홈 › Papers

MOFA: A Model Simplification Roadmap for Image Restoration on Mobile Devices

2023-08-24 · Xiangyu Chen, Ruiwen Zhen, Shuai Li, Xiaotian Li, Guanghui Wang

Image restoration aims to restore high-quality images from degraded counterparts and has seen significant advancements through deep learning techniques. The technique has been widely applied to mobile devices for tasks such as mobile photography. Given the resource limitations on mobile devices, such as memory constraints and runtime requirements, the efficiency of models during deployment becomes paramount. Nevertheless, most previous works have primarily concentrated on analyzing the efficiency of single modules and improving them individually. This paper examines the efficiency across different layers. We propose a roadmap that can be applied to further accelerate image restoration models prior to deployment while simultaneously increasing PSNR (Peak Signal-to-Noise Ratio) and SSIM (Structural Similarity Index). The roadmap first increases the model capacity by adding more parameters to partial convolutions on FLOPs non-sensitive layers. Then, it applies partial depthwise convolution coupled with decoupling upsampling/downsampling layers to accelerate the model speed. Extensive experiments demonstrate that our approach decreases runtime by up to 13% and reduces the number of parameters by up to 23%, while increasing PSNR and SSIM on several image restoration datasets. Source Code of our method is available at \href{https://github.com/xiangyu8/MOFA}{https://github.com/xiangyu8/MOFA}.

📄 PDF Abstract BibTeX arXiv:2308.12494

Code (1)

xiangyu8/mofa 공식 구현 pytorch

Tasks

Image RestorationSSIM

Methods 이 논문이 사용한 방법론

Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model

2024-05-30 · Muyao Niu, Xiaodong Cun, Xintao Wang, Yong Zhang 외

We present MOFA-Video, an advanced controllable image animation method that generates video from the given image using various additional controllable signals (such as human landmarks reference, manual trajectories, and …

Image AnimationVideo Generation

MoFaNeRF: Morphable Facial Neural Radiance Field

2021-12-04 · Yiyu Zhuang, Hao Zhu, Xusen Sun, Xun Cao

We propose a parametric model that maps free-view images into a vector space of coded facial shape, expression and appearance with a neural radiance field, namely Morphable Facial NeRF. Specifically, MoFaNeRF takes the c…

Image GenerationNeRFNovel View Synthesis

MOFA: Modular Factorial Design for Hyperparameter Optimization

2020-11-18 · Bo Xiong, Yimin Huang, Hanrong Ye, Steffen Staab 외

This paper presents a novel and lightweight hyperparameter optimization (HPO) method, MOdular FActorial Design (MOFA). MOFA pursues several rounds of HPO, where each round alternates between exploration of hyperparameter…

Hyperparameter OptimizationModel Selection

Mofasa: A Step Change in Metal-Organic Framework Generation

2025-12-01 · Vaidotas Simkus, Anders Christensen, Steven Bennett, Ian Johnson 외 arxiv

Mofasa is an all-atom latent diffusion model with state-of-the-art performance for generating Metal-Organic Frameworks (MOFs). These are highly porous crystalline materials used to harvest water from desert air, capture …

MOFA: Discovering Materials for Carbon Capture with a GenAI- and Simulation-Based Workflow

2025-01-18 · Xiaoli Yan, Nathaniel Hudson, Hyun Park, Daniel Grzenda 외

We present MOFA, an open-source generative AI (GenAI) plus simulation workflow for high-throughput generation of metal-organic frameworks (MOFs) on large-scale high-performance computing (HPC) systems. MOFA addresses key…

CPUGPU