paper-with-me

Papers

Learning to Control using Image Feedback

2021-10-28 · Krishnan Raghavan, Vignesh Narayanan, Jagannathan Saraangapani

Learning to control complex systems using non-traditional feedback, e.g., in the form of snapshot images, is an important task encountered in diverse domains such as robotics, neuroscience, and biology (cellular systems). In this paper, we present a two neural-network (NN)-based feedback control framework to design control policies for systems that generate feedback in the form of images. In particular, we develop a deep $Q$-network (DQN)-driven learning control strategy to synthesize a sequence of control inputs from snapshot images that encode the information pertaining to the current state and control action of the system. Further, to train the networks we employ a direct error-driven learning (EDL) approach that utilizes a set of linear transformations of the NN training error to update the NN weights in each layer. We verify the efficacy of the proposed control strategy using numerical examples.

📄 PDF Abstract BibTeX arXiv:2110.15290

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Synthesizing Sentiment-Controlled Feedback For Multimodal Text and Image Data

2024-02-12 · Puneet Kumar, Sarthak Malik, Balasubramanian Raman, Xiaobai Li

The ability to generate sentiment-controlled feedback in response to multimodal inputs comprising text and images addresses a critical gap in human-computer interaction. This capability allows systems to provide empathet…

DecoderMarketingQuestion AnsweringSentiment Analysis+3

ControlNet-XS: Rethinking the Control of Text-to-Image Diffusion Models as Feedback-Control Systems

2023-12-11 · Denis Zavadski, Johann-Friedrich Feiden, Carsten Rother

The field of image synthesis has made tremendous strides forward in the last years. Besides defining the desired output image with text-prompts, an intuitive approach is to additionally use spatial guidance in form of an…

Image GenerationSemantic Segmentation

Dual Recursive Feedback on Generation and Appearance Latents for Pose-Robust Text-to-Image Diffusion

2025-08-13 · Jiwon Kim, Pureum Kim, SeonHwa Kim, Soobin Park 외 arxiv

Recent advancements in controllable text-to-image (T2I) diffusion models, such as Ctrl-X and FreeControl, have demonstrated robust spatial and appearance control without requiring auxiliary module training. However, thes…

Coverage-Recon: Coordinated Multi-Drone Image Sampling with Online Map Feedback

2025-10-21 · Muhammad Hanif, Reiji Terunuma, Takumi Sumino, Kelvin Cheng 외 arxiv

This article addresses collaborative 3D map reconstruction using multiple drones. Achieving high-quality reconstruction requires capturing images of keypoints within the target scene from diverse viewing angles, and cove…

3D Reconstruction

Interactive Image Segmentation From A Feedback Control Perspective

2016-06-26 · Liangjia Zhu, Peter Karasev, Ivan Kolesov, Romeil Sandhu 외

Image segmentation is a fundamental problem in computational vision and medical imaging. Designing a generic, automated method that works for various objects and imaging modalities is a formidable task. Instead of propos…

Image SegmentationInteractive SegmentationSegmentationSemantic Segmentation