Towards L-System Captioning for Tree Reconstruction
This work proposes a novel concept for tree and plant reconstruction by directly inferring a Lindenmayer-System (L-System) word representation from image data in an image captioning approach. We train a model end-to-end which is able to translate given images into L-System words as a description of the displayed tree. To prove this concept, we demonstrate the applicability on 2D tree topologies. Transferred to real image data, this novel idea could lead to more efficient, accurate and semantically meaningful tree and plant reconstruction without using error-prone point cloud extraction, and other processes usually utilized in tree reconstruction. Furthermore, this approach bypasses the need for a predefined L-System grammar and enables species-specific L-System inference without biological knowledge.
Code (0)
등록된 구현이 없습니다.
Tasks
Image CaptioningSimilar Papers 제목 키워드 기반
Variational Structured Semantic Inference for Diverse Image Captioning
Despite the exciting progress in image captioning, generating diverse captions for a given image remains as an open problem. Existing methods typically apply generative models such as Variational Auto-Encoder to diversif…
DecoderDiversityImage CaptioningMulti-modal Dependency Tree for Video Captioning
Generating fluent and relevant language to describe visual content is critical for the video captioning task. Many existing methods generate captions using sequence models that predict words in a left-to-right order. In …
Caption GenerationDependency ParsingSentenceText Generation+1UniBrain: Unify Image Reconstruction and Captioning All in One Diffusion Model from Human Brain Activity
Image reconstruction and captioning from brain activity evoked by visual stimuli allow researchers to further understand the connection between the human brain and the visual perception system. While deep generative mode…
AllBrain DecodingImage CaptioningImage ReconstructionGroupCap: Group-Based Image Captioning With Structured Relevance and Diversity Constraints
Most image captioning models focus on one-line (single image) captioning, where the correlations like relevance and diversity among group images (e.g., within the same album or event) are simply neglected, resulting in l…
DiversityImage CaptioningVideo Captioning Using Weak Annotation
Video captioning has shown impressive progress in recent years. One key reason of the performance improvements made by existing methods lie in massive paired video-sentence data, but collecting such strong annotation, i.…
SentenceVideo CaptioningVisual Reasoning