paper-with-me

홈 › Papers

Metamorpheus: Interactive, Affective, and Creative Dream Narration Through Metaphorical Visual Storytelling

2024-03-01 · Qian Wan, Xin Feng, Yining Bei, Zhiqi Gao, Zhicong Lu

Human emotions are essentially molded by lived experiences, from which we construct personalised meaning. The engagement in such meaning-making process has been practiced as an intervention in various psychotherapies to promote wellness. Nevertheless, to support recollecting and recounting lived experiences in everyday life remains under explored in HCI. It also remains unknown how technologies such as generative AI models can facilitate the meaning making process, and ultimately support affective mindfulness. In this paper we present Metamorpheus, an affective interface that engages users in a creative visual storytelling of emotional experiences during dreams. Metamorpheus arranges the storyline based on a dream's emotional arc, and provokes self-reflection through the creation of metaphorical images and text depictions. The system provides metaphor suggestions, and generates visual metaphors and text depictions using generative AI models, while users can apply generations to recolour and re-arrange the interface to be visually affective. Our experience-centred evaluation manifests that, by interacting with Metamorpheus, users can recall their dreams in vivid detail, through which they relive and reflect upon their experiences in a meaningful way.

📄 PDF Abstract BibTeX arXiv:2403.00632

Code (0)

등록된 구현이 없습니다.

Tasks

ARCVisual Storytelling

Similar Papers 제목 키워드 기반

SketchDreamer: Interactive Text-Augmented Creative Sketch Ideation

2023-08-27 · Zhiyu Qu, Tao Xiang, Yi-Zhe Song

Artificial Intelligence Generated Content (AIGC) has shown remarkable progress in generating realistic images. However, in this paper, we take a step "backward" and address AIGC for the most rudimentary visual modality o…

The content and structure of dreams are coupled to affect

2024-09-22 · Luke Leckie, Anya K. Bershad, Jes Heppler, Mason McClay 외

Dreams offer a unique window into the cognitive and affective dynamics of the sleeping and the waking mind. Recent quantitative linguistic approaches have shown promise in obtaining corpus-level measures of dream sentime…

Explaining CLIP through Co-Creative Drawings and Interaction

2023-06-12 · Varvara Guljajeva, Mar Canet Solà, Isaac Joseph Clarke

This paper analyses a visual archive of drawings produced by an interactive robotic art installation where audience members narrated their dreams into a system powered by CLIPdraw deep learning (DL) model that interprete…

Collaborative Storytelling with Human Actors and AI Narrators

2021-09-29 · Boyd Branch, Piotr Mirowski, Kory W. Mathewson

Large language models can be used for collaborative storytelling. In this work we report on using GPT-3 \cite{brown2020language} to co-narrate stories. The AI system must track plot progression and character arcs while t…

Language Modelling

Seedream 4.0: Toward Next-generation Multimodal Image Generation

2025-09-24 · Team Seedream, :, Yunpeng Chen, Yu Gao 외 arxiv

We introduce Seedream 4.0, an efficient and high-performance multimodal image generation system that unifies text-to-image (T2I) synthesis, image editing, and multi-image composition within a single framework. We develop…

Image GenerationImage Editing