paper-with-me

Papers

LLaVA-Docent: Instruction Tuning with Multimodal Large Language Model to Support Art Appreciation Education

2024-02-09 · Unggi Lee, Minji Jeon, Yunseo Lee, Gyuri Byun, Yoorim Son, Jaeyoon Shin, Hongkyu Ko, Hyeoncheol Kim

Despite the development of various AI systems to support learning in various domains, AI assistance for art appreciation education has not been extensively explored. Art appreciation, often perceived as an unfamiliar and challenging endeavor for most students, can be more accessible with a generative AI enabled conversation partner that provides tailored questions and encourages the audience to deeply appreciate artwork. This study explores the application of multimodal large language models (MLLMs) in art appreciation education, with a focus on developing LLaVA-Docent, a model designed to serve as a personal tutor for art appreciation. Our approach involved design and development research, focusing on iterative enhancement to design and develop the application to produce a functional MLLM-enabled chatbot along with a data design framework for art appreciation education. To that end, we established a virtual dialogue dataset that was generated by GPT-4, which was instrumental in training our MLLM, LLaVA-Docent. The performance of LLaVA-Docent was evaluated by benchmarking it against alternative settings and revealed its distinct strengths and weaknesses. Our findings highlight the efficacy of the MMLM-based personalized art appreciation chatbot and demonstrate its applicability for a novel approach in which art appreciation is taught and experienced.

📄 PDF Abstract BibTeX arXiv:2402.06264

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingChatbotEmotional IntelligenceLanguage ModelingLanguage ModellingLarge Language ModelMultimodal Large Language Model

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Focus 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Visual Instruction Tuning

2023-04-17 · NeurIPS 2023 11 · Haotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae Lee

Instruction tuning large language models (LLMs) using machine-generated instruction-following data has improved zero-shot capabilities on new tasks, but the idea is less explored in the multimodal field. In this paper, w…

1 Image, 2*2 Stitching3D Question Answering (3D-QA)Image ClassificationImage Retrieval+9

Generative Visual Instruction Tuning

2024-06-17 · Jefferson Hernandez, Ruben Villegas, Vicente Ordonez

We propose to use automatically generated instruction-following data to improve the zero-shot capabilities of a large multimodal model with additional support for generative and image editing tasks. We achieve this by cu…

Image GenerationImage-text matchingInstruction FollowingLanguage Modeling+4

HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models

2024-03-20 · Wenqiao Zhang, Tianwei Lin, Jiang Liu, Fangxun Shu 외

Recent advancements indicate that scaling up Multimodal Large Language Models (MLLMs) effectively enhances performance on downstream multimodal tasks. The prevailing MLLM paradigm, \emph{e.g.}, LLaVA, transforms visual f…

MMEVisual Question Answering

Video Instruction Tuning With Synthetic Data

2024-10-03 · Yuanhan Zhang, Jinming Wu, Wei Li, Bo Li 외

The development of video large multimodal models (LMMs) has been hindered by the difficulty of curating large amounts of high-quality raw data from the web. To address this, we propose an alternative approach by creating…

3D Question Answering (3D-QA)Instruction FollowingMultiple-choice+5

To See is to Believe: Prompting GPT-4V for Better Visual Instruction Tuning

2023-11-13 · Junke Wang, Lingchen Meng, Zejia Weng, Bo He 외

Existing visual instruction tuning methods typically prompt large language models with textual descriptions to generate instruction-following data. Despite the promising performance achieved, these descriptions are deriv…

Instruction FollowingMM-VetVisual Question Answering