paper-with-me

홈 › Papers

Evaluating Durability: Benchmark Insights into Multimodal Watermarking

2024-06-06 · JieLin Qiu, William Han, Xuandong Zhao, Shangbang Long, Christos Faloutsos, Lei LI

With the development of large models, watermarks are increasingly employed to assert copyright, verify authenticity, or monitor content distribution. As applications become more multimodal, the utility of watermarking techniques becomes even more critical. The effectiveness and reliability of these watermarks largely depend on their robustness to various disturbances. However, the robustness of these watermarks in real-world scenarios, particularly under perturbations and corruption, is not well understood. To highlight the significance of robustness in watermarking techniques, our study evaluated the robustness of watermarked content generated by image and text generation models against common real-world image corruptions and text perturbations. Our results could pave the way for the development of more robust watermarking techniques in the future. Our project website can be found at \url{https://mmwatermark-robustness.github.io/}.

📄 PDF Abstract BibTeX arXiv:2406.03728

Code (0)

등록된 구현이 없습니다.

Tasks

Text Generation

Similar Papers 제목 키워드 기반

Multitask Multimodal Fusion with Tabular Foundation Models for Peak and Durability Prediction of Pertussis Booster Response

2026-05-13 · Divya Sitani arxiv

Pertussis booster vaccination produces immune responses that vary widely across individuals in both peak magnitude and long-term durability. These two phases are governed by partly distinct biological compartments:peak r…

MathScape: Evaluating MLLMs in multimodal Math Scenarios through a Hierarchical Benchmark

2024-08-14 · Minxuan Zhou, Hao Liang, Tianpeng Li, Zhiyu Wu 외

With the development of Multimodal Large Language Models (MLLMs), the evaluation of multimodal models in the context of mathematical problems has become a valuable research field. Multimodal visual-textual mathematical r…

MathMathematical Reasoning

Empowering Reliable Visual-Centric Instruction Following in MLLMs

2026-01-06 · Weilei He, Feng Ju, Zhiyuan Fan, Rui Min 외 arxiv

Evaluating the instruction-following (IF) capabilities of Multimodal Large Language Models (MLLMs) is essential for rigorously assessing how faithfully model outputs adhere to user-specified intentions. Nevertheless, exi…

Instruction Following

MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities

2023-08-04 · Weihao Yu, Zhengyuan Yang, Linjie Li, JianFeng Wang 외

We propose MM-Vet, an evaluation benchmark that examines large multimodal models (LMMs) on complicated multimodal tasks. Recent LMMs have shown various intriguing abilities, such as solving math problems written on the b…

MathMM-VetZero-Shot Visual Question Answring

ScratchEval: Are GPT-4o Smarter than My Child? Evaluating Large Multimodal Models with Visual Programming Challenges

2024-11-28 · Rao Fu, Ziyang Luo, Hongzhan Lin, Zhen Ye 외

Recent advancements in large multimodal models (LMMs) have showcased impressive code generation capabilities, primarily evaluated through image-to-code benchmarks. However, these benchmarks are limited to specific visual…

Code Generation