paper-with-me

Papers

Video2GIF: Automatic Generation of Animated GIFs from Video

2016-05-16 · CVPR 2016 6 · Michael Gygli, Yale Song, Liangliang Cao

We introduce the novel problem of automatically generating animated GIFs from video. GIFs are short looping video with no sound, and a perfect combination between image and video that really capture our attention. GIFs tell a story, express emotion, turn events into humorous moments, and are the new wave of photojournalism. We pose the question: Can we automate the entirely manual and elaborate process of GIF creation by leveraging the plethora of user generated GIF content? We propose a Robust Deep RankNet that, given a video, generates a ranked list of its segments according to their suitability as GIF. We train our model to learn what visual content is often selected for GIFs by using over 100K user generated GIFs and their corresponding video sources. We effectively deal with the noisy web data by proposing a novel adaptive Huber loss in the ranking formulation. We show that our approach is robust to outliers and picks up several patterns that are frequently present in popular animated GIFs. On our new large-scale benchmark dataset, we show the advantage of our approach over several state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:1605.04850

Code (1)

gyglim/video2gif_dataset 공식 구현

Methods 이 논문이 사용한 방법론

Huber loss The Huber loss function describes the penalty incurred by an estimation procedure f. Huber (1964) defines the loss function piecewise by[1] L δ ( a ) = { 1 2 a 2 for | a |…

Similar Papers 제목 키워드 기반

TGIF: A New Dataset and Benchmark on Animated GIF Description

2016-04-10 · CVPR 2016 6 · Yuncheng Li, Yale Song, Liangliang Cao, Joel Tetreault 외

With the recent popularity of animated GIFs on social media, there is need for ways to index them with rich metadata. To advance research on animated GIF understanding, we collected a new dataset, Tumblr GIF (TGIF), with…

Image CaptioningMachine TranslationText GenerationTranslation+1

Client-driven Animated GIF Generation Framework Using an Acoustic Feature

2021-02-12 · Ghulam Mujtaba, Sangsoon Lee, Jaehyoun Kim, Eun-Seok Ryu

This paper proposes a novel, lightweight method to generate animated graphical interchange format images (GIFs) using the computational resources of a client device. The method analyzes an acoustic feature from the clima…

Animated GIF GenerationMusic Genre Recognition

Ani-GIFs: A benchmark dataset for domain generalization of action recognition from GIFs

2022-09-26 · Frontiers of Computer Science 2022 9 · Shoumik Sovan, Majumdar Shubhangi Jain, Isidora Chara Tourni, Arsenii Mustafin 외

Deep learning models perform remarkably well for the same task under the assumption that data is always coming from the same distribution. However, this is generally violated in practice, mainly due to the differences in…

Action RecognitionAnimated GIF GenerationData AugmentationDomain Adaptation+1

FRC-GIF: Frame Ranking-based Personalized Artistic Media Generation Method for Resource Constrained Devices

2023-11-30 · journal 2023 11 · Ghulam Mujtaba, Sunder Ali Khowaja, Muhammad Aslam Jarwar, Jaehyuk Choi 외

Generating video highlights in the form of animated graphics interchange formats (GIFs) has significantly simplified the process of video browsing. Animated GIFs have paved the way for applications concerning streaming p…

Animated GIF GenerationClassification

LTC-GIF: Attracting More Clicks on Feature-length Sports Videos

2022-01-22 · Ghulam Mujtaba, Jaehyuk Choi, Eun-Seok Ryu

This paper proposes a lightweight method to attract users and increase views of the video by presenting personalized artistic media -- i.e, static thumbnails and animated GIFs. This method analyzes lightweight thumbnail …

Action AnalysisAnimated GIF GenerationSports AnalyticsUser Constrained Thumbnail Generation