VDMS: Efficient Big-Visual-Data Access for Machine Learning Workloads
We introduce the Visual Data Management System (VDMS), which enables faster access to big-visual-data and adds support to visual analytics. This is achieved by searching for relevant visual data via metadata stored as a graph, and enabling faster access to visual data through new machine-friendly storage formats. VDMS differs from existing large scale photo serving, video streaming, and textual big-data management systems due to its primary focus on supporting machine learning and data analytics pipelines that use visual data (images, videos, and feature vectors), treating these as first class entities. We describe how to use VDMS via its user friendly interface and how it enables rich and efficient vision analytics through a machine learning pipeline for processing medical images. We show the improved performance of 2x in complex queries over a comparable set-up.
Code (1)
Tasks
BIG-bench Machine LearningManagementSimilar Papers 제목 키워드 기반
Towards a Flexible Scale-out Framework for Efficient Visual Data Query Processing
There is growing interest in visual data management systems that support queries with specialized operations ranging from resizing an image to running complex machine learning models. With a plethora of such operations, …
ManagementFrom Generation to Generalization: Emergent Few-Shot Learning in Video Diffusion Models
Video Diffusion Models (VDMs) have emerged as powerful generative tools, capable of synthesizing high-quality spatiotemporal content. Yet, their potential goes far beyond mere video generation. We argue that the training…
ARCFew-Shot LearningPose EstimationVideo GenerationVDTuner: Automated Performance Tuning for Vector Data Management Systems
Vector data management systems (VDMSs) have become an indispensable cornerstone in large-scale information retrieval and machine learning systems like large language models. To enhance the efficiency and flexibility of s…
Bayesian OptimizationInformation RetrievalManagementLatent Feature and Attention Dual Erasure Attack against Multi-View Diffusion Models for 3D Assets Protection
Multi-View Diffusion Models (MVDMs) enable remarkable improvements in the field of 3D geometric reconstruction, but the issue regarding intellectual property has received increasing attention due to unauthorized imitatio…
3D geometryImage Generationsingle-image-generationMagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesis
Recently, open-source video diffusion models (VDMs), such as WanX, Magic141 and HunyuanVideo, have been scaled to over 10 billion parameters. These large-scale VDMs have demonstrated significant improvements over smaller…
GPU