paper-with-me

Papers

kMatrix: A Space Efficient Streaming Graph Summarization Technique

2021-05-12 · Oshan Mudannayake, Nalin Ranasinghe

The amount of collected information on data repositories has vastly increased with the advent of the internet. It has become increasingly complex to deal with these massive data streams due to their sheer volume and the throughput of incoming data. Many of these data streams are mapped into graphs, which helps discover some of their properties. However, due to the difficulty in processing massive streaming graphs, they are summarized such that their properties can be approximately evaluated using the summaries. gSketch, TCM, and gMatrix are some of the major streaming graph summarization techniques. Our primary contribution is devising kMatrix, which is much more memory efficient than existing streaming graph summarization techniques. We achieved this by partitioning the allocated memory using a sample of the original graph stream. Through the experiments, we show that kMatrix can achieve a significantly less error for the queries using the same space as that of TCM and gMatrix.

📄 PDF Abstract BibTeX arXiv:2105.05503

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Streaming Submodular Maximization under a k-Set System Constraint

2020-01-01 · ICML 2020 1 · Ran Haba, Ehsan Kazemi, Moran Feldman, Amin Karbasi

In this paper, we propose a novel framework that converts streaming algorithms for monotone submodular maximization into streaming algorithms for non-monotone submodular maximization. This reduction readily leads to the …

Data SummarizationMovie Recommendation

Streaming Submodular Maximization under a $k$-Set System Constraint

2020-02-09 · Ran Haba, Ehsan Kazemi, Moran Feldman, Amin Karbasi

In this paper, we propose a novel framework that converts streaming algorithms for monotone submodular maximization into streaming algorithms for non-monotone submodular maximization. This reduction readily leads to the …

Data SummarizationMovie Recommendation

TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs

2023-03-29 · Yaobo Liang, Chenfei Wu, Ting Song, Wenshan Wu 외

Artificial Intelligence (AI) has made incredible progress recently. On the one hand, advanced foundation models like ChatGPT can offer powerful conversation, in-context learning and code generation abilities on a broad r…

Code GenerationCommon Sense ReasoningIn-Context Learning

Parallel and Streaming Algorithms for K-Core Decomposition

2018-08-07 · ICML 2018 7 · Hossein Esfandiari, Silvio Lattanzi, Vahab Mirrokni

The $k$-core decomposition is a fundamental primitive in many machine learning and data mining applications. We present the first distributed and the first streaming algorithms to compute and maintain an approximate $k$-…

Diversity Promoting Online Sampling for Streaming Video Summarization

2016-10-29 · Rushil Anirudh, Ahnaf Masroor, Pavan Turaga

Many applications benefit from sampling algorithms where a small number of well chosen samples are used to generalize different properties of a large dataset. In this paper, we use diverse sampling for streaming video su…

ClusteringDiversityVideo Summarization