Semantic Data Management in Data Lakes
In recent years, data lakes emerged as away to manage large amounts of heterogeneous data for modern data analytics. One way to prevent data lakes from turning into inoperable data swamps is semantic data management. Some approaches propose the linkage of metadata to knowledge graphs based on the Linked Data principles to provide more meaning and semantics to the data in the lake. Such a semantic layer may be utilized not only for data management but also to tackle the problem of data integration from heterogeneous sources, in order to make data access more expressive and interoperable. In this survey, we review recent approaches with a specific focus on the application within data lake systems and scalability to Big Data. We classify the approaches into (i) basic semantic data management, (ii) semantic modeling approaches for enriching metadata in data lakes, and (iii) methods for ontologybased data access. In each category, we cover the main techniques and their background, and compare latest research. Finally, we point out challenges for future work in this research area, which needs a closer integration of Big Data and Semantic Web technologies.
Code (0)
등록된 구현이 없습니다.
Tasks
Data IntegrationKnowledge GraphsManagementMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LEDD: Large Language Model-Empowered Data Discovery in Data Lakes
Data discovery in data lakes with ever increasing datasets has long been recognized as a big challenge in the realm of data management, especially for semantic search of and hierarchical global catalog generation of tabl…
Language ModelingLanguage ModellingLarge Language ModelManagement+3Reproducible data science over data lakes: replayable data pipelines with Bauplan and Nessie
As the Lakehouse architecture becomes more widespread, ensuring the reproducibility of data workloads over data lakes emerges as a crucial concern for data engineers. However, achieving reproducibility remains challengin…
ManagementModel Lakes
Given a set of deep learning models, it can be hard to find models appropriate to a task, understand the models, and characterize how models are different one from another. Currently, practitioners rely on manually-writt…
BenchmarkingManagementmodelEnhancing Environmental Monitoring through Multispectral Imaging: The WasteMS Dataset for Semantic Segmentation of Lakeside Waste
Environmental monitoring of lakeside green areas is crucial for environmental protection. Compared to manual inspections, computer vision technologies offer a more efficient solution when deployed on-site. Multispectral …
SegmentationSemantic SegmentationOptimal spatial-dynamic management to minimize the damages caused by aquatic invasive species
Invasive species have been recognized as a leading threat to biodiversity. In particular, lakes are especially affected by species invasions because they are closed systems sensitive to disruption. Accurately controlling…
Management