Data Lakes: A Survey of Concepts and Architectures
Озёра данных: обзор концепций и архитектур
2024-07-22
SCID: 54.1/b8v3yxn4
Discuss with AI
architectural evolutiondata lakesdata warehousesdata-lake architecturesliterature review
Figures from the paper
Abstract (AI)
This paper presents a comprehensive literature review on the evolution of data-lake technology, with a particular focus on data-lake architectures. By systematically examining the existing body of research, we identify and classify the major types of data-lake architectures that have been proposed and implemented over time. The review highlights key trends in the development of data-lake architectures, identifies the primary challenges faced in their implementation, and discusses future directions for research and practice in this rapidly evolving field. We have developed diagrammatic representations to highlight the evolution of various architectures. These diagrams use consistent notations across all architectures to further enhance the comparative analysis of the different architectural components. We also explore the differences between data warehouses and data lakes. Our findings provide valuable insights for researchers and practitioners seeking to understand the current state of data-lake technology and its potential future trajectory.
Key Findings
1
Consistent diagrammatic notations are developed to represent and comparatively analyze architectural components across different data-lake architectures.
2
It identifies and classifies major data-lake architecture types proposed and implemented over time.
3
The paper contrasts data warehouses with data lakes and outlines future research and practice directions for data-lake technology.
4
The paper provides a comprehensive literature review tracing the evolution of data-lake technology, emphasizing architectural developments.
5
The review highlights key development trends and primary implementation challenges for data-lake architectures.
Research Object
data-lake technology and architectures
Research Subject
the evolution, classification, implementation challenges, comparative characteristics, and future directions of data-lake architectures
Publication Details
Publication Date
2024-07-22
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest