UPDF AI

Big data architectures for data lakes: A systematic literature review

Sonam Ramchand,Tariq Mahmood

2022 · DOI: 10.1109/COMPSAC54236.2022.00179
Annual International Computer Software and Applications Conference · 4 Citations

Abstract

The rise in big technologies has been demanding different concepts and practices for data exploitation; among them data lake is a recently emerged concept that is meant to deal with the heterogeneous data. Data lakes have been residing in the big data era since 2010, but there has not been any systematic review yet over data lake implementation. In this research survey, we conduct a review and provide a road map to researcher that elaborates what has happened to data lakes till now. We aim to give understanding for basic concept of data lakes and propose a novel data lake definition that could best describe the concept based on the literature review. One of the main problem while implementing data lake is deciding the technologies to use, this study covers technologies that can potentially be used for data lake implementation. Furthermore, data lake architectures and their variants are discussed in detail. Moreover, we analyze current state, challenges, pros and cons of the data lake. This study is all in one place for researchers who try to understand data lake concept, architectures, technologies, approaches, current state and challenges.