The role of data lake in big data analytics: recent developments and challenges
The role of data lake in big data analytics: recent developments and challenges
T. Rao,Pabitra Mitra,A. Goswami
TLDR
This work explores the concept of a data lake (DL), big data fabric, DL architecture and various layers of a DL, and presents various components of each of the layers that exist in a DL.
Abstract
We explore the concept of a data lake (DL), big data fabric, DL architecture and various layers of a DL. We also present various components of each of the layers that exist in a DL. We compare and contrast the notion of data warehouses and DLs concerning some key characteristics. Moreover, we explore various commercial- and open-source-based DLs with their strengths and limitations. Also, we discuss some of the key best practices for DLs. Further, we present two case studies of DLs: Lumada data lake (LDL) and Temenos data lake (TDL) for digital banking. Finally, we explore some of the crucial challenges that are facing in the formation of DLs.
