A data lake-based security transmission and storage scheme for streaming big data
A data lake-based security transmission and storage scheme for streaming big data
Xiaoyan Zhao,Conghui Zhang,Shaopeng Guan
2023 · DOI: 10.1007/s10586-023-04201-9
Cluster Computing · 8 Citations
TLDR
This work introduces the SSL secure transmission protocol to ensure secure data transmission over a multi-source streaming data transmission channel constructed using Flume and Kafka and designs a data partition scheme based on LZO compression and implements a data lake storage system using Hadoop.