Essentials of Data Engineering

Data has been a vital component of human identity since the early Roman times. Our increasing interconnectedness caused us to encounter scale issues in the US census of 1880. 59.5% of the world's population is online presently, up from 0% in the past. The 4.32 billion people who own cellphones produce a massive amount of data. What has been the human response to the need to analyze this unprecedented amount of data? We have created distributed computing, cloud computing, relational databases, punch cards, Hadoop, and even real-time stream processing in an effort to manage this deluge of 1s and 0s.
Among the many subjects we covered in this reading were:
1.Dta engineering
2.Process of data engineering
3.Pipeline for data engineering
4.ETL process
etc.