Journey of Building a Data Lake on AWS
Journey of Building a Data Lake on AWS – from Ideation to Business Value The number one question we get asked from our potential data lake customers is “how do I set up a production ready enterprise data lake and how long does it take to build one”. From our experience of building data lakes on AWS for the past three years, it could take anywhere between 3 months to 1 year depending on the end goal. To understand the timelines for building data lakes, let us first go through the details of the journey of setting up a data lake from scratch. Who Wants to Build a Data Lake? Enterprise customers are always searching for insights from a variety of data sources. Most of the times they have to deal with challenges like (a) combining data from two or more data sources and (b) limitations of technology platforms. These challenges draw them into exploring a data lake based solution. Every customer has a unique set of requirements. Yet, there are two distinct categories of customers approaching