Enterprise Data Lakes: Design Patterns and Anti-Patterns
Vikram Sharma
Every data centric organization wants to setup their own Enterprise data lake for their needs. The motivation may vary from democratization of data to transparent and centralized access control to just staying up to speed with the buzz. With the recent data explosion, organizations are generating massive amount of data in a variety of forms and velocity. Consequently, the need to maintain a centralized single source of truth that can be utilized to suit multiple needs is greater than ever. However, this is not a one size fits all situation. The needs are different so are the mechanisms and the type of data. We will explore the underlying concepts of an enterprise data lake, common patterns of usage and how to identify what works and what does not for the current need. We will also touch upon the building blocks of data lakes and a comparison and contrast of the available technologies.