Business intelligence tools can only be effective if we provide them with the right data. The process of designing a system to do this is data engineering, and the specific processes are referred to as ETL: Extract, Transform, and Load. The idea is conceptually simple, yet identifying all the available data sources and formats and then developing systems to extract and transform this data can get complicated. What would be the top three or four challenges associated with doing this? How would you overcome these challenges? Consider an organization you are familiar with. What types of data does this organization need? How would you begin to approach the process of data engineering to perform an ETL process on that data?
Source: AltexSoft, https://www.youtube.com/watch?v=qWru-b6m030 This work is licensed under a Creative Commons Attribution 3.0 License.