Data Engineering Challenges in Energy Demand Data
In today’s time, utility companies face challenge to make the large volumes of data useful and generate actionable insights from it. At E.ON , we are committed to turn data into value for our customers. We want to share our Data Engineering principles that we use to drive and deliver solutions across all our businesses, showing their impact on core company targets.
The data platform provides state-of-the-art analytics to enable conscious energy consumption, improve our customers user experience at home, and gain unprecedented insights from energy consumption data. In this session, we will focus on how we used our Blueprint Architecture consisting of Databricks for handling complex data structure. We will discuss further in a use case of how using Databricks we were able to process and visualize summary of data quality on-demand using its Dashboard functionality. We will present our current challenges and how we plan to overcome this in future.