Description

At Jemena, a centralised Data Hub Platform was architected and delivered, transforming how operational data is ingested, processed, analysed, and visualised across departments. This initiative enabled real-time decision-making and improved network reliability and efficiency across Australia’s energy infrastructure.

Key Features

  • Real-Time & Batch Pipelines: Integrated SAP/HANA, AWS S3, Confluent Kafka for both streaming and batch processing.

  • Predictive Analytics: Used ML models for outage planning, load balancing, and power quality.

  • Operational Dashboards: Unified visualisation across GIS, ADMS, ODW, and SCADA systems.

  • Alerting System: Introduced proactive monitoring using AWS CloudWatch and ServiceNow.

Technologies Used

  • Cloud & Data: AWS, Databricks, Kafka, SAP HANA

  • Integration: Delta Lake, AWS Glue, ServiceNow

  • Analytics: ML-based models for predictive maintenance

  • Monitoring: AWS CloudWatch, integrated with custom dashboards

Design Highlights

  • Designed with a future-ready architecture using Databricks Lakehouse

  • Seamless data reconciliation using automation pipelines

  • Dynamic load balancing visualised via interactive dashboards