Description

At Jemena, a centralised Data Hub Platform was architected and delivered, transforming how operational data is ingested, processed, analysed, and visualised across departments. This initiative enabled real-time decision-making and improved network reliability and efficiency across Australia’s energy infrastructure.

Key Features

• Real-Time & Batch Pipelines: Integrated SAP/HANA, AWS S3, Confluent Kafka for both streaming and batch processing.

• Predictive Analytics: Used ML models for outage planning, load balancing, and power quality.

• Operational Dashboards: Unified visualisation across GIS, ADMS, ODW, and SCADA systems.

• Alerting System: Introduced proactive monitoring using AWS CloudWatch and ServiceNow.

Technologies Used

• Cloud & Data: AWS, Databricks, Kafka, SAP HANA

• Integration: Delta Lake, AWS Glue, ServiceNow

• Analytics: ML-based models for predictive maintenance

• Monitoring: AWS CloudWatch, integrated with custom dashboards

Design Highlights

• Designed with a future-ready architecture using Databricks Lakehouse

• Seamless data reconciliation using automation pipelines

• Dynamic load balancing visualised via interactive dashboards