Job Description

Join Elexon as a Data Engineer . The ideal candidate will bring experience in building, maintaining, and optimising data pipelines to support the data needs of multiple cross-functional teams. Hybrid working & Excellent Benefits available.

Team Overview:

The Data Engineering team is dedicated to building and maintaining a robust, scalable cloud-based data platform that empowers internal users to perform advanced analytics on a self service basis. Our mission is to streamline data operations, ensure data integrity and enhance data accessibility across the organisation. By supporting the development of our next generation of data products, we aim to drive innovation and support cutting-edge solutions that meet the evolving needs of our customers and stakeholders.

Job Purpose:

The candidate will be experienced in building, maintaining, and optimising data pipelines to meet the data needs of multiple cross-functional teams. Their expertise in data engineering will enable them to contribute to Elexon's digital strategy by leveraging data to drive actionable insights, enhance decision-making processes, and fuel innovation across various business domains. Additionally, the candidate will be responsible for implementing robust data governance and security measures, ensuring compliance with regulatory requirements and protecting the confidentiality, integrity and availability of data assets.

Key Responsibilities:

Develop Azure based Data Platforms using selected tools based on the Microsoft Azure Well Architected Framework Build, orchestrate & monitor ETL/ELT jobs/pipelines Collaborate with Elexon Data Architects to implement Data Models for Analytical Workloads Collaborate with Data Analysts/Scientists & Analytics Engineers to develop data processing pipelines using Python / Spark to serve Machine Learning models Maintain metadata about the data residing within the Data Lake
Explore ways to enhance data quality and reliability
Identify opportunities for data acquisition Align architecture with business requirements Knowledge transfer within the Data Engineering team

Capabilities and competencies:

Critical:

Experience building and maintaining Azure cloud based Data Lakes Strong analytic skills related to working with large, structured and unstructured datasets Experience building ETL/ELT pipelines Advanced knowledge of SQL including query optimisation Strong Programming background specifically in Python/PySpark Experience with big data tools (Hadoop, Spark, Kafka, etc.) Background in MS Azure platform and services (Data Factory, Synapse, Databricks etc.) Version controlling and CI/CD pipelines Experience with database technologies (relational, NoSQL, graph) Infrastructure as code such as Terraform

Developmental / Desirable:

Experience in energy industry, particularly the electricity industry Experience using MLOps tools such as MLflow in Databricks Experience of project methodologies including Agile Background in application development

Elexon career path / Potential next role(s):

Senior Data Engineer: As a proficient Data Engineer, there is the potential to continue developing your technical skills and expertise, paving the way for advancement into Senior Data Engineering roles Lead Data Engineer: Develop line management skills to lead a team and projects, shaping the direction of data engineering efforts More analytical focused roles supporting Machine Learning model development
Solutions Architect: Apply technical expertise to design end-to-end data solutions
Data Architect: Lead the design and development of data architectures

In return, Elexon provides:

60,000 28 days annual holiday + Bank Holidays Discretionary annual incentive scheme Life assurance Pension Private medical (Bupa) Private dental (Bupa)

At Elexon, our employee wellbeing is particularly important to us, which is why we are proud to provide:

Hybrid working - 2 days per week at our London office BUPA health check Employee Assistance Programme Eye care voucher scheme Subsidised gym membership Cycle to Work Scheme Buying & selling holiday scheme Computing scheme Corporate Social Responsibility (CSR) days Season ticket loan
We believe a diverse and inclusive culture allows innovation and creativity to flourish. We are committed to continuously improving our culture for our colleagues and stakeholders. Through our hugely successful Diversity Forum, Mental Health First Aid network and regular programme of activities and events, we celebrate difference and recognise the value of employee wellbeing, which is a consistent outcome from annual employee surveys that we conduct. Likewise, as a community, we like to support each other, and all agree Elexon is a great place to work with a great workspace too!

At Elexon, we want to:

Provide true equality of opportunity

Attract and retain diverse talent

Listen to all voices

Be representative of the communities we work in

Be a role model for Diversity and Inclusion in the industry

Elexon together, embracing differences, listening to all voic

es