Job Description

Job highlights

Full time
London, Greater London, United Kingdom

Job ID

R200001268

Closing date

29/08/2025

Last Updated

25/08/2025

SUMMARY

Glencore, headquartered in Baar, Switzerland is one of the world's leading integrated producers and marketers of over 90 commodities that industries around the world need. Glencore has worldwide activities in the production, sourcing, processing, refining, transporting, storage, financing and supply of metals and minerals, energy products and agricultural products. We strive to be a reliable and competitive partner in the markets in which we serve and to support our customers and suppliers at each stage of their expansion and development.
Our customers around the world operate in a wide range of industries such as oil, automotive, power generation, steel production and food processing. They rely upon our established global network for supply of metals and minerals, and energy products.
These commodities either originate from Glencore's own production assets or are sourced from third parties.
The Group also provides financing, logistics and other supply chain services to producers and consumers of commodities. Our diversified operations comprise of over 150 mining and metallurgical, oil refining and distribution assets. Our industrial and marketing activities are supported by a global network of more than 90 offices located in over 30+ countries. We employ around 150,000 people, including contractors.
Glencore's Information Technology group develops and supports a range of IT applications and infrastructure to meet the needs of a fast-moving, international commodity trading business. The Oil Assets IT team is focused primarily on supporting Glencore's downstream operations in South Africa and Brazil. The team covers activities across the IT landscape but has a strong data engineering and analytics capability. Glencore uses a wide range of modern IT technologies in London and its other offices and also uses a number of leading commercial applications, providing a diverse set of opportunities and challenges.
Glencore is increasing its cloud footprint and adoption of AI technologies. This role will suit an experienced cloud professional who can bring new knowledge into the team and provide consultancy and guidance to local operations in South African and Brazil.

THE ROLE

As a Senior Data Engineer, you will be part of a team who design, build and maintain scalable, secure, and high-performance data solutions on Microsoft Azure. You will support mission-critical operations across oil trading, refining, and retail fuel distribution by building robust data pipelines, integrating real-time telemetry, and ensuring compliance with regional and international regulations.
This role sits within the Oil Assets IT team, reporting to the Data Engineering Team Lead.
This is a hybrid working position with a minimum of three days a week in the London office, including every other Thursday for team sprint meetings. This is subject to change and you may be required to come in up to five days in a week.
Occasional travel to affiliates in South Africa and Brazil.

PROFILE

Seasoned data engineer with 7+ years of experience, and a strong foundation in designing and managing cloud-native data pipelines, data models, and analytics solutions. Brings hands-on expertise in Azure-based technologies including Synapse Analytics, Data Factory, and Azure SQL, with forward-looking experience in Microsoft Fabric and Databricks. Operates in a fast-paced, business-facing environment, delivering high-quality solutions across multiple parallel workstreams. Self-driven and adaptable, with a deep understanding of the downstream oil and gas domain and a commitment to continuous learning and innovation.

RESPONSIBILITIES

Design and manage scalable data pipelines and ETL/ELT processes using Azure Data Factory, Synapse Analytics, and emerging platforms such as Microsoft Fabric and Databricks.
Collaborate with peers to create and maintain data models and databases in Azure SQL DB and Azure Data Lake.
Ensure data quality, lineage, and availability through rigorous validation, testing, and monitoring practices.
Integrate data from ETRM systems, business applications, refinery control systems, and retail station point-of-sale networks.
Implement real-time analytics solutions using Azure Event Hubs, Stream Analytics, and IoT Hub.
Liaise with multiple functional groups across Glencore Group, the Oil Department and the industrial assets, to provision and deploy infrastructure within Azure.
Implement data governance and security policies using Microsoft Purview and Azure RBAC.
Ensure data quality, lineage, and availability for business-critical applications.
Deliver high-velocity solutions supported by strong coding practices and automation.
Build and maintain multiple pipelines in parallel, managing context switching effectively.
Stay current with modern data technologies and trends, including AI/ML, and advise on their responsible adoption.
Operate independently, driving individual workstreams while contributing to team-wide initiatives

COMPETENCIES

Core Competencies

Bachelor's degree in Computer Science, Information Technology, or equivalent experience.

Data Engineering and Modeling:

Strong grasp of core data modeling concepts and techniques, experience designing and managing ETL/ELT pipelines using Azure Data Factory and Synapse Analytics.

Programming Languages:

Expert proficiency in SQL, Python, and PySpark for data transformation, validation, and analytics.

Cloud Technologies (Azure):

Azure Data Factory (ADF)
Azure Synapse Analytics
Azure Databricks
Azure Data Lake Storage Gen2
Azure SQL
Azure Functions

Version Control and CI/CD:

Experience with Git/GitHub and CI/CD pipelines using GitHub Actions.

Desirable

Visualisation and Reporting:

Skilled in building dashboards and visual narratives using Power BI.

Infrastructure and Automation:

Familiarity with infrastructure-as-code tools such as Terraform; experience provisioning resources in Azure.

Data Governance and Security:

Experience implementing data lineage, cataloguing, and access controls using Microsoft Purview and Azure RBAC.

Real-Time and Streaming Data:

Exposure to Azure Event Hubs, IoT Hub, and Azure Stream Analytics for real-time data processing.

Advanced Tools and Platforms:

Apache Airflow for workflow orchestration
Microsoft Power Platform for low-code solutions
Azure DevOps for collaborative development and deployment
NoSQL/Big Data technologies (e.g., Cosmos DB, Hadoop, or similar)

Machine Learning Engineering:

Understanding of ML workflows and integration into data pipelines.

Certifications

Microsoft Certified: Azure Data Engineer Associate
Microsoft Certified: Azure Solutions Architect Expert
Microsoft Certified: Azure Fundamentals (AZ-900)
Microsoft Certified: Azure AI Engineer Associate
Apache Spark Developer Certification