Job Description

Job Summary

As part of the Data Engineering team, you will be working alongside our Clients' Data team, and will assist with the transfer of information to support on-going project delivery.

You will work closely with the Principal Architect and Information Architects to understand business priorities for the Data teams as well as the wider business.
Our client's business is in the North of England and you will be expected to work from there and our London office for one day per week each.

Duties

Develop and maintain robust data pipelines using technologies such as Hadoop and Spark. Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications. Implement data integration solutions using tools like Informatica. Write efficient SQL queries to extract, transform, and load (ETL) data from various sources into a centralised data warehouse. Utilise Shell Scripting and Python for automation of repetitive tasks and data manipulation. Conduct thorough analysis of datasets to identify trends, anomalies, and opportunities for improvement. Ensure data quality by implementing validation checks and monitoring processes. Document processes, workflows, and technical specifications for future reference.

Qualifications

Proven experience in a Data Engineering role or similar position. 2 + Years Experience in Python in a work setting 2 + Years Linux systems and their administration 2+ Years experience in (

BigQuery,

PostgreSQL, MSSQL,) 1+ years of work experience with Infrastructure as Code (IaC) tools or languages as (Terraform, OpenTofu, Pulumi etc.) 1+ years of work experience in maintaining/developing CI/CD pipelines. High attention to detail Ability to estimate and deliver on-time Higher education degree

Strong Knowledge of Modern Data Architectures

: In-depth understanding of contemporary data architectures, including Data Warehouses, Data Lakes, and Lakehouses, and their various applications and use cases.

Experience with Cloud Infrastructure

: Demonstrated experience working with cloud platforms (AWS, Azure, or GCP) to build, manage, and optimize data solutions.

Development Lifecycle Management

: Practical experience in the full development lifecycle, from development through UAT to production.

Join us in shaping the future of our data-driven initiatives while working in an innovative environment that values your contributions!

Job Types: Full-time, Permanent

Pay: 45,000.00-55,000.00 per year

Benefits:

Company pension Work from home
Schedule:

Monday to Friday
Application question(s):

Able to spend 1 day in Doncaster and 1 day in London weekly
Language:

English (required)
Work authorisation:

United Kingdom (required)
Location:

Doncaster DN6 7NA (preferred)
Willingness to travel:

25% (required)
Work Location: Hybrid remote in Doncaster DN6 7NA

Application deadline: 21/05/2025
Expected start date: 02/06/2025