Senior Data Engineer

Bedford, ENG, GB, United Kingdom

Job Description

Details


-----------


Reference number




420297

Salary




62,000
Circa
GBP

Job grade




Other

Contract type




Permanent

Business area




MAPS - Technology & Change

Type of role




Architecture and Data

Information Technology

Working pattern




Flexible working, Full-time, Homeworking

Number of jobs available




1

Contents


------------

Location About the job Benefits Things you need to know Apply and further information

Location


------------


Bedford

About the job


-----------------

Job summary



Senior Data Engineer



c.62,000 per annum



Bedford Based



Hybrid Working



Permanent





Join us at the Money and Pensions Service (MaPS) as a Senior Data Engineer where you will design and lead the implementation of data flows to connect operational systems, data for analytics and business intelligence (BI) systems predominantly in a Microsoft Azure environment.


The Senior Data Engineer reports to the Lead Data Engineer. The role is aligned to the Government Digital and Data Profession Capability Framework: Senior Data Engineer: https://ddat-capability-framework.service.gov.uk/role/data-engineer#senior-data-engineer


You'll be part of a dynamic team dedicated to helping people across the UK improve their financial wellbeing. Specifically, the role will focus on supporting reporting for the Pensions Dashboard Programme and MoneyHelper Pensions Dashboard: https://www.pensionsdashboardsprogramme.org.uk/

Job description



Data Pipelines and ETL Processes



ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools like Apache Spark to ensure seamless data flow. Monitoring and Failure Recovery: Implement monitoring procedures to detect failures or unusual data profiles and establish recovery processes to maintain data integrity.

Azure Services



Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions using Azure's suite of services.

Collaboration and Leadership



Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs. Provide technical leadership and mentorship to junior data engineers, fostering a culture of continuous learning and improvement.

Data Governance and Quality



Ensure data governance policies are adhered to and maintain high standards of data quality and security. Develop and enforce best practices for data management and integration. Ensure only thoroughly tested, high quality code, architecture and resulting Data Products are delivered to the MaPS business.

Data Landscape



Understanding & interest of broad architectural principles underlying modern data architecture. E.g. Data Lakes, External tables, medallion architecture, loose coupling.

o Reporting & analysis tooling. An understanding of report tooling such as Power BI & the needs of analysts consuming engineered data into these tools.

About Us



The Money and Pensions Service (MaPS) is based in Bedford, in a recently renovated modern office. This is a wonderful opportunity for you to become an integral part of a dynamic organisation, working to help people across the UK.


At the heart of the Money and Pensions Service are our values - caring, connecting, and transforming, which are the foundation of our success. They permeate every area of our work and define all our business relationships and the way we work with each other. We're not only looking for the best people to come and work for us, but we need people who align themselves with our values:

Caring


We care about our colleagues and the people whose lives we are here to transform.

Connecting


We will transform lives through our ability to make positive connections.

Transforming


We are committed to transforming lives and making a positive societal impact.

Our Inclusive Working Environment



By fostering our values, we are immensely proud of the inclusive working environment that we have created. The diversity of our people is a strength that we embrace and wish to build upon, so we are committed to attracting people of all backgrounds. We work hard to ensure that we have a progressive approach to inclusion, equity, and belonging. We really do want our colleagues to "bring their whole selves to work."


Our colleague and ally networks encompass LGBTQ+, neurodiversity, women's health, men's health, ethnicity, and diversity.

Flexible Working



At MaPS, we take pride in our flexible approach to work. As standard, we work on a hybrid basis with a minimum of 2 days in the office per week. Hybrid working is a voluntary, non-contractual arrangement and our headquarters in Bedford will be your contractual place of work. The number of days that anyone will be able to work at home will be determined primarily by business needs, but personal and other relevant circumstances will also be considered. If you are successful, any opportunities for hybrid working, including whether a hybrid working arrangement is suitable for you, will be discussed with you prior to you taking up your post.

Career Development



In MaPS, we take career development seriously. We actively encourage and support applications from our existing MaPS colleagues. However, we do follow the Civil Service Commissioner recruitment principles, which means that you will be required to participate in a full, open, and fair process.

Person specification



You will need to demonstrate the following skills and experience;



Proven experience as a Data Engineer, with a focus on Azure services. Strong expertise in designing and implementing ETL processes. Experience in using SQL to query and manipulate data. Proficiency in Azure data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and Azure Data Factory. Understanding of data extraction from vendor REST APIs. Spark/Pyspark or Python skills a bonus or a willingness to develop these skills. Experience with monitoring and failure recovery in data pipelines. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills.

Benefits


------------


This role will offer the opportunity to develop your career in a Cloud only environment with a high level of technical freedom, working with other highly technical and skilled engineers as well as benefits below:

Generous Annual Leave - 30 days plus Bank Holidays Pension scheme - contributions matched 2 to 1 (up to 10% of your salary) Interest-free loan for season tickets for buses and trains Cycle to work Scheme Subsidised eye tests & flu jabs Life assurance scheme Give as you earn scheme Employee assistance programme (EAP) PAM Assist and PAM Life scheme (Wellbeing) Enhanced family and sick pay Paid volunteering (2 days a year) Recognition Scheme Discounts portal to numerous retailers

Things you need to know


---------------------------

Selection process details



Application Process



The law requires that selection for appointment to the Civil Service is on merit on the basis of fair and open competition as outlined in the Civil Service Commission's Recruitment Principles. If you feel your application has not been treated in accordance with the Recruitment Principles, and you wish to make a complaint, in the first instance, you should contact the Money and Pensions Service via email: recruitment@maps.org.uk. If you are not satisfied with the response you receive from the Department, you can contact the Civil Service Commission: Visit the Civil Service Commission website.

Reserve List



If you are successful at interview, we operate a reserve list where your details will be held for up to 6 months. Should a vacancy come available in that time with the same essential criteria, reserve list candidates will be offered that position with no further assessment required.

Job Reference:

MaPS00923

Close Date:

13/08/2025



Feedback will only be provided if you attend an interview or assessment.

Security




Successful candidates must undergo a criminal record check.
People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements




This job is broadly open to the following groups:


UK nationals nationals of the Republic of Ireland nationals of Commonwealth countries who have the right to work in the UK nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS) individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020 Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
Further information on nationality requirements

Working for the Civil Service




Please note this Post is NOT regulated by the Civil Service Commission.
The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

Diversity and Inclusion




The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan and the Civil Service Diversity and Inclusion Strategy .

Apply and further information


---------------------------------


Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants



#

Job contact :



Name : Ben Walsh Email : ben.walsh@reed.com
#

Recruitment team



* Email : ben.walsh@reed.com

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.uk will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3480335
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bedford, ENG, GB, United Kingdom
  • Education
    Not mentioned