Job Description

Senior Data Engineer

Permanent role

Salary: Competitive salary + excellent benefits

Start: ASAP

Location: Remote working with travel to the Client site in Cardiff required 1-2 days per month

We require a Senior Data Engineer to join the Clients Data Governance & Engineering team who provide a major role in providing quality and reliable data to feed into analytics products used by the business for decision making.

You will be actively involved in the technical design, planning and implementation of data structures and pipelines within both their on-premises (Microsoft SQL Server) and cloud (Microsoft Azure) environments. On occasion, you may be required to deputise for the Lead Data Engineer, to liaise with stakeholders etc. As a senior member of the team, you will also support the learning and development of junior members of the team.

We are looking for a talented individual to join the Client as they continue their data and analytics journey.

There will be opportunity to get involved with the latest cloud-based technologies and advanced analytics, and to be part of a collaborative, supportive and high-performing team within the organisation.

This is an exciting role that will allow you to play a key role in developing their new cloud-based data platform. As Senior Data Engineer, you will be working on technical data engineering development on the new platform, whilst supporting an existing set of SQL Servers that are predominantly used to feed data into a number of analytics products produced by the Data Team to help the business with data-led decision making.

Your responsibilities will include

1. Mentoring and supporting Data Engineers within the team, helping ensure developed solutions are robust, efficient and add business value

2. Designing and implementing data engineering projects on both on-premise and cloud based data stacks, delivering efficient solutions that comply with architectural and data security requirements

3. Being able to work collaboratively as part of a team, whilst also being trusted to work individually where necessary. Approaching collaborative projects with others in a positive manner to problem-solve, and identify viable solutions to overcome issues and challenges

4. Working closely with technical colleagues within key teams such as Integrated Technology Services (ITS) - to ensure relevant information technology components and services are in place to accommodate developed solutions.

5. Remain aware of new data engineering approaches, and be able to suggest how the latest research, techniques and approaches could be implemented to achieve business benefit

6. Undertaking any other duties as required to meet the needs of the business.

As the Senior Data Engineer you will possess the following skills & experience:

• Relevant undergraduate degree (BSc) in computer science, mathematics or related discipline, relevant long term experience or MCSA/MTA certification.
• Around 5 years\' experience in any of the following or related fields: database management, data architecture, data platform management
• At least 2 years\' experience using cloud-based data stack (e.g. Azure, AWS, GCP)
• Substantial experience of data pipeline design and management
• Good understanding of database administration activities and principles
• Good understanding of typical ingestion patterns (e.g. ETL, ELT) and their effective implementation with on-premise and cloud-based environments
• Knowledge of typical data modelling approaches (e.g. Kimball)
• Data transformation approaches
• Strong Python and SQL programming capabilities
• Experience using the Microsoft data stack (especially Azure Data Lake, Azure Synapse, Azure Data Factory)

This role offers flexible working arrangements, pension scheme plus excellent benefits too.

Solutions welcome applications from all sections of the community and from people with diverse experience and backgrounds

Certes Computing