Job Summary
You will be working alongside our Clients' Data team in their Google Cloud environment, and will assist with the transfer of information to support on-going project delivery.
You will work closely with the Principal Architect and Information Architects to understand business priorities for the Data teams as well as the wider business.
You will be expected to work from our London office for one day per week, with occasional client visits.
Duties
Develop and maintain robust data pipelines using technologies such as Apache Airflow.
Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications.
Write efficient SQL queries to extract, transform, and load (ETL) data from various sources into a centralised data warehouse.
Utilise Shell Scripting and Python for automation of repetitive tasks and data manipulation.
Conduct thorough analysis of datasets to identify trends, anomalies, and opportunities for improvement.
Ensure data quality by implementing validation checks and monitoring processes.
Document processes, workflows, and technical specifications for future reference.
Qualifications
Senior experience in a Data Engineering role or similar position with expert level demonstration of;
MNCJobs.co.uk will not be responsible for any payment made to a third-party. All Terms of Use are applicable.