Overview:
We are seeking a skilled Data Engineer to design and develop robust data pipelines that support a cloud-based Data Analytics platform. This role plays a key part in transforming the data landscape and enhancing the Data Warehouse Engineering function.
The successful candidate will contribute to a range of initiatives focused on improving data quality, accessibility, and performance.
Responsibilities:
Design and maintain data pipelines, including error-handling, automation, and performance optimisation.
Resolve data queries by tracing issues to source systems.
Define and deliver cloud-based data analytics platform requirements using modern EDW tools and practices.
Maintain clear and accurate team and technical documentation.
Monitor and improve data quality, consistency, and compliance with standards.
Apply operational procedures, security protocols, and support frameworks to meet service levels.
Recommend development tools to improve delivery efficiency and value.
Document systems, solutions, and processes for database and data engineering deliveries.
Contribute to IT strategy and architecture development.
Ensure solution designs comply with relevant policies, standards, and governance.
Maintain strategic oversight across data engineering components.
Identify and manage risks and issues proactively.
Conduct technical quality checks with leads to ensure standards are met.
Promote lean practices by challenging inefficiencies.
Support the strategic direction of the IT function with a proactive and positive approach.
Essential skills:
Proficient in Azure Data Factory, Azure Synapse, and Snowflake; experience with SSIS is advantageous.
Advanced SQL skills, including dynamic SQL for metadata-driven frameworks.
Strong understanding of relational database principles and data modelling.
Ability to implement DevOps processes to streamline delivery.
Excellent communication and documentation skills.
Resilient and adaptable in dynamic environments.
Experience:
Experience in monitoring and optimising database performance.
Hands-on experience with data engineering tools and frameworks.
Experience with Redgate SQL Toolbelt, SQL Server, Visual Studio, Team Foundation Services, and Python/PySpark.
Experience with Azure platforms and various RDBMS systems (SQL Server, Oracle, MongoDB).
Benefits:
Collaborative working environment - we stand shoulder to shoulder with our clients and our peers through good times and challenges
We empower all passionate technology loving professionals by allowing them to expand their skills and take part in inspiring projects
Expleo Academy - enables you to acquire and develop the right skills by delivering a suite of accredited training courses
Competitive company benefits
Always working as one team, our people are not afraid to think big and challenge the status quo
MNCJobs.co.uk will not be responsible for any payment made to a third-party. All Terms of Use are applicable.