Job Description

Cloud Data Engineer @ MATTER

About us:

We are a forward-thinking Data & Technology Company that drives improved Sales & Marketing outcomes.


We combine cutting-edge AI and Machine Learning with a culture built on innovation, quality over quantity, and continuous learning.


With a relaxed, people-focused environment--offering flexible work-from-home options, a pet-friendly office, and no dress code (I mean, you must wear something) --we invest in our team's growth while leveraging technology to drive high-quality, data-driven sales and marketing strategies to expedite client growth

Job Overview:

We are seeking a motivated and skilled Cloud Data Engineer with 2+ years of experience to join our team. The ideal candidate will have a solid foundation in data engineering with a focus on Microsoft Azure cloud services. They will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure that supports our business's data requirements. This role is perfect for someone who has already gained some experience in the field and is eager to further develop their skills in a dynamic and collaborative environment.

Key Responsibilities:

Data Pipeline Development: Design, build, and manage robust data pipelines using Azure Data Factory, Azure Databricks, and other relevant Azure services, such as Azure Functions. Data Storage Management: Manage and optimise cloud data storage solutions, including Azure Data Lake, Azure SQL Database, and Cosmos DB. ETL Processes: Develop and maintain ETL (Extract, Transform, Load) and ELT processes to ensure the accurate and efficient transfer of data between systems. Data Integration: Integrate data from various sources and ensure that data is processed, stored, and accessed in a secure and scalable manner. T-SQL Development: Write, optimise, and maintain complex T-SQL queries to support data extraction, transformation, and reporting needs. Automation: Automate repetitive data tasks and processes to improve efficiency and reliability. Data Visualisation: Develop and manage Power BI reporting. Data Governance: Implement and maintain data governance and security practices in line with organisational policies and best practices. Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data needs and ensure that data infrastructure supports business objectives. Performance Optimisation: Monitor and optimise the performance of data solutions, ensuring high availability and minimal downtime. Documentation: Maintain comprehensive documentation of data architectures, processes, and systems for reference and troubleshooting.

Ideal Qualifications and Experience:

Experience: 2+ years of experience in data engineering, with a strong focus on cloud-based solutions using Microsoft Azure. Technical Skills: + Proficiency with Azure Data Factory, Azure Databricks, and Azure SQL Database.
+ Strong understanding of ETL processes and tools.
+ Experience in data warehouse design and development.
+ Proficiency in T-SQL development, including writing and optimising complex queries.
+ Experience with Power BI, including Power Query and DAX.
+ Familiarity with programming languages such as Python, SQL, and Scala.
Cloud Knowledge: Solid understanding of cloud computing principles and practices, specifically within the Azure ecosystem. Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot complex data issues. Communication: Excellent communication skills, with the ability to work collaboratively in a team environment. Certifications: Relevant Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus but not required.

Education:

Degree in Computer Science, Information Technology, Engineering, or a related field; or equivalent experience.