Job Description

Job Overview

We are seeking a skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, constructing, and maintaining scalable data pipelines and architectures. You will work closely with data scientists and analysts to ensure the availability of high-quality data for analysis and decision-making. This role requires a strong understanding of both traditional and big data technologies, as well as the ability to work in a fast-paced environment.

Duties

Develop, construct, test, and maintain data architectures (including databases and large-scale processing systems). Design and implement data ingestion processes from various sources into data warehouses. Collaborate with data scientists and analysts to understand their data needs and provide appropriate solutions. Optimise existing data pipelines for performance and scalability. Ensure the integrity, quality, and security of data throughout its lifecycle. Utilise cloud services such as AWS for deploying and managing data solutions. Write efficient SQL queries for data extraction and manipulation. Implement server-side logic using languages such as Java or Python. Create shell scripts for automating routine tasks. Stay updated with emerging technologies in big data, including Hadoop.

Qualifications

Proven experience as a Data Engineer or in a similar role within the field of data management. Strong proficiency in SQL for database querying and management. Familiarity with big data technologies such as Hadoop is advantageous. Experience with cloud platforms, particularly AWS, is highly desirable. Proficiency in programming languages such as Python or Java is essential. Knowledge of server management and scripting (Shell Scripting) is beneficial. Understanding of data warehousing concepts and best practices. Excellent problem-solving skills with the ability to vaticinate potential issues before they arise. Strong communication skills to collaborate effectively with cross-functional teams.
If you are passionate about working with data and have the skills required to excel in this role, we encourage you to apply. Join us in our mission to harness the power of data!

Job Types: Full-time, Permanent

Pay: 25,641.27-34,975.61 per year

Benefits:

Work from home
Schedule:

Monday to Friday
Work Location: Remote