Job Description

DevOps Engineer (Fixed Term)
The successful candidate must be a self-starter, highly motivated and hardworking, with clear communication skills. The role will be primarily focused on enhancing our AWS cloud infrastructure and architecture, further developing our existing GitLab CI/CD infrastructure, as well as being responsible for its maintenance, enabling the whole team to make continuous progress, in a fast pace, while ensuring best practices and mitigating risk of failures. They will be joining a well-established Trading desk, where team members are comfortable in writing code, and able to work in small increments, making frequent deployments and releases to production whenever they feel the need. You will be responsible to enhance overall developer experience, helping the whole team to improve its capabilities to use AWS infrastructure more efficiently, reducing costs and speeding up our general feedback loop time.

Principal Responsibilities

Maintain and improve our GitLab CI/CD infrastructure - we need reduced pipeline times, and we need to be able to run more concurrent pipelines for merge requests simultaneously without one interfering on another. The ultimate artifact that gets deployed and release into our production environments is a Docker container. We need to optimize the builds of those Docker containers for faster speed/build times and for reduced image size. AWS is our cloud infrastructure. Optimize the usage of those AWS services that the team needs, focusing on ensuring scalability and performance, while keeping costs under control. Work with other team members to educate on AWS best practices, as well as working with Infrastructure teams to extend our capabilities of fully provisioning holistic environments in AWS in an automated, repeatable and auditable fashion. We have several existing AWS EC2 instances and On-Premises Servers that are running Linux. Housekeeping on those hosts is required sometimes, so maintaining those servers, as well as developing tooling for automating that kind of maintenance. All applications and services developed by the team are fully written in Python. A good understanding and previous experience on how Python projects are structured, how Python packaging works, how libraries are installed in runtime environments, how conda environments come to life, and usage of tools like conda (mamba/pixi as well) is desired. The team will be looking for contributions on applying Python best practices for project structure and packaging, in the context of a Monorepo (we have all our code in a single codebase, where applications and libraries are structured internally, and inter-dependencies are expected). Support other team members to troubleshoot network issues (e.g.: proxy issues, network latency), development environment issues (local or on Dev Boxes).

Qualifications/Skills Required

AWS Docker Linux (system administration and configuration) Python Terraform GitLab CI/CD pipelines (experience with Python Monorepos is a plus) * Airflow (nice to have)