Senior Big Data Engineer

London, United Kingdom

Job Description


Project description
ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver: Scalable cost-efficient infrastructure, using cloud PaaS components. Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage. Shared across Front Office, Finance and Risk, improving regulatory compliance. One-Platform / One-Experience -fast to train, easy to operate, retaining talent. The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.
Responsibilities

  • Development of big data technologies like Apache Spark and Azure Databricks
  • Programming complex production systems in Scala or Java or Python
  • Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
  • Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
  • Experience with containerisation in development, build and runtime environments including experience of Kubernetes NY salary - 140-150K/year
SKILLS
Must have
  • Development of big data technologies like Apache Spark and Azure Databricks
  • Programming complex production systems in Scala or Java or Python
  • Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
  • Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
  • Experience with containerisation in development, build and runtime environments including experience of Kubernetes
Nice to have
  • Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure) Python experience Testing and instrumentation practices, observability and alerting tooling Understanding of information modelling, data structures and algorithms Technical architecture and low-level design Agile development and planning practices Ability to collaborate effectively in a large global team and influence key architectural decisions

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.uk will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3033043
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    London, United Kingdom
  • Education
    Not mentioned