Big Data Engineer (java Or Scala) Remote Working

Newcastle upon Tyne, United Kingdom

Job Description

Big Data Engineer (Java Scala Azure Spark) New digital disruptor looking for experienced Java Big Data Engineers for greenfield programme 6+ years of hands-on-experience in Java or Scala is a must, ideally in a high transactional data environment. Experience in many of the following;

  • Data Engineering tech; Spark Batch, Spark Streaming, Hive, Oozie or Airflow, Kafka, NoSQL DBs, Mongo, HBase
  • Data Platforms like Cloudera HDP, CDH, Databricks
  • Data storage formats like ORC, Parquet, Avro
  • Cloud Data Platform development (Azure, GCP, AWS)
  • DevOps culture, Docker and/or Kubernetes containers
  • CI/CD pipelines (ie jenkins)
  • TDD/BDD methodologies, Git
  • Security of data platforms; SSL, RBAC, Kerberos
  • Data pipeline designs
#dataengineers #dataengineerjobs #javajobs #scalajobs #spark #bigdata #azure #cloudera #datapipelines INSIDE IR35 – this assignment will fall within scope of IR35 legislation and appropriate umbrella company should be utilised during this assignment. This advert was posted by Staffworx Limited – a UK based recruitment consultancy supporting the global E-commerce, software & consulting sectors. Services advertised by Staffworx are those of an Agency and/or an Employment Business. Staffworx operate a referral scheme of £500 or new iPad for each successfully referred candidate, if you know of someone suitable please forward for consideration.

Beware of fraud agents! do not pay money to get a job will not be responsible for any payment made to a third-party. All Terms of Use are applicable.

Related Jobs

Job Detail

  • Job Id
  • Industry
    Not mentioned
  • Total Positions
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
  • Job Location
    Newcastle upon Tyne, United Kingdom
  • Education
    Not mentioned