: Databricks Engineer (UK Remote -- 3 to 12 Years Experience)
Position:
Databricks Engineer
Employment Type:
Full-time, Permanent
Work Mode:
Fully Remote (UK-based)
Experience:
3 to 12 years
Eligibility:
Must have right to work in the UK
Key Responsibilities
Design, implement, and maintain data pipelines, ETL/ELT workflows using Databricks (Spark, PySpark/Scala) and related technologies.
Work with large-scale data sets, perform data transformations, data cleansing, and data modelling.
Integrate data from multiple sources (structured and unstructured) and ensure data quality and integrity.
Collaborate with data scientists, analysts, and stakeholders to enable analytics, reporting, and ML/AI workloads.
Optimize performance of data processing, ensure scalability, efficiency, and cost-efficiency.
Maintain documentation, version control, and follow best practices for data governance and security.
Contribute to architecture/design decisions for data infrastructure, and help evolve the data platform over time.
Required Skills & Experience
Strong hands-on experience with
Databricks
and
Apache Spark
(PySpark and/or Scala).
Solid experience with
data engineering
, ETL/ELT processes, data modelling, and working with large data sets.
Proficiency in
Python
(or Scala) and SQL.
Good understanding of cloud platforms (e.g. AWS, Azure, GCP) and cloud-native data services.
Experience in building and maintaining production-grade data pipelines and data workflows.
Strong analytical, problem-solving skills, and attention to data quality.
Ability to work independently in a remote environment, collaborate across teams, and communicate effectively.
Job Types: Full-time, Permanent
Pay: 45,000.00-90,000.00 per year
Benefits:
* Work from home
Beware of fraud agents! do not pay money to get a job
MNCJobs.co.uk will not be responsible for any payment made to a third-party. All Terms of Use are applicable.