OKTO is seeking a Senior Data Engineer to lead the architecture and implementation of a mission-critical digital operations system for several major projects. This role is foundational to our mission - connecting diverse system endpoints such as power ,airflow, heating, medical gas and fire alarms into a centralised, resilient cloud-based infrastructure.
You will be responsible for designing the end-to-end data lifecycle from high frequency time series ingestion to the creation of a "Master Dashboard" that ensures critical systems remain vital, accurate and trustworthy.
OKTO provides industry leading investment per employee in personal development and on-going training.
We are committed to employing the best qualified and highest certified technical team in the UK.
The successful permanent applicant will enjoy 4,000.00 per annum investment in their own personal development every year.
The successful permanent candidate will also receive a number of employment benefits such as:
Company pension
Cycle to work scheme
Paid volunteer time
Private medical insurance
Birthday holiday
Free lunch Fridays
Length of service benefit
Cinema tickets
Free annual eye test
Responsibilities:
Data architecture & modelling: Design and implement a scalable architecture on Microsoft Azure to organise raw system data into curated, reporting-ready layers.
Operational system integration: Build robust pipelines to ingest and process high-frequency time-series and IoT-like data from critical infrastructure.
Cloud database production: Develop and manage the foundational cloud database using Azure Databricks, Synapse and Data Lake to serve as the single source of truth.
Real-time processing: Implement and optimise streaming workloads using Kafka, Event Hub and Spark Streaming to ensure low-latency data availability for life-critical monitoring.
Governance & compliance: Enforce strict data quality frameworks and maintain PII/PHI compliance, ensuring the integrity of sensitive healthcare and operational data.
Visualisation & reporting: Collaborate with stakeholders to design and deploy the "Master Dashboard" using Power BI, utilising DAX and semantic models for actionable insights.
Requirements:
Azure mastery: Deep expertise in the Azure Ecosystem, specifically Databricks, Azure Data Factory (ADF), Synapse and Unity Catalog.
Data engineering: Proficiency in Python, PySpark and Spark SQL for ETL/ELT pipeline development.
Time-series expertise: Proven experience handling real-time, high frequency data feeds (e.g. aviation, sensor or industrial data)
Schema design: Advanced knowledge of Star and Snowflake Schemas and Lakehouse architectures.
Quality assurance: Hands-on experience with data validation tools like Great Expectations and observability platforms like Grafana.
DevOps: Familiarity with CI/CD processes using Azure DevOps or GitHub Actions.
Preferred Qualifications:
6+ years of experience in data engineering with a focus on resilient, high availability systems.
Strong understanding of security protocols, including RBAC and Row-level Masking.
Ability to work closely with AI/ML teams to support predictive maintenance or digital data products.
What's in It for You?
Chance to be part of a focused and goal driven team
Work alongside next generation building and estate controls and design technology and software
An environment that helps foster personal and professional development offering in-house and industry training
A hardworking and personally accountable working environment
Excellent career progression opportunities
The technical training includes:
BCIA bms training
AVIXA AV training
Cnet IT training
Nexus labs Smart Building training
CEDIA training Smart Home Training
Extensive Manufacturer / service provider training including:
Schneider
Tridium
Barco
Crestron
Aruba
Cisco
Power BI
Azure
Management training includes:
Report writing
Email writing
Commercial management
Health and safety
First aid
Job Type: Full-time
Pay: 75,000.00 per year
Experience:
Data Engineering: 1 year (preferred)
Work authorisation:
United Kingdom (required)
Work Location: On the road
Beware of fraud agents! do not pay money to get a job
MNCJobs.co.uk will not be responsible for any payment made to a third-party. All Terms of Use are applicable.