Job Description

Job Advert

Data Engineer - Trade Promotion Management (TPM)

(12-Month FTC)

Location:

Home-based with travel to UK sites

Salary:

40,000 - 45,000 + Benefits

Contract:

Initial 12-month Fixed-Term Contract

Hours:

Full-time, Monday to Friday

About the Role

We are seeking a

Data Engineer

to join our team in a key role supporting the deployment of our

Trade Promotion Management (TPM

) system, UpClear BluePlanner. This is a data-intensive position where the Data Engineer will play a foundational role in ensuring the right data flows into and out of the TPM platform, enabling forecasting, ROI calculations, accruals, and more.



You'll be integral to building and optimizing data pipelines, integrating systems, and ensuring data quality and consistency, with a focus on the smooth operation of our TPM system to drive business performance.

Key Responsibilities

Data Integration & Connectivity

Source Data Ingestion: Build pipelines to extract data from systems such as ERP (SAP, Oracle) for shipments, actuals, pricing, CRM (for customer hierarchies and sales teams), POS/Syndicated Data Providers (e.g., Nielsen, IRI, Retail Link), and Financial Systems (budgets, accruals). Integration Targets: Work with TPM platforms like Salesforce TPM, SAP TPM, o9, Blacksmith, Eversight, Anaplan.

Data Transformation & Mapping

Data Harmonization: Align product and customer hierarchies across systems and match event-level POS or shipment data to planned promotions. Business Logic Implementation: Apply business calculation logic (e.g., lift factors, cannibalization, baseline vs incremental volume) and complex accrual and ROI logic, particularly when not natively handled by the TPM system.

Data Modeling & Storage

Data Warehouse/Lake Setup: Design data models to support promotion master data, actual vs forecasted volume/financials, claim reconciliation, and KPIs for ROI and effectiveness. Performance Optimization: Ensure that queries for reporting dashboards and AI/ML models perform efficiently.

Data Quality & Validation

Validation Rules: Build checks to validate promotion dates vs shipment timelines, identify duplicate promotions, and ensure valid account-product combinations. Error Handling: Develop monitoring and logging systems for failed data loads or mismatches.

Ongoing Maintenance & Enhancements

Job Scheduling & Automation: Utilize tools such as Airflow, Azure Data Factory, or Informatica to automate and schedule data pipelines. Change Management: Adapt data models as business rules or TPM system logic evolves. User Feedback Loop: Collaborate with TPM analysts and business users to refine data outputs and resolve discrepancies.

Knowledge, Skills and Experience

Essential Experience & Skills:

5+ years' experience in a data engineering role within mid-to-large enterprises (FMCG or manufacturing experience is a plus). Strong expertise in modern data platforms and cloud technologies (Azure preferred; AWS/GCP also considered). Proven experience with: + Data lakehouse architectures (e.g., Delta Lake, Snowflake)
+ ETL/ELT tools (e.g., dbt, Azure Data Factory, Airflow, Informatica, Talend)
+ SQL and programming languages (Python, Spark)
+ Real-time data streaming (e.g., Kafka, Azure Event Hub)
+ Integration with Planning Tools (ERP, REST/SOAP APIs, flat file interfaces)
+ Data Quality Tools (Great Expectations, dbt tests)
+ Familiarity with analytics platforms such as Power BI
+ Knowledge of DevOps, CI/CD, and infrastructure-as-code for data pipelines

What We Offer:

Salary:

40,000 - 45,000 + Benefits

Hybrid Working:

Flexibility to work from home with occasional travel to the office or other UK sites.

Growth Opportunity:

An initial 12-month contract with the potential to transition to a permanent position based on performance.

Collaborative Culture:

Work with a dynamic, cross-functional team within a leading food business.

About The Compleat Food Group

We are a forward-thinking company focused on innovation and sustainable practices in the food industry. Join us to contribute to exciting transformation projects and play a key role in shaping the future of our demand planning and data infrastructure.

What You'll Get in Return

Flexible hybrid working with a home base Travel to UK sites as part of a collaborative, people-first business Opportunity to make a tangible impact in a business investing in transformation Competitive salary, benefits, and the potential to move into a permanent role

Why Join Us?

At The Compleat Food Group we're on a mission to create tasty food that's better for people and the planet -- we call it

'Food to Feel Good'

.


We pride ourselves on being a business that gives equal emphasis to

HOW

we operate as well as the financial results we achieve.


Our

5,500 (and growing)

fantastic people make this possible. They are passionate about creating delicious products for UK consumers, leading retailers, and our exciting, market-leading brands, including

Wall's Pastry, Vadasz, Squeaky Bean

, and

Unearthed

.

Benefits to Include:

33 Days annual leave 2 Employee Volunteering Days per year Online and High-street retailer discount scheme Employee well-being and community support groups Informal and Formal training opportunities with personalised online LMS platform Charity Initiatives and Team events 24/7 Access to Grocery Aid (Free Financial, Emotional and Practical Support) Physical Wellbeing Benefits - Free on demand exercise hub and various gym discounts. Online Wellbeing benefits Free Financial wellbeing - mortgage calculators, budget tools, financial aid tools Holiday Discounts via Online Retail Discount


The Compleat Food Group are proud to have built an inclusive and respectful culture where our colleagues feel safe, supported and valued. A place where they can bring their whole selves to work to achieve exceptional results and thrive. We continue to attract diverse talent into our teams, because we know greater diversity leads to exceptional results and provides a better working life. That's why we're committed to ensuring Fairness, Equity, Inclusivity, and Respect in all that we do.



Recruitment Agencies We have an active and trusted Preferred Supplier List to assist us if required. We do not acknowledge any speculative CVs or unsolicited candidate introductions from agencies.