Senior Data Engineer

Overview

Job Description

Responsibilities

• - Own the design, reliability, and resilience of ingestion pipelines end-to-end, including TSDS, with a clear recovery strategy when things break.
• - Build and maintain ETL/ELT pipelines for new and existing data sources.
• - Decide the right approach (batch vs. streaming) for each pipeline in your domain, including high-scale, low-latency requirements for time-series data.
• - Set data quality checks that make an SLA commitment possible, and hold the line on them.
• - Own the day-to-day reliability of the data platform: monitoring, testing, and fixing issues before they become firefights.
• - Own code quality and standards for the systems you're responsible for, including CI checks (linting, tests, coverage).
• - Work through the existing tech debt backlog, prioritising fixes that unblock SLA commitments.
• - Optimise pipelines for performance and cost as data volumes grow.
• - Handle the failure modes specific to energy data: late arrivals, reprocessing, backfills.
• - Build and improve observability across your systems so problems surface before they cause downstream impact.
• - Set up alerting tied to the SLAs the team is committing to.
• - Investigate and resolve issues within your domain, escalating genuinely cross-system problems.
• - Help scope and prepare the platform for new data sources tied to international expansion.
• - Flag where current architecture won't hold up as scope grows, even if fixing it isn't your call to make alone.
• - Work closely with the AI team as their data needs on the platform grow.

Required Skills

• - Strong Python skills, with proven experience building and maintaining production data pipelines.
• - Experience owning the design, reliability, and resilience of a data pipeline or system end-to-end, not just writing pipeline code.
• - AWS or GCP experience.
• - Great communication skills, comfortable working directly with stakeholders to scope and agree SLAs, and explaining technical trade-offs to non-technical audiences.
• - Strong team player, comfortable working independently against a backlog and making judgement calls on prioritisation, while fitting into an existing team of 4.
• - Terraform experience.

Benefits

• - Salary aligned to internal benchmarks and reviewed twice a year.
• - Stock options so everyone has ownership in our mission.
• - 25 days holiday plus public holidays.
• - Swap public holidays for the ones that matter most to you, and enjoy your birthday off.
• - Remote first and flexible working, with clear core hours and no internal meetings on Friday afternoons.
• - Home working and wellbeing budgets: Up to GBP1,200 or EUR1,200 per year for your remote setup.
• - Up to GBP150 or EUR150 per month for wellbeing.