National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Data Engineer

Daresbury
1 week ago
Create job alert

Data Engineer - Daresbury

Role Description

As a Data Engineer will be a core member of the wider technical team, responsible for designing, building, and optimising the pipelines that turn raw network, commercial, and operational data into trustworthy, analytics-ready assets. Working closely with Data Analysts, Network Engineering, and Digital teams, you will own our data platform, ensuring data is accurate, timely, and secure to drive reporting, automation, and develop towards AI-driven decision-making.

Key Responsibilities

• Design, develop and maintain scalable ELT/ETL pipelines that ingest data from network devices (IPDR, SNMP, OSS/BSS), CRM, finance, and IoT platforms into our BI warehousing environment.

• Model data using Kimball/star schemas and data-vault principles to support BI and self-service analytics.

• Implement data quality, lineage, and observability tooling (e.g., dbt tests, Great Expectations, Azure Purview).

• Optimise storage and compute costs through partitioning, incremental loads, and automation.

• Collaborate with DevOps to embed CI/CD and Infrastructure-as-Code (Terraform, Azure DevOps pipelines).

• Work with stakeholders to capture data requirements and translate them into technical solutions.

• Ensure data is handled in line with GDPR, ISO-27001, and company security policies. • Mentor junior data team members and champion a data-driven culture across ITS.

About You

• Proven experience as a Data Engineer (or similar), building cloud data platforms.

• Strong SQL and Python skills for data transformation and automation.

• Hands-on with modern ELT frameworks (e.g., dbt, Fivetran, ADF, Synapse Pipelines). • Experience with version control (Git) and CI/CD for data.

• Knowledge of data modelling techniques and performance optimisation.

• Familiarity with data governance, security, and privacy best practices.

Desirable

• Experience with network-centric datasets (fiber, GPON, ethernet, Wi-Fi telemetry).

• Exposure to streaming technologies (Kafka, Event Hubs) and real-time analytics.

• Knowledge of Machine Learning Ops (MLflow, Databricks)

Related Jobs

View all jobs

GCP Data Engineer

Big Data Engineer

AWS Data Engineer

Senior Software Engineer

Data Scientist

Senior Developer - Data & AI

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Edge Computing Recruitment Agencies in the UK You Should Know (2025 Job‑Seeker Guide)

As AI moves closer to devices and latency matters more than ever, edge computing is scaling fast. UK hiring for edge-aligned roles—IoT infrastructure, 5G, MEC, embedded AI, and low-latency networking—has risen +39 % YoY, according to Lightcast (Q1 2025). Yet supply lags behind: fewer than 10,000 engineers in the UK list edge computing, and 700–900 roles remain open each month. This guide lists 10 UK-registered agencies specialising in embedded, networking, and distributed-systems roles. You’ll find: Verified recruiters with edge/IOT practices Salary medians for mid-level roles Skills in demand & prep tips FAQs and next steps to land your next role

Edge Computing Jobs Skills Radar 2026: Emerging Frameworks, Tools & Technologies to Learn Now

Edge computing is reshaping how we process data—bringing computation closer to devices, sensors, vehicles, and factories. In 2026, the UK’s edge computing landscape is booming, driven by autonomous systems, IoT, 5G, and AI workloads that can’t wait on cloud latency. Welcome to the Edge Computing Jobs Skills Radar 2026—a forward-looking guide to the tools, frameworks, platforms, and programming languages that are powering the UK’s most in-demand edge computing jobs. Whether you’re building smart cameras, working on industrial automation, or deploying microservices to the edge, this radar will keep your skills sharp and relevant.

How to Find Hidden Edge Computing Jobs in the UK Using Professional Bodies like BCS, IET & More

Edge computing is reshaping the way data is processed and delivered across industries—from real-time IoT in manufacturing to low-latency systems in healthcare, defence, and smart cities. With its growing influence, demand for UK-based edge computing professionals is rising rapidly. But here’s what most job seekers don’t realise: many edge computing jobs aren’t listed on public job boards. Instead, they’re shared through private networks, CPD events, special interest groups, and technical communities. In this guide, we’ll show you how to access these hidden job opportunities by engaging with professional bodies like the BCS, IET, TechUK, and niche edge computing communities. We’ll explore how to use directories, events, and collaborative ecosystems to position yourself at the front of the queue—before roles even go live.