Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Databricks Engineer - £400PD - Remote

London
1 week ago
Create job alert

Databricks Engineer - £400PD - Remote

About the Role

We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven decision making across the business.

Key Responsibilities

Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.

Build and optimise data lakehouse architectures on Azure Data Lake Storage (ADLS).

Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows

Implement best practices for data governance, security, and quality across all pipelines.

Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models.

Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation.

Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOps

Required Skills & Experience

3+ years' experience as a Data Engineer working in Azure environments.

Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling).

Solid knowledge of Azure cloud services including:

Azure Data Lake Storage

Azure Data Factory

Azure Synapse / SQL Pools

Azure Key Vault

Strong programming skills in Python and SQL.

Experience building scalable, production-grade data pipelines.

Understanding of data modelling, data warehousing concepts, and distributed computing.

Familiarity with CI/CD, version control, and DevOps practices.

Nice-to-Have

Experience with streaming technologies (e.g., Spark Structured Streaming, Event Hub, Kafka).

Knowledge of MLflow, Unity Catalog, or advanced Databricks features.

Exposure to Terraform or other IaC tools.

Experience working in Agile/Scrum environments.

To apply for this role please submit your CV or contact Dillon Blackburn on (phone number removed) or at (url removed).

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment

Related Jobs

View all jobs

Data Scientist / Quant Engineer

Data Engineering Lead

Azure Cloud Engineer

Data Architect - London - Databricks - 110k + Bonus

Senior Cloud Infrastructure Engineer

Technical Pre Sales Consultant

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Edge Computing Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK edge computing hiring has moved from tool‑lists to capability‑driven assessments that emphasise resilient edge architectures, real‑time data pipelines, secure device fleets, container/Kubernetes at the edge, on‑device/near‑edge ML, and measurable business impact (latency, reliability, cost‑to‑serve). This guide explains what’s changed, what to expect in interviews & how to prepare—especially for edge platform engineers, IoT/OT engineers, edge SREs, embedded/firmware engineers, edge AI/ML engineers, network engineers (5G/private LTE), security specialists & product managers. Who this is for: Edge platform/SRE, IoT solution architects, embedded/firmware developers, edge AI/ML engineers, network engineers (5G/SD‑WAN), security engineers (OT/ICS), data/streaming engineers, site deployment/field engineers & edge product managers targeting roles in the UK.

Why Edge Computing Careers in the UK Are Becoming More Multidisciplinary

For years, computing innovation was focused on the cloud. But as demand for real-time analytics, low-latency processing and secure local data handling grows, edge computing has become the next frontier. From autonomous vehicles to healthcare monitoring devices, retail checkout systems to industrial IoT, edge computing is transforming how data is processed and used in the UK. This shift has also changed what it means to work in the field. Edge computing careers are no longer purely technical. They now require knowledge of law, ethics, psychology, linguistics & design, as professionals must consider regulation, human behaviour, communication & usability alongside engineering. In this article, we’ll explore why UK edge computing careers are becoming more multidisciplinary, how these five fields intersect with edge roles, and what job-seekers & employers need to know to thrive in this evolving landscape.

Edge Computing Team Structures Explained: Who Does What in a Modern Edge Computing Department

Edge computing is expanding rapidly in the UK, driven by demands for low latency, on-site processing, IoT proliferation, autonomous systems, 5G, AI inference on devices, and regulatory pressures for data sovereignty. Businesses in sectors such as telecoms, industrial automation, retail, smart cities, autonomous vehicles, and healthcare are pushing computation and intelligence closer to where data is generated. But to design, build, deploy, secure, and maintain edge computing systems requires more than just hardware or software — it requires structured teams with clearly defined roles and responsibilities. If you’re hiring, or applying for roles via EdgeComputingJobs.co.uk, understanding who does what in a mature edge computing department will help you plan better, show relevance in job applications, and build resilient teams. This article covers the key roles in edge computing teams, how they collaborate through the project lifecycle, what skills and qualifications UK employers usually expect, salary benchmarks, challenges and trends, and best practices for structuring effective edge teams.