Databricks Engineer - £400PD - Remote

London

1 month ago

Applications closed

Related Jobs

View all jobs

Data Solution Architect

Databricks Engineer - £400PD - Remote

About the Role

We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven decision making across the business.

Key Responsibilities

Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.

Build and optimise data lakehouse architectures on Azure Data Lake Storage (ADLS).

Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows

Implement best practices for data governance, security, and quality across all pipelines.

Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models.

Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation.

Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOps

Required Skills & Experience

3+ years' experience as a Data Engineer working in Azure environments.

Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling).

Solid knowledge of Azure cloud services including:

Azure Data Lake Storage

Azure Data Factory

Azure Synapse / SQL Pools

Azure Key Vault

Strong programming skills in Python and SQL.

Experience building scalable, production-grade data pipelines.

Understanding of data modelling, data warehousing concepts, and distributed computing.

Familiarity with CI/CD, version control, and DevOps practices.

Nice-to-Have

Experience with streaming technologies (e.g., Spark Structured Streaming, Event Hub, Kafka).

Knowledge of MLflow, Unity Catalog, or advanced Databricks features.

Exposure to Terraform or other IaC tools.

Experience working in Agile/Scrum environments.

To apply for this role please submit your CV or contact Dillon Blackburn on (phone number removed) or at (url removed).

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Feb 10, 2026

Careers

How Many Edge Computing Tools Do You Need to Know to Get an Edge Computing Job?

If you’re trying to start or grow a career in edge computing, it can feel like you’re navigating a maze of tools, frameworks and platforms — Kubernetes, Docker, IoT frameworks, AWS Greengrass, Azure IoT Edge, OpenShift, TinyML toolkits, networking orchestration, real-time streaming frameworks, and on it goes. Scroll job boards and community forums and it’s easy to conclude that unless you master every buzzword imaginable, you’ll never get a job. Here’s the honest truth most edge computing hiring managers won’t necessarily say out loud: 👉 They don’t hire you because you know every edge computing tool — they hire you because you can solve real system problems using the tools you know. Tools matter, yes — but only when they support clear outcomes: reliable systems, performance at scale, secure edge deployments and real business value. So how many edge computing tools do you actually need to know to secure a job? For most edge computing roles, the answer is fewer than you think — and a lot clearer when sorted by fundamentals and roles. This guide shows you what matters, what doesn’t, and how to focus your time wisely so you come across as capable, confident and employable.

Feb 3, 2026

Jobs

What Hiring Managers Look for First in Edge Computing Job Applications (UK Guide)

In today’s fast-evolving tech landscape, edge computing is one of the most sought-after fields — blending distributed systems, embedded systems, networking, cloud, IoT, data and real-time processing. But that also means hiring managers are highly selective. They scan applications fast and look for signals of relevance, impact, technical depth and real-world delivery long before they read every line. This guide demystifies what hiring managers in edge computing look for first in your application — so you can tailor your CV, portfolio and cover letter to jump out of the stack. Whether you’re targeting edge systems roles, embedded IoT edge jobs, edge-native data roles, edge platform engineering or edge-AI positions, this checklist will help you position your experience in a way hiring managers can trust immediately.

Jan 23, 2026

Education

The Skills Gap in Edge Computing Jobs: What Universities Aren’t Teaching

Edge computing is rapidly moving from niche concept to critical infrastructure. As organisations deploy connected devices, sensors, autonomous systems and real-time analytics, processing data closer to where it is generated has become essential. From smart cities and manufacturing to healthcare, transport, defence and telecommunications, edge computing underpins systems where latency, reliability and resilience matter. Demand for edge computing skills across the UK is rising steadily — yet employers consistently report difficulty finding candidates who are genuinely job-ready. Despite growing interest and academic coverage, universities are not fully preparing graduates for real edge computing jobs. This article explores the edge computing skills gap in depth: what universities teach well, what they consistently miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build sustainable careers in edge computing.