Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Azure Data Engineer - £500 - Hybrid

Newcastle upon Tyne
3 days ago
Create job alert

Azure Data Engineer - £500PD - Hybrid

We are seeking an Azure Data Engineer with strong experience in Databricks to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have hands-on expertise across Azure data services, data modeling, ETL/ELT development, and collaborative engineering practices.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL).
  • Build and optimize ETL/ELT workflows that ingest data from various on-prem and cloud-based sources.
  • Work with Azure services including Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure SQL, and Event Hub.
  • Implement data quality validation, monitoring, metadata management, and governance processes.
  • Collaborate closely with data architects, analysts, and business stakeholders to understand data requirements.
  • Optimize Databricks clusters, jobs, and runtimes for performance and cost efficiency.
  • Develop CI/CD workflows for data pipelines using tools such as Azure DevOps or GitHub Actions.
  • Ensure security best practices for data access, data masking, and role-based access control.
  • Produce technical documentation and contribute to data engineering standards and best practices.

    Required Skills and Experience
  • Proven experience as a Data Engineer working with Azure cloud services.
  • Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration.
  • Strong SQL and data modeling skills (e.g., dimensional modeling, data vault).
  • Experience with Azure Data Factory or other orchestration tools.
  • Understanding of data lakehouse architecture and distributed computing principles.
  • Experience with CI/CD pipelines and version control (Git).
  • Knowledge of REST APIs, JSON, and event-driven data processing.
  • Solid understanding of data governance, data lineage, and security controls.
  • Ability to solve complex technical problems and communicate solutions clearly.

    Preferred Qualifications
  • Industry certifications (e.g., Databricks Data Engineer Associate/Professional, Azure Data Engineer Associate).
  • Experience with Azure Synapse SQL or serverless SQL pools.
  • Familiarity with streaming technologies (e.g., Spark Structured Streaming, Kafka, Event Hub).
  • Experience with infrastructure-as-code (Terraform or Bicep).
  • Background in BI or analytics engineering (Power BI, dbt) is a plus.

    To apply for this role please submit your CV or contact Dillon Blackburn on (phone number removed) or at (url removed).

    Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment

Related Jobs

View all jobs

Databricks Engineer - £400PD - Remote

PySpark Developer

Lead Data Engineer - Microsoft Fabric - Hybrid - £75k

Azure DevOps Engineer

IT Engineer - Rubrik Backup and Hybrid Cloud Protection

AI Developer/Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Neurodiversity in Edge Computing Careers: Turning Different Thinking into a Superpower

Edge computing is where the digital world meets the physical one. From smart factories & connected cars to wearables & drones, edge systems bring compute closer to where data is generated so decisions can be made in real time. That means: Complex, distributed architectures Tight performance constraints Safety-critical decisions at the network edge It also means edge computing needs people who think differently – people who can see patterns in systems, ask unusual questions, spot tiny anomalies & imagine new ways to build reliable, low-latency tech. In other words: it needs neurodiversity. If you live with ADHD, autism or dyslexia, you may have been told your brain is “too chaotic”, “too literal” or “too distracted” for a deep technical role. In reality, many traits that can make school or traditional offices hard line up beautifully with edge computing work. This guide is for neurodivergent job seekers exploring edge computing careers in the UK. We’ll look at: What neurodiversity means in an edge computing context How ADHD, autism & dyslexia strengths map to edge roles Practical workplace adjustments you can ask for under UK law How to talk about your neurodivergence in applications & interviews By the end, you’ll have a clearer sense of where you might thrive in edge computing – & how to turn “different thinking” into a real career advantage.

Edge Computing Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK edge computing hiring has moved from tool‑lists to capability‑driven assessments that emphasise resilient edge architectures, real‑time data pipelines, secure device fleets, container/Kubernetes at the edge, on‑device/near‑edge ML, and measurable business impact (latency, reliability, cost‑to‑serve). This guide explains what’s changed, what to expect in interviews & how to prepare—especially for edge platform engineers, IoT/OT engineers, edge SREs, embedded/firmware engineers, edge AI/ML engineers, network engineers (5G/private LTE), security specialists & product managers. Who this is for: Edge platform/SRE, IoT solution architects, embedded/firmware developers, edge AI/ML engineers, network engineers (5G/SD‑WAN), security engineers (OT/ICS), data/streaming engineers, site deployment/field engineers & edge product managers targeting roles in the UK.

Why Edge Computing Careers in the UK Are Becoming More Multidisciplinary

For years, computing innovation was focused on the cloud. But as demand for real-time analytics, low-latency processing and secure local data handling grows, edge computing has become the next frontier. From autonomous vehicles to healthcare monitoring devices, retail checkout systems to industrial IoT, edge computing is transforming how data is processed and used in the UK. This shift has also changed what it means to work in the field. Edge computing careers are no longer purely technical. They now require knowledge of law, ethics, psychology, linguistics & design, as professionals must consider regulation, human behaviour, communication & usability alongside engineering. In this article, we’ll explore why UK edge computing careers are becoming more multidisciplinary, how these five fields intersect with edge roles, and what job-seekers & employers need to know to thrive in this evolving landscape.