Engineer the Quantum RevolutionYour expertise can help us shape the future of quantum computing at Oxford Ionics.

View Open Roles

Big Data Engineer

London
1 month ago
Applications closed

Related Jobs

View all jobs

Data Engineering Manager

Senior Data Architect

Senior Data Engineer

Lead Azure Data Engineer

Data Engineer - Gen AI - £140,000

Data Engineer - Gen AI - Remote

Big Data Engineer – Defence & National Security
📍 Full-time, On-Site | 💷 £77,400 – £116,000 | UK Citizenship & Highest Level Clearance Required | 🧳 Relocation Assistance Available

Work at the cutting edge of national security and big data innovation.

My client is seeking an experienced Big Data Engineer to help design, implement, and optimise scalable data systems that support critical AI, ML, and data science operations in a secure, mission-focused environment. This is a high-impact, high-trust role, supporting the UK’s most sensitive digital transformation programmes.

🔧 Key Responsibilities:



Automate and troubleshoot complex data workflows using tools like NiFi and Airflow

*

Design secure, scalable data systems with GDPR and privacy in mind

*

Integrate and maintain big data platforms like Hive, Impala, and Elasticsearch

*

Support hybrid cloud infrastructure (on-premise + AWS)

*

Enable AI/ML environments using tools such as Jupyter, Spacy, and Transformers

*

Use BI tools like Tableau, Kibana, and PowerBI for reporting and insight delivery

*

Collaborate across engineering and data science teams to deliver high-impact outcomes

✅ You’ll Need:

*

Strong scripting and Linux system administration skills

*

Deep understanding of TCP/IP, OSI models, and network troubleshooting

*

Experience with NoSQL databases and big data architectures

*

Track record supporting AI/ML pipelines in regulated or secure environments

*

Excellent problem-solving and integration testing skills

🌟 Desirable:

*

AWS/cloud certifications

*

Experience with Cloudera, Hadoop, CDSW, or CML

*

Background in defence, intelligence, or highly regulated industries

🎯 Why Apply?

*

Be part of a mission with real national impact

*

Competitive salary & benefits

*

Supportive team, with access to cutting-edge tools and training

*

Work on-site with some of the most advanced data systems in the UK

Define what’s possible. Apply now and help build the future of secure data in defence

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

The Future of Edge Computing Jobs: Careers That Don’t Exist Yet

Edge computing is one of the fastest-growing frontiers in technology. Where cloud computing centralises data and processing, edge computing pushes it closer to where data is generated—on devices, sensors, vehicles, and local hubs. This shift enables real-time decision-making, reduces latency, and powers innovations such as autonomous vehicles, smart cities, augmented reality, and advanced manufacturing. In the UK, edge computing is gaining momentum as telecoms roll out 5G, manufacturers deploy IoT systems, and healthcare organisations adopt real-time monitoring. Government, industry, and academia are collaborating to establish the UK as a leader in edge-enabled innovation. Yet as with all transformative technologies, edge computing is only at the beginning of its journey. Many of the careers that will shape this sector in 10–20 years don’t exist today. This article explores why new roles are emerging, what they might look like, how current jobs will evolve, why the UK is well placed to lead, and how professionals can prepare.

Jobs

Seasonal Hiring Peaks for Edge Computing Jobs: The Best Months to Apply & Why

The UK's edge computing sector has emerged as one of Europe's most dynamic and technically demanding technology markets, with roles spanning from junior edge systems engineers to principal edge architects and heads of distributed computing. With edge computing positions commanding salaries from £35,000 for graduate systems engineers to £150,000+ for senior principal architects, understanding when organisations actively recruit can dramatically accelerate your career progression in this cutting-edge and rapidly expanding field. Unlike traditional cloud computing roles, edge computing hiring follows distinct patterns influenced by IoT deployment cycles, 5G infrastructure rollouts, and distributed systems project timelines. The sector's unique combination of hardware-software integration, real-time processing requirements, and ultra-low latency demands creates predictable hiring windows that strategic professionals can leverage to advance their careers in building tomorrow's distributed computing infrastructure. This comprehensive guide explores the optimal timing for edge computing job applications in the UK, examining how enterprise IoT strategies, telecommunications infrastructure deployment, and Industry 4.0 initiatives influence recruitment patterns, and why strategic timing can determine whether you join a pioneering edge research team or miss the opportunity to develop the next generation of distributed computing systems.

Jobs

Pre-Employment Checks for Edge Computing Jobs: DBS, References & Right-to-Work and more Explained

Pre-employment screening in edge computing reflects the discipline's unique position at the intersection of distributed systems architecture, real-time processing, and critical infrastructure deployment. Edge computing professionals often have privileged access to mission-critical systems, industrial control networks, and sensitive operational data that form the backbone of autonomous systems and real-time decision-making capabilities. The edge computing industry operates within complex regulatory frameworks spanning cyber security directives, industrial safety standards, and emerging IoT governance regulations. Edge computing specialists must demonstrate not only technical competence in distributed architecture and low-latency systems but also deep understanding of operational technology security, industrial protocols, and the safety implications of real-time autonomous systems. Modern edge computing roles frequently involve managing industrial control systems, autonomous vehicle networks, smart city infrastructure, and critical operational systems across multiple security domains and regulatory frameworks simultaneously. The combination of system-level privileges, real-time control capabilities, and safety-critical responsibilities makes thorough candidate verification essential for maintaining security, operational continuity, and public safety in edge-deployed systems.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.