Senior Backend Engineer - Data Engineer

St James's
2 days ago
Create job alert

Our Energy client seeks a Senior Backend Engineer - Data Engineer to join their team in Mayfair, London.

We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions.

Hybrid working is in play, with 3 days in the office and 2 days at home.

Senior Backend Engineer - Data Engineer - About the role:

My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications, user tools, and automated trading workflows.

You will collaborate closely with analysts, data scientists, and business stakeholders to translate requirements into robust, scalable backend solutions. You’ll be responsible for designing and developing services, APIs, data pipelines, and internal applications that integrate analytics and enable better decision-making and operational efficiency.

This is a hands-on role for someone who thrives in a fast-paced, build-first culture without multiple tiers of management. You should be excited to take full ownership of backend development, lead on best practices, and coach others in a collaborative, delivery-focused team.

Experience in retail or wholesale electricity and gas markets is helpful, but a willingness to become an expert in this field is essential. Our success is based on understanding the subject matter from first principles.

Senior Backend Engineer - Data Engineer - Key Responsibilities:

  • Architect, design, develop and maintain backend systems for analytics-driven applications, user tools, and automation workflows.

  • Build and manage APIs and internal services using Python (FastAPI, Flask) and cloud-native tooling.

  • Develop and manage data pipelines, backend components, and supporting infrastructure.

  • Manage server resources and backend processing environments to ensure reliability and scalability.

  • Monitor and maintain application performance, availability, and data quality across production systems.

  • Implement and maintain CI/CD pipelines, testing frameworks, and DevOps practices to enable robust delivery.

  • Write, test, and document code in line with quality standards and engineering best practices.

  • Collaborate with operations, analytics and commercial teams to gather requirements and translate them into scalable technical solutions.

  • Support analysts and data scientists in deploying and operationalising analytics tools and models.

  • Lead or support the data engineering team, help structure development workflows, and mentor junior team members.

  • Stay current with technological advancements and promote a culture of continuous improvement.

  • Present technical solutions to stakeholders and train non-technical users on tools and workflows.

    Senior Backend Engineer - Data Engineer - Skills Required:

  • Python (FastAPI, Flask)

  • REST API development

  • Containerisation: Docker, Kubernetes

  • CI/CD: Azure DevOps, GitHub Actions

  • Software testing and documentation practices

  • SQL, PySpark, Databricks

  • Relational databases and data lake architecture

  • Model and data pipeline integration (e.g. MLflow)

  • Streamlit or other lightweight UI frameworks

  • Microsoft Azure (Functions, Storage, Compute)

  • Monitoring tools (Grafana, Prometheus, etc.)

  • Performance optimisation and resource management

  • Agile delivery practices (Jira, Azure Boards, etc.)

  • Strong communication with technical and business teams

  • Mentoring and knowledge sharing within the team

    Desirable Skills:

  • Experience in energy supply or trading

  • Familiarity with dbt or modular analytics tooling

  • Exposure to forecasting or optimisation workflows

  • Knowledge of React or frontend tools for internal apps

  • Networking or IoT integration experience

    What they offer:

  • A high-autonomy role in a flat, delivery-focused team

  • Ownership of backend systems for real-time analytics and automation

  • A fast-moving, hands-on culture with meaningful technical challenges

  • The opportunity to apply software and data engineering to real-world energy problems

Related Jobs

View all jobs

Senior Software Engineer

Senior Frontend Engineer

Senior Embedded Developer

Senior Software Developer

Senior Security Architect

Senior AI Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Top UK Edge Computing Labs and Institutes: Driving the Next Wave of Digital Innovation

In an era dominated by real-time data and hyperconnectivity, edge computing has emerged as a transformative force in the tech world. By shifting computation and data storage closer to the source—be it IoT devices, sensors, or user smartphones—edge computing minimises latency, improves reliability, and creates unprecedented opportunities for advanced analytics. For businesses in manufacturing, telecom, retail, autonomous vehicles, and beyond, it’s unlocking entirely new possibilities. If you’re searching for a career path in one of tech’s fastest-evolving fields, the UK offers a world-class environment for edge computing research, development, and commercialisation. From government-backed initiatives and academic research labs to bustling tech ecosystems, the UK stands out as a hotbed for innovation. In this in-depth article written for EdgeComputingJobs.co.uk, we explore the leading UK labs and institutes driving edge computing, highlight industry collaborations, and outline how you can build a thriving career at the cutting edge of technology.

Careers

Shadowing and Mentorship in Edge Computing: Gaining Experience Before Your First Full-Time Role

How to Find Mentors, Forge Industry Connections, and Master Emerging Technologies in a Rapidly Evolving Field Introduction Edge computing stands at the forefront of technological innovation, poised to transform industries from manufacturing and logistics to healthcare and smart cities. By bringing computation and data storage closer to the source—be it IoT devices, sensors, or on-site servers—edge computing promises low-latency responses, more efficient data handling, and greater resilience in networked environments. Its potential is immense: think of autonomous vehicles coordinating in real time, industrial robots working seamlessly on factory floors, and remote healthcare devices that can analyse and respond to patient vitals instantly. Despite this momentum, breaking into edge computing can be a challenge for those just starting out. While online courses, academic programmes, or certification paths can teach foundational principles—such as networking protocols, distributed systems, and embedded development—they may only scratch the surface of how these concepts are applied in real-world edge scenarios. In a domain as fast-moving as this, shadowing and mentorship become indispensable for bridging the gap between theory and practice. This article will guide you through the process of finding mentors in the edge computing space and capitalising on shadowing opportunities. We’ll discuss ways to demonstrate your value as a mentee, strategies for building long-term professional connections, and essential tips for positioning yourself for success when applying for your first full-time edge computing role.

Careers

Edge Computing Apprenticeships: Your Guide to a Next-Generation Tech Career

Technology has transformed nearly every facet of our daily lives—from the way we communicate to how we shop, work, and even manage our health. As data volumes skyrocket and latency requirements become stricter, edge computing has emerged as a powerful paradigm in the tech ecosystem. By processing data closer to where it’s generated—rather than relying solely on distant centralised data centres—edge computing enables rapid responses, reduced bandwidth usage, and enhanced security. Organisations across various sectors, from manufacturing to healthcare, are keen to leverage this capability. With the growing emphasis on IoT (Internet of Things), AI-driven devices, and real-time analytics, the demand for professionals skilled in edge computing is intensifying. Edge computing apprenticeships offer an accessible, hands-on pathway to gain these high-demand skills without the need for a traditional university degree. If you’ve been exploring ways to break into tech or pivot to a cutting-edge (pun intended) domain, this article will equip you with everything you need to know about edge computing apprenticeships in the UK.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.