IT Business Analyst
ETRM, Endur, Gas & Power
ago
Location
Waterloo, London
Hybrid
Salary
Competitive
Employment Type
Contractor
Experience Level
Entry
Junior
Mid
Senior
Expert
Our Client
Global Energy Company
SPECIALTY
Upstream/Downstream, Bio-Fuels, Integrated Gas, New Energies, Chemicals, Energy and Trading
INDUSTRY
Energy
Company Size
80000+ Employees
Aubay's Take
Our client is one of the Super Major global energy companies with who are working to power progress through cleaner energy solutions. You will have the opportunity to work in a challenging but rewarding environment that is fast paced and changing fundamentally, and work towards transforming the business of a Super Major energy company to meet the ambition to be a net-zero emissions energy business by 2050, whilst delivering a world class business case that has a strong societal license to operate. In your role you will be expected to enact change and deliver value globally across business lines and geographies.
Role Summary
Aubay UK is seeking an experienced Tech Lead (Azure Databricks Data Platform) to lead the design, development, and delivery of enterprise-scale data platform solutions leveraging the Azure Data Platform and Databricks ecosystem. The successful candidate will be responsible for providing end-to-end technical leadership across data engineering initiatives, driving solution architecture, platform strategy, engineering standards, and delivery excellence. Working closely with business stakeholders, architects, product teams, and engineers, the Tech Lead will translate complex business requirements into scalable, high-performance data solutions that support critical business operations and analytics capabilities. This role requires deep hands-on expertise in Azure Databricks, Structured Streaming, Delta Live Tables (DLT), PySpark, Python, and SQL, alongside strong stakeholder management and leadership skills. The ideal candidate will have a proven track record of delivering large-scale cloud data platforms, optimising platform performance and costs, and mentoring engineering teams to achieve successful business outcomes.
Required Skills and Experience:
- Strong hands-on experience with Azure Databricks, PySpark, Python, and SQL
- Experience within financial trading, commodities trading, or energy trading environments
- Understanding of trading data models and trading business processes
- Experience building and supporting enterprise-scale data platforms on Microsoft Azure
- Expertise in Structured Streaming and Delta Live Tables (DLT)
- Experience designing scalable, high-performance data solutions and architectures
- Strong understanding of data governance, data quality, and engineering best practices
- Experience leading technical delivery from design through to production support
- Strong stakeholder management and communication skills
- Experience leading and mentoring engineering teams
Desired Skills and Experience:
- Experience optimising Databricks performance and managing cloud platform costs
- Knowledge of Lakehouse architecture and modern data platform design patterns
- Experience working within Agile delivery environments
- Relevant Azure and/or Databricks certifications
Roles and Responsibilities:
- Lead the design, development, and implementation of scalable data platform solutions using Azure and Databricks
- Provide technical leadership across the full solution lifecycle, from architecture through delivery and production support
- Define and promote best practices for data engineering, governance, security, quality, and platform standards
- Design and optimise real-time data processing solutions using Structured Streaming and Delta Live Tables (DLT)
- Collaborate with business stakeholders to translate business requirements into technical solutions
- Drive technical decision-making and ensure alignment with platform strategy and business objectives
- Monitor and optimise platform performance, reliability, scalability, and cloud costs
- Support the development of data architecture, integration patterns, and engineering roadmaps
- Mentor Data Engineers and provide technical guidance across delivery teams
- Ensure successful delivery of business outcomes through strong ownership, accountability, and leadership
- Work closely with architects, product teams, and stakeholders to manage technical risks, dependencies, and priorities
- Promote continuous improvement and adoption of modern data engineering practices across the platform team
This site uses cookies 🍪
We use cookies and similar technologies to give you a personalised browsing experience, personalised advertising and to analyse our web traffic. Click 'Accept' if you'd like to allow all cookies. Alternatively, you can choose which types of cookies you'd like to accept or disable by clicking 'Reject' below. For more information, please see our Cookie Policy.