Data Engineer (Tech Lead)
ago
Location
Waterloo, London
Hybrid
Salary
£100k+ per year
Experience Level
Entry
Junior
Mid
Senior
Expert
Our Client
Global Energy Company
SPECIALTY
Upstream/Downstream, Bio-Fuels, Integrated Gas, New Energies, Chemicals, Energy and Trading
INDUSTRY
Energy
Company Size
80000+ Employees
Aubay's Take
Our client is one of the Super Major global energy companies with who are working to power progress through cleaner energy solutions. You will have the opportunity to work in a challenging but rewarding environment that is fast paced and changing fundamentally, and work towards transforming the business of a Super Major energy company to meet the ambition to be a net-zero emissions energy business by 2050, whilst delivering a world class business case that has a strong societal license to operate. In your role you will be expected to enact change and deliver value globally across business lines and geographies.
Benefits from Aubay
At Aubay UK, people are at the heart of our business. We offer a competitive remunerations package which includes a range of benefits. You will receive continuous support from our dedicated team of Talent Acquisition Specialists who will support your career development and success during your assignment with our client.
25 Days Annual Leave
Work From Home Opportunities
Pension Scheme
Opportunities to Work Directly with our Client
Training Opportunities
Discount Holidays at I'Aero Chalet
Role Summary
Aubay is seeking a Data Engineer (Tech Lead) to join a prestigious energy sector client, leading the delivery of high-impact data engineering solutions. This is a hands-on technical leadership role, responsible for designing robust data foundations, optimising performance and cost efficiency, and driving end-to-end delivery of data platforms. The successful candidate will lead a team of engineers while actively contributing to solution development, ensuring alignment with strategic business objectives and best practices in data architecture.
Required Skills and Experience:
- Previous experience leading large and global Data engineering teams. Technically leading the design and development of scalable data engineering solutions, leveraging technologies such as Databricks (DLT), PySpark, ADF, andSQL.
- Extensive experience in data engineering with strong hands-on expertise in Databricks, including DLT, performance tuning, and cost optimisation.
- Proficiency in PySpark, Python, and SQL for large-scale data manipulation and processing.
- Strong background in designing and implementing ELT pipelines using tools such as Azure Data Factory and Synapse.
- Deep expertise in data modelling and architecture, supporting scalable and maintainable data solutions.
- Experience with cloud platforms including Azure, AWS, and SAP.
- Skilled in DevOps and CI/CD practices using GitHub Actions, Azure DevOps, SonarQube, and PyTest.
- Familiarity with key data engineering tools including Glue, Airflow, Stream Analytics, Kinesis, Redshift.
- Proven ability to lead engineering teams and drive technical delivery across multiple projects.
- Excellent communication skills with the ability to work effectively across business and technical teams.
Desired Skills and Experience:
- Experience managing Agile or Scrum teams, including project planning and delivery tracking.
- Background in planning solutions using tools such as BPC.
- Exposure to working within a global external technical ecosystem.
- Previous experience managing small teams or working in a team leadership capacity.
- Familiarity with technical documentation tools such as MkDocs.
Role Responsibilities:
- Lead the design and development of scalable data engineering solutions, leveraging technologies such as Databricks (DLT), PySpark, ADF, andSQL.
- Guide and mentor a team of data engineers, ensuring high standards of quality, performance, and delivery across projects.
- Drive performance tuning, cost optimisation, and efficient use of data resources across cloud platforms.
- Collaborate with stakeholders across business and IT to align data engineering efforts with broader strategic objectives.
- Champion a data-driven culture by promoting best practices and fostering innovation within the team.
- Contribute to architecture decisions and lead technical discussions to ensure sound, future-ready solutions.
- Conduct code reviews, solution walkthroughs, and provide hands-on technical oversight.
- Coordinate incident, change, and problem management processes to ensure stability and continuous improvement.
- Present technical strategies and results to both technical and non-technical audiences.
- Actively contribute to community-building initiatives such as Centres of Excellence and Communities of Practice.