Principal Data Engineer (Python)
ago
Location
Waterloo, London
Hybrid
Salary
£95k+
Experience Level
Entry
Junior
Mid
Senior
Expert
Technologies Used
Azure
Python
SAP
AWS
Our Client
Global Energy Company
SPECIALTY
Upstream/Downstream, Bio-Fuels, Integrated Gas, New Energies, Chemicals, Energy and Trading
INDUSTRY
Energy
Company Size
80000+ Employees
Aubay's Take
Our client is one of the Super Major global energy companies with who are working to power progress through cleaner energy solutions. You will have the opportunity to work in a challenging but rewarding environment that is fast paced and changing fundamentally, and work towards transforming the business of a Super Major energy company to meet the ambition to be a net-zero emissions energy business by 2050, whilst delivering a world class business case that has a strong societal license to operate. In your role you will be expected to enact change and deliver value globally across business lines and geographies.
Benefits from Aubay
At Aubay UK, people are at the heart of our business. We offer a competitive remunerations package which includes a range of benefits. You will receive continuous support from our dedicated team of Talent Acquisition Specialists who will support your career development and success during your assignment with our client.
25 Days Annual Leave
Work From Home Opportunities
Pension Scheme
Opportunities to Work Directly with our Client
Training Opportunities
Discount Holidays at I'Aero Chalet
Role Summary
Aubay is seeking an experienced Principal Data Engineer to lead the design and implementation of robust data platforms and solutions for our client. This is a vital role in shaping the data landscape, with a focus on collaboration, innovation, and continuous learning. You will have the opportunity to engage across multiple teams and lead key initiatives that influence the future of the organisation's data strategy. The role focuses on creating a data-driven approach across both technical and business teams, delivering efficient and scalable solutions that maximise value from data. As a hands-on technical leader, you will drive the vision and data strategy, ensuring that IT solutions are future-ready while influencing the wider business community.
Required Skills and Experience
- 10+ years of experience in Python backend engineering, with expertise in building elastic containerised web services in Azure.
- University degree in any IT discipline.
- Expertise in prototyping, solution design, and delivering end-to-end projects.
- Able to work/demo on POCs involving new technologies.
- Champion in working with any OLTP/OLAP databases; highly experienced in building and optimising complex queries. Highly experienced with data manipulation, processing, and extracting value from large, disconnected datasets.
- Deep subject matter expertise with technologies such as BODS, SLT, HANA, BW.
- Proven expertise working with reporting tools like SAC (SAP Analytics Cloud), WEBI, etc.
- Hands-on experience to conceptualise, design, and deliver end-to-end data solutions using the above-mentioned technologies.
- Experienced working with NoSQL databases, big data sets, and big data technologies.
- Excellent communication and interpersonal skills; a skilled communicator capable of speaking to both technical developers, architects, and stakeholders.
- Hands-on experience designing data foundation initiatives like data modelling, data quality, data governance, data maturity assessments, and data strategy in support of key business stakeholders.
- Self-motivated, innovative, and very good at taking up new initiatives and driving them.
- Proven experience in working with source control technologies (such as GITHUB, Azure DevOps).
- Must have experience in working with AGILE and KANBAN methodologies.
Desired Skills and Experience
- Gas/Power Trading knowledge - Short-term trading, physical assets trading (CCGT, Wind, Solar, Battery).
- Risk - Modelling & understanding of risk & risk management.
- Quantitative Skills - Statistical methods to check and investigate numerical data for practical insights.
- Commodity Modelling - Energy (power, gas, environmental products) and meteorology.
- Experience in project management, running a scrum team.
- Experience working with BPC, Planning.
- Exposure to working with the external technical ecosystem.
- Managing small teams.
Key Role Responsibilities
- Leading the development of Python-based backend systems, including elastic containerised web services in Azure.
- Designing and implementing automatic deployment pipelines for efficient, scalable delivery.
- Creating and optimising low-latency data aggregation solutions for real-time data access.
- Implementing observability and monitoring solutions to ensure service reliability and performance.
- Demonstrating strong leadership in Site Reliability Engineering (SRE) practices and data engineering community initiatives.
- Conceptualising and designing end-to-end data foundations and solutions to support key business programmes.
- Acting as a visible leader for data engineers, mentoring team members and driving community growth through presentations, training, and thought leadership.
- Collaborating with stakeholders to translate data needs and requirements into scalable data solutions, ensuring traceability throughout the project lifecycle.
- Championing continuous improvement and implementation efficiency, reducing costs and maximising delivery speed.
- Providing expertise in cloud technologies (Azure, AWS, SAP) and leading innovation in data engineering practices, ensuring alignment with evolving business needs.
- Engaging with both technical and business stakeholders to drive change, improvement, and the development of future-ready IT solutions.