Senior Data Engineer
Trading
ago
Location
Waterloo, London
Hybrid
Salary
Competitive
Employment Type
Full Time
Experience Level
Entry
Junior
Mid
Senior
Expert
Our Client
Global Energy Company
SPECIALTY
Upstream/Downstream, Bio-Fuels, Integrated Gas, New Energies, Chemicals, Energy and Trading
INDUSTRY
Energy
Company Size
80000+ Employees
Aubay's Take
Our client is one of the Super Major global energy companies with who are working to power progress through cleaner energy solutions. You will have the opportunity to work in a challenging but rewarding environment that is fast paced and changing fundamentally, and work towards transforming the business of a Super Major energy company to meet the ambition to be a net-zero emissions energy business by 2050, whilst delivering a world class business case that has a strong societal license to operate. In your role you will be expected to enact change and deliver value globally across business lines and geographies.
Benefits from Aubay
At Aubay UK, people are at the heart of our business. We offer a competitive remunerations package which includes a range of benefits. You will receive continuous support from our dedicated team of Talent Acquisition Specialists who will support your career development and success during your assignment with our client.
25 Days Annual Leave
Work From Home Opportunities
Pension Scheme
Opportunities to Work Directly with our Client
Training Opportunities
Discount Holidays at I'Aero Chalet
Role Summary
Aubay is seeking a Senior Data Engineer to join our Supermajor client’s trading & supply space and build a robust data infrastructure that supports research and systematic trading strategies. The role involves designing, optimising, and managing real-time and historical market data pipelines in a cloud-native environment, enabling advanced analytics such as TCA and pre/post-trade insights.
Required skills and experience
- Minimum 8 years’ experience in Commodity Trading, Capital Markets, or Investment Banking
- Strong understanding of global futures exchanges and the exchange-traded derivatives lifecycle
- 5+ years working with large financial datasets (market data, order/execution data, positions data)
- 5+ years of experience with real-time market data distribution platforms and feed handlers
- Strong programming/scripting skills (Python, PowerShell, C#, SQL or similar)
- Experience with time-series databases (e.g., KDB, OneTick)
- Knowledge of Parquet-based data storage
- Solid experience in Linux environments and scripting (Bash, Perl)
- Experience building and maintaining high-performance data pipelines
- Strong understanding of data validation, monitoring, and error handling
- Exposure to trading analytics (TCA, pre- and post-trade analytics)
Desired skills and experience
- Familiarity with Kubernetes, containerization, and orchestration tools
- Experience with Databricks or Apache Iceberg
- Advanced experience with time-series databases (KDB, OneTick)
- Experience optimising query performance for large-scale datasets
Role Responsibilities
- Design, build, and maintain real-time and historical market data pipelines
- Evaluate, onboard, and integrate complex data products from external vendors
- Collaborate with traders, stakeholders, and engineering teams to define data requirements
- Develop and enhance analytical data services and statistical functions
- Optimise data infrastructure for fast query execution and high performance
- Ensure data integrity through validation, monitoring, and error handling processes
- Provide operational support, troubleshooting, and issue resolution for data pipelines
- Support the development of trading strategies through high-quality data delivery
- Continuously improve data solutions to enhance trading performance and analytics
This site uses cookies 🍪
We use cookies and similar technologies to give you a personalised browsing experience, personalised advertising and to analyse our web traffic. Click 'Accept' if you'd like to allow all cookies. Alternatively, you can choose which types of cookies you'd like to accept or disable by clicking 'Reject' below. For more information, please see our Cookie Policy.