Overview
In this role you will own and evolve low-latency data pipelines that support commodities trading analytics. You work at the intersection of front office and data services, ensuring reliable, real-time data feeds for traders and researchers. You’ll tackle production incidents, lead data integration across diverse sources, and drive platform migrations in a cloud-native, containerised environment. This is a hands-on role with cross-functional collaboration and a clear impact on trading performance.
Responsibilities
- Design, build and own bespoke low-latency pipelines for demanding data sources
- On-call rota: detect, triage and resolve production data incidents
- Act as SME for PMs and quants on data issues, communicating clearly under pressure
- Uphold engineering standards across the team: reviews, testing, and releases
Key requirements
- 5+ years in data engineering with ownership of production data systems
- Built low latency or near real-time pipelines
- Experience running trade-critical systems on an on-call rota
- Supported front-office or technical users, resolving issues quickly and explaining them clearly
- Experience with long-running platform migrations on containerised, cloud-native infrastructure
- Integrated and normalised diverse non-standard external data sources
- Commodities or energy market exposure is a plus but not essential
- Clear communication with traders and quants
- Strong collaboration across front office and data teams
- Ability to perform under pressure during incidents
- Python (expert) for production services and data pipelines
- SQL (expert) with performance-aware modeling across Snowflake/Clickhouse
- Kubernetes and Docker
…
