About the Role
Senior Data Engineer – Commodities & Energy TradingLondon | Permanent | Hybrid WorkingOur client is a global commodities and energy trading organisation operating an asset‑light, highly diversified business model. The firm combines advanced analytics, proprietary technology, and robust risk management to support trading, optimisation, and risk‑management decisions across energy and commodities markets.As a Senior Data Engineer, you will join a highly technical Data, AI & Analytics function responsible for building the data platforms that underpin trading, quantitative research, predictive analytics, and machine‑learning use cases. This is a hands‑on role with ownership across data ingestion, transformation, storage, and distribution, working closely with Data Scientists, Traders, and technology teams.You’ll have the opportunity to:Build and maintain scalable data pipelines supporting trading and analytics use casesIngest structured and unstructured data from diverse internal and external sourcesSupport predictive analytics, systematic trading, and machine‑learning workloadsPartner closely with Data Scientists and Trading teams to deliver high‑quality datasetsContribute to cloud‑native data platforms using modern engineering practicesDrive improvements in data quality, performance, and self‑service capabilitiesYour ResponsibilitiesAs a Senior Data Engineer, you will:Design and implement data ingestion pipelines using ETL, streaming, scraping, and batch approachesClean, enrich, and transform datasets for analytical and operational consumptionPersist data across databases, warehouses, and data lakesDistribute data internally via APIs, Python packages, and direct queryingMaintain and enhance production data pipelines and databasesSupport post‑processing automation, including analytics, models, and visualisation workflowsEnable Data Scientists through shared libraries, cloud resources, and documented data accessMaintain knowledge bases covering data sources, pipelines, and usageKey RequirementsAs a Senior Data Engineer, you should have:Strong engineering background in Data Engineering, Computer Science, or similarExperience working in commodities, energy trading, or financial markets environmentsAdvanced Python skills, including extensive use of PandasExperience with analytical or time‑series databases (e.g. Redshift, ClickHouse)Hands‑on experience with Docker and containerised workloadsExperience with Git and modern DevOps practicesPractical experience deploying infrastructure on AWS using IaC (e.g. CDK, CloudFormation)A proactive, ownership‑driven mindset with strong problem‑solving skillsYou will gain exposure with:Working as a Senior Data Engineer, you will gain exposure to:Direct collaboration with Traders and quantitative teamsCloud‑native data platforms supporting real‑time and batch processingBig‑data and distributed processing toolsAWS services such as S3, Lambda, Athena, EMR, Kinesis, and EC2Advanced analytics, visualisation, and data‑science workflowsEmerging technologies across AI and machine learningWhy Join?Work on data platforms that directly support trading and optimisation decisionsOwn data engineering solutions end‑to‑end in a high‑impact environmentOperate in a technically deep, collaborative engineering cultureCompetitive compensation with performance‑linked bonusHybrid working model supporting flexibility and collaborationInterested? Apply now.