Lead Data Engineer

Commodities Trading Industry

Location: London, United Kingdom

Salary: £850 per day

Job Description:

We are seeking a Lead Data Engineer to lead the data warehouse design and strategy with a Commodities Trading client. The successful candidate will be responsible for designing, maintaining, and implementing efficient ETL pipelines for ingestion and transformation. This role plays a key role in evaluating and selecting appropriate technologies and tools for building the data warehouse.

The contract length is 6 months (with the view to extend), Inside IR35, 3 days on-site in the London office, and looking for someone to start as soon as possible.

Key Responsibilities:

• Lead and design the strategic data warehouse
• Design, maintain, and implement efficient ETL pipelines for data ingestion and transformation
• Evaluate and select appropriate technologies and tools for building the data warehouse
• Collaborate with cross-functional teams to gather business requirements
• Implement efficient data storage solutions that support Front Office traders for analysis and pricing.
• Contributing to strong software development and data engineering principles to build and maintain the data warehouse.

Requirements:

• Experience working with AWS or Azure
• Proficient in Python
• Knowledge of Java and Python
• Experience with ETL pipelines
• Skills in SQL
• Working knowledge of CI/CD pipelines
• Experience with DevOps