Lead Data Engineer

Job Description

Lead Data EngineerLondon3 Months We are representing a leading global Energy organisation who are seeking an experienced Lead Data Engineer on an interim basis initially until for 3 months. Working within the Power Programme, the Lead Data Engineer will support a number of initiatives including onboarding of renewable assets, short term Power Trading and associated trading operations as well as supporting ad-hoc data and systems enhancements across the Programme. The team is a cloud native team deploying solutions into MS Azure. You will be tasked with defining strategic solutions and best practices for a small number of Data Engineers but will also be hands-on gathering requirements, designing and supporting the delivery of data solutions supporting trading and operations for the Power Desk within the business. Part of this role includes meeting the visualisation, reporting and analytics needs of key business functions through development and experience of data models. Ideally suited to someone who can work in a fast-paced environment and solve complex business problems. You should be adept at working within an agile environment using the Scrum framework. Personal Attributes: * Adaptable to change, versatile and pragmatic * Uses best practice development techniques but can change approach according to conflicting timelines/risks involved * Comfortable talking to trading business users and can translate business needs into tangible IT deliverables * Keeps up-to-date knowledge with recent IT software developments (open source and cloud in particular) * Uses initiative and owns end-to-end solution delivery * Brings ideas to the table, is inquisitive and excited by new technology * Proactively communicates and shares understanding and experience within a team * Used to working in a flexible, independent manner on a mixture of small unstructured and large structured items Essential Skills: * Strong experience of working with big data solutions & data platform products & services on Microsoft Azure such as Databricks, SQL Warehouse, Data Factory, Data Explorer, SQL Database, PySpark etc. * Experience of utilising the appropriate development, data engineering (ETL, stream processing) principles to suite requirements * Experience of applying appropriate standards and principles when delivering data ingestion and data transformation into target data models * Experienced in converting models and features created by analysts and designers from prototypes/designs into production solutions * Knowledge of Software Development Lifecycle and Agile methodologies (SCRUM) * Strong written and verbal communication skills to gather requirements * Experience of leading a team of data engineers (Desirable) * Experience in the commodities trading or financial services sector (Desirable) * Knowledge of application development architecture tools, technology frameworks and security principles (Desirable) Interested Please reply with your updated CV and we will be in touch shorty to discuss the next steps!Advantage Resourcing is a service driven recruitment consultancy. Required skills

Active Directory

Agile

Application Development

Communication

Database

Designing

ETL

Framework

KYC

Life Cycle

Lifecycle

Big Data

Design

Microsoft

MS

Development

Commodities

Cloud

AD

Azure

Gathering Requirements

Application

Onbo

Keyskills :
Active Directy Agile Application Development Communication Database Designing ETL Framewk KYC Life Cycle Lifecycle Big Data Design Microsoft MS Development Commodities Cloud AD Azure Gathering Requirements Applica