Lead Data Engineer

Job Description

Position: Lead Data ArchitectLocation: York or London (Hybrid working)Benefits: Up to £110,000 DOE + Bonus and moreAre you an experienced architect looking for an opportunity within a globally recognised company Our client are market leads within the insurance space and are currently on the lookout for a Lead Data Architect to scale and drive the team.As a Lead Data Architect, you will assist in architecting and building new data solutions and initial PoCs using SaaS and PaaS-based services on Azure. This role requires somebody with a strong understanding of how to set up the suitable tools and technologiesin the cloud to securely process an array of data.Responsibilities:

• Working with senior stakeholders to understand high value business problems that can be solved through the application of data processing and analytical systems
• Helping to architect, setup and support a new cloud-based analytics platform for the business
• Helping to create and manage a specialist Data Engineering practice for the Re & ILSs business
• Ensuring your team supports the Data Science Team by building data pipelines for specific insights and provides them with an environment for their R&D and experimentation
• Providing robust, secure and scalable production data analytics solutions
• Understand business requirements and refine into development tasks and estimate their complexity
• Research, evaluate and adopt new technologies with a right tool for the job mentality
• Prototype, fail rapidly and iterate
• Focus on both speed of delivery and quality, with suitable pragmatism - ensuring your solutions are always "appropriate" and not overly complex or over-engineered
• Quick progression of projects from PoC to post-production stage
• Communication and presentation of ideas to colleagues in all parts of the wider business
• Recruitment, Mentoring & code reviews for the Data Engineering Team

Essential skills:

• Passion for and experience of building data analytical platforms to deliver business value.

• Ability to setup secure, automated and scalable data platforms/technologies within Microsoft Azure.
• Solid experience working with ELT/ETL tools like Data Factory, Matillion and SSIS.
• Solid experience working with Azure Storage and Azure Data Lake.
• Good understanding of different types of data (i.e., structured, semi-structured and unstructured data) and the considerations that should be made in how they are stored.
• Solid experience of working with and implementing BI solutions on platforms like Tableau and Power BI.
• Solid understanding on how to incorporate data lineage, discovery and governance within production solutions, with experience in tools such as Purview, Informatica, or Apache Atlas.
• Solid experience of data management and validation techniques.
• Excellent working knowledge of T-SQL.

• Track record of taking initiative and delivering projects end-to-end; clear evidence of being self-driven and motivated.
• Immense curiosity, high energy and desire to go the extra mile to make a difference.
• Having an awareness of trends in the data engineering space.
• Leading and nurturing the team.