Data Engineer

Job Description

Data EngineerLegal and GeneralFor nearly 200 years we have provided financial services to customers across the UK, and now the US.As one of Europes largest insurance and asset management groups, with over £1 trillion in assets, we are experts in safeguarding peoples financial futures.Job summary

• You will design, develop, document & maintain data pipelines that load & transform data from key source systems, trading platforms & Azure BLOB into our Snowflake cloud data warehouse platform
• You will use Wherescape for ETL/ELT automation to create scheduled workloads that load data into Snowflake
• You will use Qlik Replicate to create solutions that stream data into Snowflake
• You will join an existing Data Engineering Team that consists of 12 engineers, a QA & a Support function with a diversity of developers across a spectrum of experience & knowledge. The Team is based in Cardiff, but this is an Agile role and will consistof mainly working remotely - there may be occasions when attending the Cardiff office is required (rare)
• You will be working on the Data Strategy program & will be involved in a wide variety of workflows. This program is in its 3rd phase & has been running for 2 years. It will run till the end of 2021 and may extend into 2022.
• You will assist the team with the migration from a traditional legacy on-premises Data Warehouse technology (MS SQL Server & SSIS) to Wherescape & Snowflake
• Using Scrum/Agile methodologies you will plan work & demonstrate progress towards achieving MVP delivery within time-boxed sprint cycles
• You will work iteratively with business end users to understand their requirements & transform those requirements into ETL/ELT & streaming solutions
• You will model data into Snowflake marts/star-schemas using Kimball dimensional data modelling methodologies
• The role is based in our UK Life Insurance division, exclusively

Candidate summary

• Proven track record of delivering data engineering solutions including ETL/ELT development, data streaming, data Integration and analytics
• Ability to communicate to all levels of stakeholders in the organisation is absolutely essential
• Ability to demonstrate the communication of complex data management issues & data solutions to non-technical stakeholders
• Knowledge of modern data paradigms within the cloud is required
• An SQL guru, you will have a minimum of 3-5 years hands-on experience of this technology and be able to demonstrate advanced knowledge in the subject
• Technologies: Wherescape, Snowflake, Qlik Replicate, SSIS, PowerBI (desirable), Legacy RBDMS (Oracle, MSSQL, Postgres).
• Significant hands-on experience working as a technician within a data engineering team is essential
• Snowflake skills & experience is essential
• Wherescape skills are highly desirable but not essential as training will be provided
• SSIS/ SSMS/ MS SQL Server/ Visual Studio are highly desirable
• QLIK Replicate - desirable but not essential
• Exposure to other streaming technologies is a bonus
• Jira - desirable but not essential
• Expert knowledge on Kimball Data Modelling methodologies is essential.
• As a first-class communicator you are able to relate abstract ideas to less experienced individuals as well as engage with highly technical members of the organisation; Absolutely essential for this role holder.
• This is a hands-on technical role & the holder of the role will be an experienced developer with at least 3-5 years of coal-face experience in ETL, warehouse design and data modelling.
• Degree calibre in appropriate subject and/or formal technical qualifications preferable.
• SnowPro qualified desirable