Data Engineering Tech Lead

Job Description

The role involves technical leadership and accountability for the delivery of technical solutions to implement the companys data strategy, including new data services to process data at scale, both in batch and real-time pipelines, to support a wide range of data-driven projects and support our transformation into an AI-ready organisation.* Technical LeadershipoAlign the business strategy with the technical strategy for your product teamoBe accountable for the architecture of data platform, data services and products and ensure that it is aligned with the broader technology strategyoTo coach & mentor your data engineers, encouraging best practices, standards and continuous improvement of practices & processes*Line ManagementoSupport, coach and develop high performing engineers through regular 1:1s, setting & tracking objectives, managing performance and supporting the development of individual team membersoBe responsible for the overall engagement of your data engineers, ensuring that each individual is aware of the strategy and goalsoEnsure that your team is resourced appropriately and be accountable for recruitment of engineers within your team, preparing job descriptions, conducting telephone & face to face interviews and onboarding new hires*Data EngineeringoLeverage your experience and skills to assist your team in establishing the best architecture for our Snowflake-based, from ingestion of new feeds, to the transformation and delivery of data products to business stakeholders, as well as the delivery of data processing pipelines and services for other products to consume in our real-time data platform.oLiaise with tech leads from all product teams to standardise our data engineering tech stack, establishing best practices and developing generic software components that can be adopted in multiple projectsoLiaise with Data Science and Business Intelligence leads to identify requirements and develop the necessary data solutions to deliver against those requirementsoExtreme programming practices - notably pair programming and test-driven developmentoBuild, support and maintain automated, fault-tolerant, scalable products and solutions that are continuously delivered into our production environmentoBe technically curious, tackling problems without giving up, and producing solutions that less-experienced engineers can use, maintain, and learn fromoHave a sense of being part of a larger whole with a desire to establish best practices & standards and to continuously improve the discipline of product engineering *Essential Skills: oComfortable with using a variety of frameworks, languages & tools and able to pick up new skills when the need arisesoGood experience in Java 8+ with Maven & Spring, JUnit oExperience with Python and familiarity with machine learning - desirable oRelational databases such as SQL Server, PostgreSQL, Amazon RDS. Experience with Snowflake a plus.oExperience batch processing frameworks, preferably familiarity with DBT, Apache Airflow/Spring DataFlow, Metaflow, or similaroExperience with message brokers and stream processing technologies (Kinesis, Kafka, Flink)oAWS, Jenkins, Docker & Kubernetes, ElasticSearch & Kibana, Grafana & PrometheusoReading & Writing Code, Debugging & Troubleshooting, IDE & OS Basics, Test Driven Development, Pair Programming, Clean Code & Refactoring, Version Control, CI / CD, Algorithms & Data Structures, DI/ IoC, Mocks & Stubs, Alerting & Monitoring, Functional & Non-Functional Testing, SOLID Principles, Containerisation & Networking Basics, Solution ArchitectureYou will have line management responsibilities of 5-8 data engineers and will influence how the data engineering technology budget is spent.This Data Engineering Tech Lead role is based in Uxbridge (remote working,currently) and pays c£75-85K base + £6.7K Car Allowance, 15% bonus + bens.