Senior Data Engineer

Job Description

DWP. Digital with Purpose. DWP is the UKs largest government department. We help people into work, and make payments worth over £195bn a year to support some of the most vulnerable people in our society.We are looking for a Senior Data Engineer to workwith us on development of innovative data solutions, through robust product development strategies, ETL process design and continuous improvement of the data engineering lifecycle, that will improve DWP applications for millions of UK citizens, allowing themto access essential services and interact with DWP.Youll join our community of tech experts in DWP Digital. Were driving a once-in-a-generation transformation of government services, using fresh ideas and leading-edge technologies to create innovative, scalableand user-centric digital solutions.The DWP products and services we maintain and modernise will be used by nearly every person in the UK, at key moments in their lives. The scale of what we do is extraordinary, and our scale and purpose is unique. Wed loveyou to join us.Delivery. Work. Projects. As a Senior Data Engineer youll be working on the development and delivery of complex data solutions, defining product development strategies and contributing to the continuous improvement of the data engineering lifecycle.Youll be working on ETL process design, data loading strategy and data interrogation, drawing insights and introducing new technologies and processes that will improve the way millions of users interact with DWP and its services.What skills, knowledge andexperience will you need Has a deep understanding of the technical concepts required in their role and understands how these fit into the wider technical landscape. Experience in designing and building efficient, scalable, automated ETL/ELT pipelines, includingdata ingestion (batch/messaging/streaming), processing and storage. Comfortable turning complex technical data into compelling, clear, concise messages, at the right level for different stakeholder groups, and using information and experience to make tacticaland strategic recommendations. Key Skills in one or more of the following: Experience of designing and developing data solutions on AWS/Azure or GCP platforms Database and storage eg RDBMS/NoSql/HDFS/S3 SQL / HQL Data modelling concepts (normalised/dimensional/noSql/Bigdata) ETL toolsets e.g. Informatica Programming Languages - SQL, Python, Shell scripting (BASH) Experience of Distributed Version control methodologies and tooling, and CI/CD deployments eg (GitLab) Experience of big data frameworks and associated processingand storage components eg Hadoop Cloudera/AWS EMR, Spark, HIVE, Hue Details. Wages. Perks. Youll join us in one of our brilliant digital hubs in Leeds, Newcastle or Sheffield, whichever is most convenient for you.We also have all the tools and tech we needto enable our people to work flexibly, and many of us are working remotely at the moment due to COVID-19.In return for your skills, we offer a competitive salary of up to £62,969 a brilliant civil service pension with employer contributions worth over 27%,and a generous leave package starting at -26 days. We also have a broad benefits package built around your work-life balance which includes: Flexible working, flexi hours and flexi days Hybrid working: some time in a hub with the team, some time at home Family-friendlypolicies Time off volunteering and charitable giving Bring your authentic self to work with I Can Be Me in DWP Discounts and savings on shopping, fun days out and more Interest-free loans to buy a bike or a season ticket, so its even easier for you to getto work and start making a difference Sports and social activities Working in an award-winning environment and culture Professional development, coaching, mentoring and career progression opportunities. CLICK APPLY for more information and to start your application.