Data Engineer

Job Description

This job is currently remote working. When COVID-19 restrictions reduce, we may ask you to come to our Leeds HQ once or twice a week - although this is to be confirmed. Were looking for a dynamic Data Engineer to join one of the most exciting Tribes within Sky Betting and Gamingthe Data Tribe!Data are the tribe that takes raw information, and puts intelligence in the hands of decision makers. Our teams design and build SBGs data capabilities, from data warehousing platforms and business reporting, to machine learning and predictive algorithms.We believe the data we serve will make a difference, and we are on a journey to migrate our data warehouse to the cloud, to unleash more of its vast potential! Our strategy is to migrate from on prem Hadoop platform to Google Cloud Platform utilising theirbig data tools. We are underway with this project and skills in GCP tooling such as BigQuery, Pub/Sub, Data Flow, Data Proc, Composer as well as GCP accreditation is an advantage.If youre the kind of person who embraces challenges and is able help the team to think outside of the box to unblock processes, you would be an ideal fit for this role.Responsibilities as a Data Engineer include:

• Deliver outstanding software solutions, which are secure, appropriately tested, perform well, and help provide an engaging customer experience
• Actively improve your engineering skills growing your mastery level of our stack
• Play a proactive part in owning your teams services; taking ownership for support, monitoring, measuring performance and addressing technical issues when required
• Contribute enthusiastically to our continuous improvement of coding practices, application quality, tooling and agile processes
• Continuously evaluate teams processes and procedures to maintain a positive and efficient engineering culture
• Directly contribute to the design and code of the data pipelines operating on secure, production data
• Contribute to the end-to-end design and implementation of common components that improve our ability to write efficient and reliable data pipelines
• Build and maintain quality technical documentation for any software you have developed, ensuring maintainability, readability and test-ability
• Conduct code reviews, pair programming and knowledge sharing sessions, embracing feedback at every step
• Involve yourself in code deployments, including raising and completing change requests to deploy to production
• Help grow the engineering teams community presence through contributing to conferences, meetups, blog posts and open-source projects

Collaboration is a key part of working at Sky Betting and Gaming. The ideal candidate will thrive in this environment, supporting their colleagues in their weaker areas and in return, well nurture you with your development goals! You should also:

• Demonstrate experience of working with and designing a platform, implementing best practices around data processing on an industrial scale
• Show your ability to deliver on projects of varied complexity across multiple SBG domains
• Strong software development skills (particularly in Scala) in an object oriented and/or functional design, coding, and testing patterns, detailing in a clear and concise manner
• Demonstrate solid knowledge of data modelling, including data lakes and warehousing tools and techniques
• Hands-on experience with ingesting and processing streamed data (e.g. RabbitMQ, Kafka, PubSub etc.) and data flow orchestration (Data Flow, Apache NiFi, Airflow, Luigi etc.)
• Strong understanding of the SDLC of data products, relevant CI/CD tools (Jenkins, Spinnaker, TeamCity) and containerisation (Docker, Kubernetes, Helm)
• Adapt to new technologies and technical challenges, working in a fast-paced, dynamic and agile organisation
• Support project delivery with pragmatic estimates and progress tracking
• Excellent interpersonal, written communication skills and highly numerate
• Able to learn from mistakes, embodying a fail fast, succeed faster mentality