Data Engineer

Job Description

Ofcom looks after communications in the UK. From phones and broadband to TV, radio, post and wireless devices, we regulate services at the heart of peoples everyday lives.This is an exciting time to join Ofcom. Were delivering vital work to help shape the communications services of today and tomorrow - from helping the UK be a world leader in 5G mobile, to driving investment in ultrafast broadband and supporting the traditionalpostal service.As the UKs broadcast regulator, we uphold standards on TV and radio. And we make sure communications companies stick to the rules and treat their customers fairly. To support all that work, we carry out world-class research in exciting areas such as technologyand consumer behaviour.Purpose of the roleThe Data Innovation Hub works with colleagues across the organisation to improve Ofcoms capability to process, analyse and extract insights from data. For example, we crunch terabytes of data to give us an unparalleled understanding of the coverageand performance of the UKs broadband and mobile networks. And were exploring how AI and machine learning can help us extract more insights from complex data sets or help us do things more efficiently.We are looking for someone who can fulfil a valuable junior role in our crucial process of building, developing and maintaining our data management systems that will enable us to get the best from data. This role will support our growing role in online safetyregulation.We need someone who can work with colleagues in the Data Innovation Hub, and with others across the organisation, to understand requirements and then put in place the necessary automated systems to extract, transform and load the data sets for subsequentanalysis, to support continuous improvement of standards and provide technical guidance alongside other data engineering functions.Expectations:

• This role will work with colleagues in the Hub and with our policy and operations teams to understand how we can support them through building, deploying and proactively maintaining systems to extract, transform and load (ETL) data in response to theiremerging business requirements.
• The role will also develop our approach to application programming interfaces (APIs) and information exchange architectures and to seek ways in which we can improve our data systems and pipelines to be in line with industry best practice.
• This role will also support our initiative to locate, catalogue and, where appropriate, integrate data sets, as well as to provide our data scientists and analysts with the data and infrastructure required to undertake their analysis.

Essential Skills & KnowledgeCandidates will need to have relevant skills in, and knowledge of, data engineering processes which transform raw data into a state fit for subsequent analysis. They should also be familiar with information management and collection activities.Candidates should also have skills top enable them to work across organisational boundaries to understand requirements, translate those requirements into technical specifications, communicating to stakeholders, and delivering on business outcomes.Applicants should be able to demonstrate capability in:

• Developing, coding, testing, correcting and documenting programs or scripts using code versioning systems such as GitHub
• Using technical tools such as Python, C++, Java, Php, Spark
• Use of environments such as PostgreSQL, Cosmos and Azure
• Communicating technical concepts across organisational and technical boundaries
• Working independently, demonstrating flexibility and adaptability
• Identifying with, and demonstrating a desire to promote, Ofcoms values of respect, excellence, agility, empowerment and collaboration