Naukrijobs UK
Register
London Jobs
Manchester Jobs
Liverpool Jobs
Nottingham Jobs
Birmingham Jobs
Cambridge Jobs
Glasgow Jobs
Bristol Jobs
Wales Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Lead Data Engineer

Pimento Connection
Job LocationLondon
EducationNot Mentioned
Salary60,000 - 80,000 per annum
IndustryNot Mentioned
Functional AreaNot Mentioned
Job TypePermanent, full-time

Job Description

Lead Data EngineerThe Lead Data Engineer will lead a small technical team including Data Engineers and Infrastructure Leads to consolidate and scale the technical product offering that has already been built.Within a secure-by-design AWS infrastructure, the Lead Data Engineer will be comfortable running daily stand-ups and working closely with the Client Servicing Team to ensure the best-in-class product continues to evolveand maintain the precision and quality customers expect.This is an opportunity to be part of a small but ambitious team looking to scale rapidly throughout 2021 and 2022, with excellent career progression for the right candidate.Location: Remote working with 1-2 days per month in Central LondonYou will:

  • Have experience working in the private sector, building technical products for Government customers in the field of open-source intelligence data solutions
  • Have an in-depth understanding of the open-source information environment in particular the opportunities and challenges presented by such an environment
Responsibilities
  • Setup and maintain secure environments for data management and access on AWS
  • Automate monitoring and evaluation of data quality
  • Work with the Client Servicing team and PM to deliver data products to senior government clients
  • Work closely with senior stakeholders to outline project scope and requirements
  • With the technical PM, be able to rapidly and professionally advise on feasibility of technical requirements in terms of data availability and appropriateness.
  • Work on pre-sales to respond to immediate business opportunities and longer-term development projects
  • Overall responsibility for the setup of API and third-party data pipelines for batch and near real-time data collection across platforms such as Twitter and YouTube
  • Scale projects to ensure data is available as required
  • Scope out new data collection opportunities and manage access
  • Scope requirements and target architecture for project propositions
  • Manage and support the rest of the tech team in debugging, blockers etc
  • Oversee and run daily standups to distribute and prioritise tasks
  • Architect data solutions for new projects and new technology
  • Liaise with CEO and Business development on pitching new work, including costing technology, resource and timeframe
  • Comfortable with being hands-on as well as manage the more strategic / technical aspects of code
  • Have experience in working with data scientists to productionise data science and AI models
  • Professional attitude at all times and confident speaking directly to senior clients if required
  • Essential
  • Security Cleared to SC
  • Technical
  • SQL
  • Python
  • AWS
  • Data warehousing
  • Serverless functions (AWS Lambda)
  • Docker
  • AWS Glue (PySpark)
  • Desirable
  • Terraform
  • CI/CD pipelining

Keyskills :
Private SectorSecure EnvironmentOpen Source IntelligenceSQL Python AWS Data Warehousing Docker AWS Glue (PySpark) CI/CDOpen Source Information Environment: Opportunities and Challenges

APPLY NOW

Lead Data Engineer Related Jobs

© 2019 Naukrijobs All Rights Reserved