Naukrijobs UK
Register
London Jobs
Manchester Jobs
Liverpool Jobs
Nottingham Jobs
Birmingham Jobs
Cambridge Jobs
Glasgow Jobs
Bristol Jobs
Wales Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Senior Data Engineer

Job LocationLondon
EducationNot Mentioned
Salary£70,000 - £80,000 per annum
IndustryNot Mentioned
Functional AreaNot Mentioned
Job TypePermanent, full-time

Job Description

My client is looking to recruit an experienced data engineer to help rearchitect one of their leading platforms. You will be joining a state-of-the-art R&D team that utilises AI, ML, NLP and modern development to build innovative solutions and best in industry products.Responsibilities and Performance Objectives:

  • Architect and build distributed, scalable, and reliable data pipelines to ingest and process data.
  • Collaborate closely with stakeholders and researchers to support machine learning, analytical and product use cases.
  • On-board, document and curate external datasets for internal usage.
  • Engage in data interpretation and forensic data analysis and troubleshooting.
  • Required skills:
  • We’re looking for an experienced engineer who can hit the ground running.
  • Self-motivated and creative. We’re building from ground up, not tweaking legacy.
  • Proficiency in scripting languages (especially Python).
  • Good communicator and team player.
  • Solid understanding of algorithms and data structures.
  • Experience of cloud platforms (e.g. Amazon Web Services).
  • Commercial experience of writing and optimizing SQL queries.
  • Experience of data orchestration platforms (e.g. Airflow).
  • Nice to have skills:
  • Experience in feature engineering for Machine Learning applications
  • Experience working within an agile team
  • Knowledge of data versioning libraries/ methods (e.g. DVC)
  • Familiarity with data lakes
  • Experience of cloud data warehouses (e.g. Snowflake)
  • Familiarity with migrations frameworks for change management (e.g. Flyway, Alembic)
  • Experience of dynamic schemas/schemas evolution
  • Experience building streaming pipelines (e.g. Kafka, Kinesis)
  • Familiarity with continuous deployment
  • Experience ingesting data from web (e.g. HTTP requests, HTML/ XML parsing)
  • Familiarity with Big Data ecosystem (e.g. Spark/ MapReduce)
  • Experience of load testing data pipelines
  • Experience of geo-indexing technologies (e.g. PostGIS)
  • Knowledge of columnar data storage formats (e.g. Parquet, ORC)
  • Required skills
  • Data
  • Data Analysis
  • Data Warehousing
  • Python
  • Airflow
  • Keyskills :
    Data Data Analysis Data Warehousing Python Airflow

    APPLY NOW

    Senior Data Engineer Related Jobs

    © 2019 Naukrijobs All Rights Reserved