Naukrijobs UK
Register
London Jobs
Manchester Jobs
Liverpool Jobs
Nottingham Jobs
Birmingham Jobs
Cambridge Jobs
Glasgow Jobs
Bristol Jobs
Wales Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Senior Data Engineer

Job LocationLondon
EducationNot Mentioned
Salary£70,000 - £80,000 per annum
IndustryNot Mentioned
Functional AreaNot Mentioned
Job TypePermanent, full-time

Job Description

Salary £70,000 - £80,000Key Requirements: Scala and Spark Build services/features/libraries that serve as a definitive examples for new engineers and makes major contributions to library code or core services Design low risk Spark process and write effective complex Spark jobs (data processes, aggregations, pipeline) Design low risk APIs and write complex asynchronous, highly parallel low latency APIs and processes Work as part of Agile team to maintain, improve, monitor company data collection processes using Java and Scala Write high quality, extensible and testable code by applying good engineering practices (TDD, SOLID) Understand and apply modern technologies, data structures and design patterns to solve real problems efficiently Understand the data architecture and uses appropriate design patterns and designs complex database tables Support TA and Data Science team to help deliver and productionise their backlog/prototypes Take ownership and pride in the products we build and always make sure they are of the highest standard Be empathetic towards team members and customersPreferred qualifications Bachelor degree in Computer Science, similar technical field of study or equivalent practical experience. Commercial experience developing Spark Jobs using Scala Commercial experience using Java and Scala (Python nice to have) Experience in data processing using traditional and distributed systems (Hadoop, Spark, AWS - S3) Experience designing data models and data warehouses. Experience in SQL, NoSQL database management systems (PostgreSQL and Cassandra) Commercial experience using messaging technologies (RabbitMQ, Kafka) Experience using orchestration software (Chef, Puppet, Ansible, Salt) Confident with building complex ETL workflows (Luigi, Airflow) Good knowledge working cloud technologies (AWS) Good knowledge using monitoring software (ELK stack) Motivated problem-solving skills, ability to bring ideas forward and adapt solutions to complex challengesBenefits: Startup Engineering culture Good work/life integration (flexible working) Untracked annual leave Stock options from day one Individual coaching programme Monthly Hackdays Team lunch every Friday Daily breakfast, snacks and drinks provided Pension scheme Modern office space with on-site shower Perkbox Memberships Monthly Socials and company-wide retreats Free Trainers when you join our team Social activities to join in. Regular off-sites, bake-offs, office table tennis tournaments and much more! Required skills

  • Scrum
  • Spark
  • Agile Environment
  • Scala
  • Keyskills :
    Scrum Spark Agile Environment Scala

    APPLY NOW

    © 2019 Naukrijobs All Rights Reserved