London Jobs |
Manchester Jobs |
Liverpool Jobs |
Nottingham Jobs |
Birmingham Jobs |
Cambridge Jobs |
Glasgow Jobs |
Bristol Jobs |
Wales Jobs |
London Jobs |
Manchester Jobs |
Liverpool Jobs |
Nottingham Jobs |
Birmingham Jobs |
Cambridge Jobs |
Glasgow Jobs |
Bristol Jobs |
Wales Jobs |
Oil & Gas Jobs |
Banking Jobs |
Construction Jobs |
Top Management Jobs |
IT - Software Jobs |
Medical Healthcare Jobs |
Purchase / Logistics Jobs |
Sales |
Ajax Jobs |
Designing Jobs |
ASP .NET Jobs |
Java Jobs |
MySQL Jobs |
Sap hr Jobs |
Software Testing Jobs |
Html Jobs |
Job Location | Cramlington |
Education | Not Mentioned |
Salary | £50,000 - £60,000 per annum |
Industry | Not Mentioned |
Functional Area | Not Mentioned |
Job Type | Permanent , full-time |
Data Engineer, Python (or Scala), AWS, Delta Lakehouse, ETL, Databricks, Data ingestion, transformation and modelling.An exciting ecommerce company with offices across the UK are looking for a Data Engineer with solid experience of working with in an AWS ecosystem, Databricks & Delta Lakehouse, Python (or Scala) and SQL.Youll be central in building and maintaining robust data pipelines within the AWS ecosystem, primarily focusing on Delta Lakehouse Platform on Databricks.Responsibilities· Data Ingestion: Build and optimize data ingestion pipelines using AWS services such as Lambda, Kinesis, and Glue.· Data Transformation: Develop, maintain, and optimize transformation pipelines within our Delta Lake on Databricks.· Data Modelling: Design and implement efficient and reliable data models to store and retrieve data.· Collaboration: Work closely with data scientists, analysts, and stakeholders to understand data requirements and deliver optimal solutions.Requirements· AWS Services: Proficiency in AWS services like Lambda, Kinesis, and Glue.· Databricks & Delta Lake: Hands-on experience with Databricks and Delta Lakehouse architectures.· Programming: Proficient in Python, Scala, and SQL for data engineering tasks.· ETL Processes: Demonstrated expertise in designing, building, and maintaining ETL processes.· Data Modelling: Experience in logical and physical data modelling with large datasets.Data Engineer, Python, AWS, Delta Lakehouse, ETL, Databricks, Data ingestion, transformation and modelling.
Keyskills :
ETLData EngineerAWSDatabricksData ingestionDelta LakehousePython (or Scala)transformation and modelling.