| London Jobs |
| Manchester Jobs |
| Liverpool Jobs |
| Nottingham Jobs |
| Birmingham Jobs |
| Cambridge Jobs |
| Glasgow Jobs |
| Bristol Jobs |
| Wales Jobs |
| London Jobs |
| Manchester Jobs |
| Liverpool Jobs |
| Nottingham Jobs |
| Birmingham Jobs |
| Cambridge Jobs |
| Glasgow Jobs |
| Bristol Jobs |
| Wales Jobs |
| Oil & Gas Jobs |
| Banking Jobs |
| Construction Jobs |
| Top Management Jobs |
| IT - Software Jobs |
| Medical Healthcare Jobs |
| Purchase / Logistics Jobs |
| Sales |
| Ajax Jobs |
| Designing Jobs |
| ASP .NET Jobs |
| Java Jobs |
| MySQL Jobs |
| Sap hr Jobs |
| Software Testing Jobs |
| Html Jobs |
| Job Location | London |
| Education | Not Mentioned |
| Salary | 55,000 - 65,000 per annum |
| Industry | Not Mentioned |
| Functional Area | Not Mentioned |
| Job Type | Permanent , full-time Work from home |
Job title: Data EngineerLocation: London, E14Salary: £55,000 - £65,000 depending on experienceContract type:PermanentHours:37.5, MondayFridayWFH policy:Employees are required to attend the office 2 days/weekFlexible working: Informal flexible work patterns subject to line manager discretion including a 9-day fortnight. Role Summary:As the Data Engineer, you will own data ecosystems and will work with developers, solution architects, technical BAs, data scientists, and other SMEs to define the optimum data architecture for the business. You will build the required ETL/ELT pipelines forthe collection, preparation, and storage of data in a form that is optimised, secure and reliable. You will have a specific focus on developing the data inputs that are utilised by the organisations internal forecasting model of the GB power markets; designing a framework that scales effectively along with the source data.Key Responsibilities:Design data infrastructure to support modelling and data analyticsBuild and maintain ETL/ELT pipelines to make data accurate and easy to useWork to ingest and transform data sets from a variety of data sourcesExplore ways to enhance data quality and reliabilityAssist with the establishment of a data culture across the organisationDrive better data governance through the creation and embedding of principles and processes e.g. Logical Data Model & Flow Diagram, Data Dictionary, Data Semantic LayersSet service level indicators and monitor execution of data workflows and configure alerts Apply dimensional data modelling concepts and practices to develop conceptual, logical and physical data models to support insight deliveryIdentify data quality issues through data profiling, analysis, and stakeholder engagementLCCC reserves the right to assign other duties commensurate with the role as required.Skills Knowledge and Expertise:Essential:At least 2 years of designing data infrastructure to support modelling and data analyticsExperience building, modelling, and maintaining data pipelines Strong experience in SQL optimisation, performance tuning, data modelling and SQL/database design skills.Hands on experience within the Azure Data ecosystem, with Azure Databricks, Data Factory, Data Lake, and Synapse. Certifications are a plus.Highly Desirable:Strong competence in Python or Scala, ideally PySpark experience
Keyskills :
Data Engineer