| London Jobs |
| Manchester Jobs |
| Liverpool Jobs |
| Nottingham Jobs |
| Birmingham Jobs |
| Cambridge Jobs |
| Glasgow Jobs |
| Bristol Jobs |
| Wales Jobs |
| London Jobs |
| Manchester Jobs |
| Liverpool Jobs |
| Nottingham Jobs |
| Birmingham Jobs |
| Cambridge Jobs |
| Glasgow Jobs |
| Bristol Jobs |
| Wales Jobs |
| Oil & Gas Jobs |
| Banking Jobs |
| Construction Jobs |
| Top Management Jobs |
| IT - Software Jobs |
| Medical Healthcare Jobs |
| Purchase / Logistics Jobs |
| Sales |
| Ajax Jobs |
| Designing Jobs |
| ASP .NET Jobs |
| Java Jobs |
| MySQL Jobs |
| Sap hr Jobs |
| Software Testing Jobs |
| Html Jobs |
| Job Location | London |
| Education | Not Mentioned |
| Salary | £500.00 - £600.00 per day |
| Industry | Not Mentioned |
| Functional Area | Not Mentioned |
| Job Type | Temporary, full-time |
Data Engineer SC cleared London, Titchfield or Newport 3 months to start - but until march 2021Outside IR35 SC cleared holder before applying - due to quick start of work Key Responsibilities*Collaborating with key members of the Data Engineering team to develop automated coding solutions for a range of ETL, data cleaning, structuring and validation processes.*Working with large semi-structured datasets to construct linked datasets derived from multiple underlying sources as well as supporting the wider team in delivering a range of data profiles across key strategic administrative data flows. *Assisting in a range of ETL and warehousing design projects in migrating data from a number of legacy my clients environmentsAs indicated above, the role requires experience of manipulating big data using Hadoop-based tools such as Hive, Impala and Spark so experience of data manipulation and querying using Python and SQL in such tools is a core element of the position. Person Specification*Good inter-personal and communication skills;*Stakeholder management skills (dealing with suppliers and customers);*Self-starter e.g. problem solving and taking initiative to sort out issues.*A quick learner, able to assimilate the complexities of unfamiliar data sources and business data requirements;Skills and ExperienceEssential*Extensive proven experience of data engineering and architectural techniques, including data wrangling, data profiling, data preparation, metadata development, and data upload/download;*Proven experience of big data environments, including the Hadoop Stack (Cloudera), including data ingestion, processing and storage using HDFS, Spark, Hive and Impala;*Extensive hands-on experience of developing ETL functionality in a cloud or on-premise environment;*Experience of using tools such as python and SQL (Spark) to profile, query and structure large-volume data;*Proven experience of using Cloud Services particularly in the context of Hadoop;*Experience of developing/utilising programming and query languages e.g. SQL (Hive Impala specifically), Python (through Spark), Scala.*Understanding of data bases and applying data models in relational database formats.Desirable*Experience of UK Government Administrative Data;Certes Computing (and all of its subsidiary companies) is committed to promoting equality and diversity in its business operations.