Data Engineer - Cardiff - Inside IR35

Job Description

Data Engineer6 month contractCardiff - hybrid role, once a week in the office£550 per day, inside IR35Role* As a Data Engineer you will support ongoing projects focused on collecting, aggregating, storing, reconciling, andmaking data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the Business Energy data supply chain, by ensuring stakeholders can access and manipulate data for routine and ad hoc analysis.Additionally, you will support the full lifecycle of data from ingesting through analytics to action.Key Role Responsibilities:* Translate business requirements into technical solutions.* Plan and implement data design services, provide sizing and configuration assistance, and perform needs assessments.* Deliver architectures for enterprise data solutions transformations and modernizations using Azure cloud data technologies.* Design and build modern data pipelines and data streams.* Develop and maintain data warehouse schematics, layouts, architectures, and relational/non-relational databases for data access and advanced analytics.* Expose data to end-users using PowerBI, Azure API Apps or any other modern visualization platform or experience.* Deliver effective metrics and monitoring processes.* Support colleagues and new users through mentoring and training.Skill & Capability Requirements:* Demonstrated experience of turning business use cases and requirements to technical solutions.* Experience in business processing mapping of data and analytics solutions.* Ability to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows.* Experienced in Data Transformation using ETL/ELT tools.* Knowledge in business intelligence tools such as Power BI, Tableau, Qlik, Cognos TM1* Knowledge of Azure Data Factory, Azure Data Lake, Azure SQL DW, and Azure SQL, Azure App Service is required. Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Databricks, Azure Stream Analytics is a plus.* Ability to leverage on variety of programming languages & data crawling/processing tools to ensure data reliability, quality & efficiency* Knowledge in data modelling.* Experience preparing data for use in Azure Machine Learning and/or Azure Databricks.* Demonstrated experience preparing data and building data pipelines for AI Use Cases (text, voice, image, etc.…).* Strong team collaboration, communicator and experience working with remote teams.* Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals.* Working experience with Visual Studio, PowerShell Scripting, and ARM templates.* Preferred Azure certifications (AZ-900, AZ-200 and 201)Does this sound like you If so, APPLY NOW!We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation, gender reassignment, marriage and civil partnerships, pregnancy or maternityor age