Azure Data Integration Engineer .Net Core

Job Description

Azure Data Integration Engineer .Net CoreRef: 504656 MonthsHybrid/Remote working (occasionally required in the London office)Day Rate Inside IR35 £650 - £700 (depending on experience)Interviews taking place immediatelyWe are undergoing a roll out of our Azure data platform, and we are looking for an Azure-based Software Engineer to join a growing team to build our data integration services, responsible for managing the communication of data between distributed operationalsystems across our technology estate. The data integration project transitions from point-to-point integrations to a centralised hub and spoke model, promoting decoupling of systems, improved data quality, and simplified estate architecture.

• Engineer highly scalable and resilient data integrations, leveraging Azure Cloud PaaS and reference architectures.
• Create data integrations using different data latency methodologies, e.g., real-time and periodic.
• Subscribe and publish to operational systems using their native application interface technologies, such as REST, GraphQL, SOAP, Service Bus, SQL, etc.
• Perform transformations to conform the data with expected schema required by downstream operational systems.
• Develop a toolset to monitor the health of data integrations, including near real-time alerting of failures, data volume metrics, resource consumption metrics, etc.
• DevOps approach to software; create high quality code using traditional software practices, such as building, linting, unit and integration testing, source control, CI/CD, peer reviews, etc.
• DevOps approach to support; monitor pipelines to ensure business-critical data pipelines are processed meeting time constraint and data quality expectations (including implementing reactive changes where applicable).
• Integrate into the data teams SCRUM ceremonies, including backlog refinement, sprint planning, demonstrations and retrospectives, including translation of user requirements into technical requirements including complexity estimation, implement in two-weeksprint cycles, collaboration into process improvement, etc.
• Offer Level 3 and beyond support for platform.
• Based on requirements, perform ad-hoc analysis of data across multiple data sources to inform solution design.
• Document datasets in data catalogue, including ownership, stewardship, dictionaries, glossaries, lineage, sensitivity, etc.
• Document solution design in wiki.

KNOWLEDGE AND EXPERIENCEMust Have:

• Strong Azure Function Apps experience for data integrations, using C# and .Net Core; including Durable Functions.
• Strong Azure SQL and data skills.
• Strong understanding of software development practices, such as SOLID principals, functional and object oriented, structuring code, testing, IOC, dependency injection, etc.
• Strong unit testing, including TDD.
• Strong experience with Azure DevOps Repositories, Pipelines and Artifacts (git, multistage YAML, NuGet).
• Strong experience with Azure data integration stack, including Azure Function Apps, Azure Logic Apps, Azure API Management, Azure Service Bus, Azure Blob Storage etc.
• Strong understanding of distributed systems, considering scalability, resiliency, high availability, disaster recovery, networking, etc.
• Strong understanding of application interface technologies including REST, GraphQL, SOAP, Service Bus, SQL, etc.
• IaC, e.g., Terraform, ARM, Bicep, etc.

o Includes solid Azure Resource Manager skills including Azure Portal, Az CLI and Az PowerShell.

• Demonstrate understanding of Event driven Architectures.
• Knowledge of Canonicalised modelling. * Excellent written and verbal communication skills
• Presentation skills, e.g., to Architecture Review Board.
• A minimum of 5 years of experience as an Azure Software Engineer.
• A demonstrable track record of getting stuff done whilst managing competing pressures and deadlines and retaining an eye for detail and quality.
• A passion for technology and its ability to have a positive impact on business.

Nice To Have:

• Desirable if also has Azure Stream Analytics, Azure Data Factory V2, Azure EventHubs.
• Other languages, such as Python, PowerShell.
• Knowledge of Data Catalogue systems.

PERSONAL ATTRIBUTES

• Self-driven, doesnt require micromanagement
• Comfortable in fast-paced environments with occasionally shifting, ambiguous requirements
• Passionate about both process and technology and the impact they can have on business and our customers
• Articulate and credible
• Quality and detail orientated
• Positive attitude and influence on others
• Fast learner and able to adapt to new technology and keep abreast of current industry trends and practice
• Excellent communicator in all forms to key stakeholders
• Excellent organisation and time management skills

If you are available immediately and seeking a new contract or would just like more information on this role please get in touch! Concept Resourcing is committed to building a diverse and inclusive community where we can all be ourselves and succeed on merit.Concept Resourcing welcomes all.