Infrastructure engineer monitoring

Job Description

Job Title:AIOPs / Monitoring Engineer Following the development of our strategic IT road map, we are looking to both insource and modernize our IT infrastructure team by developing, installing and managing an AIOPs monitoring solution to create a holistic view of performance monitoring across networks, infrastructure, DevOps and InfoSec. The intent is to move from a traditional reactive model to a proactive model which addresses the following while avoiding “tool bloat”:

Difficulty getting actionable insights out of monitoring tools

Noisy and incomplete data

Difficulty performing root cause analysis

High volume of persistent and recurring issues

High ticket volumes (especially for low-level issues like application problems, WiFi connectivity, slow login, and printing problems)

Pressure from the business to do more without increasing staff

Difficulty addressing issues proactively

Productivity loss and decreased employee satisfaction due to poorly performing technology

Loss of visibility into the environment as organizations adopt SaaS and cloud services

This is therefore a new role within Holland and Barrett, aimed at bridging the gap between traditional infrastructure monitoring engineering and modern AIOPs practices. This position will sit within the Infrastructure team and will work closely with the Development Engineering (Build) teams, as we migrate our IT services away from the current incumbent service partner arrangement to an internally managed Run organization.While automating tasks have helped teams free up some bandwidth for operations and planning, automation alone is not enough as the volume of data continues to increase. You will therefore help design, build and maintain a modern robust monitoring platform which will provide the foundation for our AIOPs strategy, linking both our worldwide retail and corporate estates. The ultimate goal is to ensure that the data flows freely from multiple IT data sources; where it is then analyzed and processed; and automated workflows are then triggered, keeping administrators informed accordingly. The individual will work with the data, development engineering, infrastructure and network teams to develop, implement and maintain a strategy focused on reducing the amount of IT operational activities through intelligent automated system management, and deliver the following:

Intelligent alerting that can be trusted to indicate an emerging issue

Automated root cause analysis and business impact assessment.

Automated remediation and self-healing for common issues.

The PersonYou will be a subject matter expert and will be expected to take the lead in a variety of team-oriented projects and activities in both monitoring and general infrastructure support. You will be expected to work closely with internal and external stakeholders to deliver complex monitoring solutions as we transition from our service partner environment to an internally managed cloud environment which utilizes AIOPs.As a talented individual who has come from an infrastructure or cloud background, you will be passionate about monitoring and “X”aaS (platform, infrastructure etc). Ideally you will be familiar with concepts such as infrastructure, cloud and automation monitoring technology. You will be working with a group of data, infrastructure, and DevOps engineers; and architects, on maintaining, improving and developing the organization infrastructure that provides real time services to our retail and corporate users.You will help transition the business from traditional outsource model to a modern AIOPs based organization, as well as supporting and maintaining the current monitoring systems while they are migrated. You will have a good knowledge of monitoring software and related protocols or a willingness to learn these to an advanced level; and ideally development experience which you are willing to utilize in a mixed virtual / cloud / on-prem environment.Your responsibilities:To be part of the team you need a desire to collaborate, to keep on learning and the discipline to deliver nothing short of excellence. Working with stakeholders to understand and interpret business requirements, we are looking for someone who demonstrates:

Familiarity with Application performance monitoring (APM) solutions, such as:

SolarWinds, Datadog, Cloudwatch etc

Familiarity with managing the performance and reliability of distributed systems across various on-prem, virtualized and multi-cloud environments (AWS, Azure etc).

Experience of applying AIOPs in an existing environment is a major plus

Maintain and develop the organizations (monitoring) infrastructure

Contribute and deliver against strategic initiatives

Own the problem, quality, deployment speed and cost (recommend if we should buy or build)

The idea of learning new technologies appeals to you

You want to develop and share your knowledge, support your colleagues and you want your team to be successful (it is about the team success not only yours).

You are detail oriented

An analytical mindset and pragmatic approach

Competencies Required:

Knowledge of multiple APM tools such as Data Dog, Solar Winds, Nagios etc

Knowledge of supporting technologies such as PagerDuty

Experience of working in a multi cloud environment