Data Engineer

Job Description

Data Engineer - Location: BelfastSalary Information - Based on ExperienceJunior Consultant: £38,000 - £47,000Consultant: £47,000 - £55,000Senior Consultant: £55,000 - £64,000Overview:Our client is a renowned management consultancy working across both public and private sectors, with a focus on preparing their clients for a technology driven world. Boasting a large network of clients across the FTSE 100 and Fortune 500, you are beingoffered the unique opportunity to join this disruptive and forward-thinking organisation, helping to build innovative digital solutions in a technology-driven future. With the power of human ingenuity at its core, you will become a pivotal part in a team ofindustry leading experts working across both public and private sectors.What you will do:

• Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL.
• Perform tasks such as writing scripts, extracting data using APIs, writing SQL queries etc.
• Work closely with other engineering teams to integrate data engineering component into production systems.
• Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
• Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming.
• Knowledge of data mining, machine learning, natural language processing is an advantage.
• Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that include Platform-as-a-Service components and perhaps even server-less and container technologies.

You will have:

• AWS is a significant growth area for our client with a diverse and growing capability and they are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement.
• There are a variety of different tools, cloud technologies and approaches and while we have a preference for AWS tooling experience, open-source equivalence will be suitable.
• As an Data Engineer, youll have experience working in teams to design, build, and maintain large scale data solutions and applications using AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB.
• Your team members will look to you as a trusted expert and will expect you to define the end-to-end software development lifecycle in line with modern AWS best practices.
• Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing.

Benefits:

• Flexible working
• 25 days annual leave with the opportunity to buy 5 additional days
• Annual performance-based bonus
• Generous company pension scheme
• Share ownership
• Tax efficient benefits (cycle to work, give as you earn)
• Private healthcare for you and your family, and additional health and lifestyle perks

If you are interested in the Solution Architect role apply now, or if you have any further questions contact Svava Danielsdottir at Anson McCade for additional details.Reference: AMC/SDA/DE