Data Engineer

Job Description

Data Engineer - The company is also looking to recruit for a Junior Data Engineer.Department: DeliveryReporting to: Senior Data EngineerLocation: Edinburgh / BristolPurpose of the RoleThe company are currently looking for a Data Engineer to support the delivery of multiple data projects for their diverse client base. This role will involve hands-on data engineering with appropriate testing.The Data Engineer is a key part of the developmentteam and will work with Senior Data Engineers and Project Managers, Clients Services to ensure that projects are accurately scoped and delivered.Key ResponsibilitiesGeneral

• Ensuring excellence in the end-to-end delivery of data engineering tasks for the clients and internal stakeholders.
• Supporting the design of technology solutions that meet the business needs of the clients in terms of sustainability, scalability, performance, and security.
• Supporting the design and development of database build, integration projects, and change management across a diverse range of clients, industries, and technologies.
• Collaborating with clients and project delivery teams in the low-level design of data-oriented, ELT, or ETL projects in response to client requirements.
• Taking accountability and sharing responsibility for the implementation, dissemination, and adherence of Indicias Data Engineering methodologies, processes & principles.
• Providing reliable estimates and working to tight deadlines.
• Participating in programmes of continuous improvement to improve the reliability and efficiency of data processing.
• Supporting strategic initiatives impacting the Data Engineering team such as Continuous Integration / Continuous Deployment methodologies.
• The role often will be client-facing and will articulate technology deliverables in both technical and plain English language.

Strategic Planning & Decision Making

• Collaborating and deploying innovative technology solution
• Responsibility for ensuring own projects are running to time and escalates where there are potential issues
• Working with the senior technology team to ensure that the right technologyis being used with the right resource allocated to the project

Relationships

• Establishing and maintaining crucial relationships with day-to-day clients including marketing and technology departments through email, telephone and face-to-face meetings and briefings
• Reporting to Senior Data Engineer providing updates about work in progress and escalating any delivery issues
• Engaging with colleagues from other departments as appropriate to deliver projects
• Attending weekly client meetings for projects as and when required

Essential and Desirable Skills/ExperienceMandatory Requirements

• 2+ years of demonstrable experience in delivering data-driven technology solutions
• Demonstrable knowledge and practical experience of ETL/ELT approaches and processes
• Experience of an enterprise level ETL/ELT tool (e.g. Ab-Initio, Matillion, Informatica, AWS Glue)
• Database development utilising cloud database technologies such as Snowflake, Redshift or equivalent platforms
• Solid knowledge and experience of SQL including DML and DDL.
• Solid knowledge and experience of data modeling techniques
• Proven ability to quickly adapt to new technologies, concepts, and approaches
• Experience of high-standard documentation across the delivery cycle
• Experience of creating detailed Technical Design specifications that meet functional and non-functional requirements.
• Confident verbal and written English communication skills
• Experience of working in an agile environment.

Experience in the delivery of more than oneof the following is also required:

• Enterprise-level Business to Consumer databases using cloud platforms such as Snowflake, Redshift, Postgres, MySQL, NoSQL, SQL Server
• Campaign Management in a cloud-based environment (Adobe, Braze, Unica, SalesForce etc.)
• Enterprise-level BI or visualisation programmes (Tableau, Qlik, Power BI) etc.
• Experience in scalable APIs or equivalent Web Services integration
• Delivery of data driven digital personalisation and recommendation platforms
• Delivery of data science platforms such as AWS SageMaker

If you feel you are a suitable candidate and would like the opportunity to work for this very reputable company, then please do not hesitate in applying.