Tech Lead / Senior Data & Analytics Engineer

Job Description

Tech Lead / Senior Data & Analytics Engineer (Databricks) £70,000 - £90,000 plus excellent benefits including pension, health care, life assurance and 28 days holiday. Plus lots of career progression, promoting from within and a friendly team.This is a hybrid role with 2 days in the Bristol office and 3 days working from home.A leading reinsurance agency based in Bristol. Their focus is on providing innovative, data-driven solutions to the reinsurance industry. By utilising advanced machine learning models, cutting-edge technology, and industry expertise, they transform raw datainto actionable insights for their clients.Job Description for Tech Lead / Senior Data & Analytics Engineer (Databricks):They are currently seeking an experienced Senior Data/ Analytics Engineer to join their team and play a critical role in the ongoing development and operationalisation of their cloud-based data platform.The successful candidate will work across the platform tackling large-scale data processing challenges and diverse types of data. You will need to be confident working with data that is statistical in nature, being able to interpret and question the outputand spot outliers and anomalies.The role encompasses everything from the initial ingestion of raw data through the application of advanced machine learning models to the visualisation and reporting of model results.As well as focusing on data content, you will support wider team with defining, implementing, and championing best practices around data asset creation and management.Key things for the Tech Lead / Senior Data & Analytics Engineer (Databricks) are:

• You have worked with analytical / statistical data or have a background in analytics
• You have a proven track record as data / analytics engineer regularly acting as a technical lead on projects
• You have strong stills in Databricks, python and pyspark
• You are able to translate requirements to technical specifications
• You question and challenge, you dont just execute
• You are a team player who is able to support, mentor and coach others

Responsibilities for Tech Lead / Senior Data & Analytics Engineer (Databricks):

• Design, develop, and maintain scalable data pipelines to ingest, process, and store large volumes of structured and unstructured data from various sources.
• Collaborate closely with data scientists and business stakeholders to define requirements and implement data processing workflows.
• Optimise and tune data pipelines for performance (cost and execution time) and reliability, ensuring the timely and accurate delivery of data to stakeholders.
• Implement and maintain robust data quality and governance processes, ensuring data accuracy, completeness, and compliance.
• Develop and maintain documentation for data engineering processes and systems.
• Collaborate with the data science team to operationalise ML models and integrate them into data processing workflows.
• Develop and maintain data visualisation and reporting solutions to support business decision-making.

Requirements for Tech Lead / Senior Data & Analytics Engineer (Databricks):

• A Bachelors degree in Computer Science, Mathematics or a related field.
• A minimum of 3 years of experience as a data / analytics engineer.
• At least 1 year of experience using Databricks, including PySpark and Delta Lake.
• Strong programming skills in Python.
• Strong skills in SQL and relational databases.
• Experience with cloud computing platforms, such as GCP, AWS, or Azure.
• Strong understanding of data warehousing and ETL concepts.
• Experience with data visualisation tools, such as Tableau, Power BI, or similar.
• Excellent communication and collaboration skills.
• Strong problem-solving and critical-thinking abilities.

Preferred Qualifications for Tech Lead / Senior Data & Analytics Engineer (Databricks):

• Experience in the reinsurance or insurance industry.

Experience with containerisation technologies, such as Docker and Kubernetes.How to apply for Tech Lead / Senior Data & Analytics Engineer (Databricks)If you would like to apply please send your CV to the links below.

Keyskills :
pythontechnical leadpysparkData Engineer / Analytics Engineer / statistical data / databricks