Data Engineer

Pioneer Search Ltd
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
£ 70K

Job location

Tech stack

Agile Methodologies
Azure
Big Data
Cloud Engineering
Continuous Integration
Data Architecture
Information Engineering
ETL
Data Systems
DevOps
Python
Azure
SQL Databases
Azure
Spark
GIT
Data Lake
Azure
Data Pipelines
Databricks

Job description

We are working with a leading Lloyd's and London Market insurer who are continuing to invest heavily in their cloud data platform. This role sits within a specialist data engineering team responsible for building and evolving Markel's Azure based data architecture., You will work on a modern Azure data stack including Databricks, Azure Data Factory, Synapse and Data Lake, helping to design and develop scalable data pipelines that support underwriting, analytics and wider business reporting., * Design and develop cloud based data solutions using Azure technologies including Databricks, Azure Data Factory, Synapse and ADLS

  • Build and optimise data pipelines using Python, SQL and Spark
  • Support the ingestion and transformation of data from multiple global systems into the Azure data platform
  • Work closely with data engineers, architects and product owners to deliver new data capabilities
  • Contribute to CI/CD pipelines and DevOps practices within the data engineering environment
  • Collaborate with stakeholders across the business to understand and deliver data requirements

Requirements

This is an excellent opportunity for a Data Engineer with a few years of Azure experience who is looking to deepen their cloud engineering capability within a highly collaborative and technically strong team., * Experience working as a Data Engineer within an Azure environment

  • Strong SQL and Python development skills
  • Exposure to Databricks, Azure Data Factory, Synapse or Azure Data Lake
  • Experience building ETL or ELT pipelines and working with large datasets
  • Familiarity with DevOps practices such as Git and CI/CD
  • Strong communication skills and experience working within Agile teams

Experience within Financial Services or the London Market insurance sector would be advantageous but is not essential.

This role would suit an ambitious Data Engineer with around four to five years' experience who is looking to work with modern Azure technologies and continue developing their technical skill set in a supportive team environment.

Apply for this position