Lead Azure Databricks Engineer
Tenth Revolution Group
2 days ago
Role details
Contract type
Temporary to permanent Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English, Italian Experience level
Senior Compensation
£ 120KJob location
Tech stack
Unity
Artificial Intelligence
Amazon Web Services (AWS)
Azure
Cloud Engineering
Computer Security
Continuous Integration
Data Architecture
Information Engineering
Data Governance
ETL
Data Systems
Hive
Python
Azure
Azure
Data Lake
PySpark
Data Management
Data Pipelines
Serverless Computing
Databricks
Job description
- Design and build enterprise data platforms using Microsoft Azure services including Azure Data Factory, Azure Data Lake Storage, Azure Key Vault, Azure Functions and Azure Databricks
- Develop scalable pipelines using Delta Lake, PySpark and Unity Catalog
- Work with underwriting, actuarial, delegated authority, bordereaux, exposure management, reinsurance, finance and risk teams to deliver solutions aligned to Lloyd's market requirements and regulations including Solvency II
- Translate business requirements into scalable cloud data solutions with architects, SMEs and product owners
- Lead the resolution of complex technical challenges and drive delivery
- Promote best practices in data engineering, cloud architecture, CI/CD and data life cycle management
- Provide technical leadership and mentoring to engineers
- Improve platform performance, resilience, cost efficiency and observability
- Deliver reliable, high quality data pipelines across the platform, Power Systems Engineer - Renewable Energy (London based focusing on Italian projects) Our client is a fast-growing renewable energy development business operating across the UK and Italian markets. With a strong pipeline of solar, wind, and storage projects, the company is..., Power Generation Risk Engineer- Insurance- £105,000- £120,000 + Bonus + Car Allowance- London/ HybridHave you built your career inside power generation plants and know exactly where operational risks hide? Ready to step away from shift patterns or site pressure and use your..., A leading consulting firm in Greater London is seeking a Data Engineer - Associate to assist in building and optimizing data pipelines, ensuring data quality and performance. The role requires a Bachelor's degree and at least one year of experience in a commercial setting,..., A leading tech training provider in Greater London is seeking a Databricks Data Engineer to design and improve cloud data platforms. The role involves translating regulatory requirements and ensuring efficient data pipelines. The ideal candidate will have strong expertise..., A leading consultancy in cloud data solutions is looking for a Lead Azure Databricks Engineer to enhance enterprise data platforms. In this role, you will design and optimize Azure solutions, ensuring compliance with regulatory standards. The ideal candidate will have..., A leading technology company in the UK is seeking a talented Data and AI specialist to contribute to impactful projects. Responsibilities include managing data architecture and applying cutting-edge technologies. Candidates should have expertise in Python, Pyspark, and...
Requirements
We are seeking an experienced Lead Azure Databricks Engineer to design, build and optimise our enterprise data platforms. The role requires deep technical expertise, strong delivery capability and experience working in highly regulated environments within the Lloyd's of London market., * Strong engineering experience with Microsoft Azure data services and Azure Databricks in large scale environments
- Deep knowledge of Delta Lake, medallion architecture, distributed compute and lakehouse data platforms
- Strong development skills in Python, PySpark and Spark SQL
- Experience implementing CI/CD for data platforms using Azure DevOps
- Knowledge of data governance, lineage, access control and secure cloud engineering
- Excellent communication skills and ability to work with senior stakeholders
- Proven delivery mindset with strong ownership and accountability in fast paced environments
About the company
Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment., A leading financial services firm is seeking a contract Lead Data Engineer to join a dynamic team in London. This role involves engineering solutions using PySpark and Azure Databricks, while developing innovative Agentic AI technologies. Candidates should have a strong..., A leading consultancy in digital transformation is seeking a Senior Data Engineer in London to lead the development of data pipelines and workflows using Azure Databricks. The ideal candidate has over 5 years of hands-on experience, particularly in the insurance domain, and..., A technology solutions provider is seeking a Databricks SME and AWS Data Engineer in Northampton. This hybrid role focuses on migrating systems, developing PoCs for fraud detection, and working with cross-functional teams. Candidates should have strong AWS Data Engineering..., La Fosse are partnered with a market leading, high profile financial services company who urgently require a Lead Data Engineer contractor (Databricks) to join a dynmaic, fast placed, greenfield project team who are leveraging cutting edge AI technology to build a new..., Job Description Data Architect - Databricks - Hybrid - Up to £125,000 A leading Microsoft partnered consultancy is seeking an experienced Data Architect to design and deliver modern data solutions built on Databricks Lakehouse Architecture. You'll work with a variety of...
© 2026, Jobsora.com