Lead Data Engineer

Paymentgenes
Charing Cross, United Kingdom
3 days ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 140K

Job location

Remote
Charing Cross, United Kingdom

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Data analysis
Apache HTTP Server
Big Data
Cloud Computing
Databases
Continuous Integration
Data Architecture
Data Infrastructure
Data Integration
ETL
Data Systems
Data Warehousing
Python
NoSQL
Raw Data
SQL Databases
Data Ingestion
Data Management
Data Pipelines
Docker
Databricks

Job description

As a Senior Data Engineer, you will design and build scalable data pipelines and platforms that ingest, process and distribute data from a wide range of internal and external sources. Your work will ensure data is structured, reliable and readily available for analytics, predictive modelling and trading applications.

You will collaborate closely with data scientists, quantitative teams and traders, helping transform raw data into actionable insights. The environment is highly collaborative and fast-paced, with a strong focus on continuous improvement, modern cloud technologies and high-performance data infrastructure.

What Youll Be Working With

  • Python for data ingestion, transformation and processing
  • Cloud-based data infrastructure within AWS
  • Analytical and time-series databases such as Redshift or ClickHouse
  • Containerised environments using Docker
  • CI/CD and Infrastructure-as-Code practices
  • Large and varied datasets used in energy and financial markets, Role: Lead Data Engineer - Azure/Databricks Read on to find out what you will need to succeed in this position, including skills, qualifications, and experience.Location: SheffieldWorking Model: Hybrid - 2 days per week in personSalary: Up to £85k depending on...

Requirements

  • Strong experience building and maintaining data pipelines and data platforms
  • Excellent Python skills and experience working with large datasets
  • Experience with cloud platforms (AWS) and modern data architecture
  • Knowledge of analytical databases and data warehousing technologies
  • Experience working in commodities, energy trading or financial markets
  • A proactive, solutions-focused mindset with a passion for building reliable data systems, If youre a data engineer who enjoys working on complex data challenges in a fast-moving environment, this is a chance to make a tangible impact within a world-class trading organisation., Job Description - Gloucester location - hybrid working when possible - Must hold active Enhanced DV Clearance (West) - Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus - Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL,...

Benefits & conditions

Alongside a competitive salary, the role offers a discretionary bonus, strong benefits package, hybrid working and ongoing professional development., £40,000

BI and Data Engineering Lead A variety of soft skills and experience may be required for the following role Please ensure you check the overview below carefully.Salary: £40,000£45,000 per annumReporting to: Digital Delivery ManagerLocation: Trust sites (with travel...

Lead Data Engineer

Rebel Recruitment £85,000, Job Description Senior / Lead Data Engineer London, Hybrid. (1-3 Days in London) Up to £90,000 plus 25% bonus. This is an exciting opportunity to lead data engineering within a growing organisation that is scaling its cloud data platform. You will take technical...

About the company

A global energy and commodities trading organisation is looking for a Senior Data Engineer to join its growing Data, AI & Analytics team in London. This is an opportunity to work at the heart of a highly data-driven trading environment, building the platforms and pipelines that power advanced analytics, machine learning and systematic trading strategies. The firm operates across global energy and commodities markets and is known for combining quantitative research, advanced analytics and modern technology to support trading and risk management. Data sits at the centre of this ecosystem, and the engineering team plays a critical role in delivering high-quality, accessible data to traders, analysts and data scientists., Job Description About Indicium AI Indicium AI is trusted by the world's leading enterprises to deliver AI into production at scale. We are a global AI-native consultancy with proven experience across Financial Services, Energy & Utilities, Healthcare & Life Sciences,..., Job Description Our client is a successful tech scale-up, a cash-generative SME currently at c.£10m turnover and c.80 staff, looking to double in size in the next five years under the guidance of its experienced, highly charismatic and driven CEO, supported by a...

Apply for this position