Senior Data Engineer

VanRath
17 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Tech stack

Java
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Information Engineering
Data Governance
Amazon DynamoDB
Python
DataOps
SQL Databases
Spark
Kafka
Data Management
Functional Programming
Terraform
Data Pipelines

Job description

  • Design, build, and optimise end-to-end data pipelines to support surveillance and compliance systems
  • Implement automated data quality checks, validation, and reconciliation processes, ensuring data accuracy and completeness
  • Develop AWS infrastructure using Terraform or CDK to enhance scalability and reliability
  • Monitor and troubleshoot data anomalies, collaborating with analysts, developers, and business units to resolve issues swiftly
  • Establish data management frameworks aligned with regulatory and security standards
  • Partner with stakeholders to translate business rules into robust technical solutions, fostering continuous improvement and technological innovation

Requirements

  • Proven experience in data engineering and data operations within financial services
  • Strong proficiency in Python or Java, SQL, and data pipeline frameworks such as Airflow, dbt, or Spark
  • Hands-on experience with AWS services including Lambda, S3, DynamoDB, Glue, and infrastructure-as-code tools like Terraform or CDK
  • Knowledge of data governance, compliance regulations, and security best practices in financial ecosystems
  • Excellent communication skills with the ability to collaborate effectively with technical and non-technical stakeholders
  • Familiarity with streaming technologies like Kafka or Kinesis

Benefits & conditions

  • Competitive salary package
  • Generous holiday allowance
  • Comprehensive health and wellness benefits
  • Opportunities for professional development and certification support
  • Dynamic and collaborative global work environment

About the company

Join a global leader at the forefront of financial markets-this organisation boasts a rich history of connecting clients to vital liquidity and data solutions across the world. As a trusted provider of market infrastructure, they enable secure, innovative, and responsible trading and data services that empower the industry's future. About your next employer This organisation is a world-renowned provider of market infrastructure, serving as the largest interdealer broker globally and a leader in Energy & Commodities brokerage, OTC data, and trading platforms.

Apply for this position