Senior Data Engineer
VanRath
17 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Tech stack
Java
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Information Engineering
Data Governance
Amazon DynamoDB
Python
DataOps
SQL Databases
Spark
Kafka
Data Management
Functional Programming
Terraform
Data Pipelines
Job description
- Design, build, and optimise end-to-end data pipelines to support surveillance and compliance systems
- Implement automated data quality checks, validation, and reconciliation processes, ensuring data accuracy and completeness
- Develop AWS infrastructure using Terraform or CDK to enhance scalability and reliability
- Monitor and troubleshoot data anomalies, collaborating with analysts, developers, and business units to resolve issues swiftly
- Establish data management frameworks aligned with regulatory and security standards
- Partner with stakeholders to translate business rules into robust technical solutions, fostering continuous improvement and technological innovation
Requirements
- Proven experience in data engineering and data operations within financial services
- Strong proficiency in Python or Java, SQL, and data pipeline frameworks such as Airflow, dbt, or Spark
- Hands-on experience with AWS services including Lambda, S3, DynamoDB, Glue, and infrastructure-as-code tools like Terraform or CDK
- Knowledge of data governance, compliance regulations, and security best practices in financial ecosystems
- Excellent communication skills with the ability to collaborate effectively with technical and non-technical stakeholders
- Familiarity with streaming technologies like Kafka or Kinesis
Benefits & conditions
- Competitive salary package
- Generous holiday allowance
- Comprehensive health and wellness benefits
- Opportunities for professional development and certification support
- Dynamic and collaborative global work environment
About the company
Join a global leader at the forefront of financial markets-this organisation boasts a rich history of connecting clients to vital liquidity and data solutions across the world. As a trusted provider of market infrastructure, they enable secure, innovative, and responsible trading and data services that empower the industry's future.
About your next employer
This organisation is a world-renowned provider of market infrastructure, serving as the largest interdealer broker globally and a leader in Energy & Commodities brokerage, OTC data, and trading platforms.