JOB SUMMARY
This role is focused on:
- Designing, developing, and maintaining scalable data pipelines using Spark and PySpark.
- Building cloud-native data solutions within AWS data platforms.
- Supporting large-scale migration of legacy and bespoke data pipelines.
- Developing robust ETL and ELT processes using modern data engineering practices.
- Working with business and technical stakeholders to understand requirements and deliver high-quality solutions.
- Contributing to data platform optimisation, automation, and continuous improvement initiatives.
- Collaborating within Agile delivery teams to deliver business-critical outcomes.
Key Responsibilities
- Design, build, and optimise data pipelines using Spark, PySpark, and Java.
- Develop and maintain AWS-native data solutions leveraging services including Glue, Glue Catalog, S3, Airflow, DBT, and Starburst/Presto.
- Support the migration of existing data assets into modern cloud-based architectures.
- Implement data quality, monitoring, and performance optimisation practices.
- Work closely with architects, analysts, and stakeholders to deliver reliable and scalable data solutions.
- Troubleshoot complex data engineering issues and identify opportunities for improvement.
- Contribute to technical design discussions and engineering best practices.
- Provide consulting expertise and communicate effectively with customer stakeholders.
What We’re Looking For
Core Skills and Experience
- Strong experience as a Data Engineer in enterprise-scale environments.
- Hands-on experience with Spark, PySpark, and Java.
- Strong knowledge of the AWS data ecosystem, including:
o AWS Glue
o Glue Catalog
o Amazon S3
o Starburst / Presto
o Apache Airflow
o DBT
- Experience designing and supporting complex data pipelines and data integration solutions.
- Strong understanding of cloud-based data architectures and engineering best practices.
- Excellent problem-solving and analytical skills.
- Strong stakeholder engagement and communication skills.
- Customer-focused mindset with the ability to work directly with senior business and technical stakeholders.
Desirable
- Financial Services industry experience.
- Consulting experience within client-facing environments.
- Experience delivering large-scale cloud migration or modernisation programs.
- Exposure to modern data lake, lakehouse, and distributed data processing architectures.
Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#DesignFintech #GlobalDesigners
#FintechInnovation #CreativeJobs
#DesignHub
#Tech Meets Design
#DesignerNetwork
#Myausjob