Senior Software Engineer Data
Employment Info
JOB SUMMARY
Requirements
- 5+ years of experience in software engineering, with a data focus
- Demonstrable proficiency in Python
- Familiarity with distributed data processing and building robust data pipelines
- Familiarity with the use or concepts underpinning various Data Engineering technologies and approaches
- Ability to lead projects autonomously, prioritise tasks, and deliver high-quality results
- Proven success working with research and platform engineering teams to support data-driven projects
- Strong problem-solving skills, focusing on efficiency, scalability, and cost-effectiveness
- Excellent written and verbal communication skills
- A Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field
Responsibilities
- Data Pipeline Design & Development: Architect, build, and manage scalable data pipelines using Spark, Databricks, and proprietary HPC tooling, ensuring high availability, scalability, and performance
- Platform and Tooling Development: Advance the state of the art of Optiver’s Research and Data platforms and tools
- Cost Optimisation: Monitor and optimise resource usage in partnership with the Data Platform team, balancing performance and cost-effectiveness
- Monitoring & Tuning: Implement monitoring tools and fine-tune systems for optimal throughput, latency, and reliability
- Cross-Functional Collaboration: Work closely with global Data Platform teams to maintain alignment on data strategy, tools, and best practices
- Documentation & Standards: Develop and maintain clear documentation of data pipeline architectures, processes, and best practices
- Mentorship & Guidance: Provide technical mentorship to junior engineers and support the growth of the data engineering function in Sydney
Desired Qualifications
- Hands-on experience with Spark or Databricks
- Experience developing bespoke software components for data pipelines
- Familiarity with system languages (e.g. C++, Rust)
- Familiarity with cloud-based architectures (e.g. AWS)
- Experience with large-scale relational databases (e.g. PostgreSQL)
- Knowledge of real-time data streaming technologies (e.g. Kafka)
- Experience collaborating with researchers to transform experimental workflows into production-ready pipelines
Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#DesignFintech #GlobalDesigners
#FintechInnovation #CreativeJobs
#DesignHub
#Tech Meets Design
#DesignerNetwork
#Myausjob
Related Jobs
Your Next Career Move Starts Here