Senior Software Engineer, Data and Orchestration

Overview

In this role you will evolve Wayve’s data pipeline and orchestration platform to handle high-volume autonomous driving data. You’ll revamp Harness and build a DAG-based system, enabling reliable, scalable data ingestion, processing, inference, and evaluation across teams. You’ll partner with stakeholders to translate needs into robust pipelines and improve reliability and usability. This is a chance to shape critical infrastructure at a fast-growing AI-driven mobility company.

Pay / Benefits

• Salaries benchmarked against the market annually
• Meaningful equity stake
• Relocation support and visa sponsorship
• Hybrid working with core hours
• Learning and development budgets
• Comprehensive benefits: health, dental, parental leave, retirement/pension, wellbeing support

Responsibilities

• Design, build, and evolve scalable data pipelines and orchestration infrastructure for the next‑gen autonomous driving data platform
• Revamp the Harness system and develop a new DAG-based workflow platform
• Create tooling and libraries to standardize ingestion, processing, inference and evaluation workflows across teams
• Ensure the platform supports hundreds of parallel pipeline steps with correct outputs and prioritized resources
• Support batch inference and optimisation workflows for cost-effective, scalable evaluations
• Improve platform reliability, quality and usability, including incident response aligned to business SLOs

Key requirements

• Strong software engineering fundamentals with production-grade systems experience
• Solid Python programming skills
• Experience with large-scale or high-throughput distributed systems
• Understanding of software engineering best practices (unit/integration tests, TDD, data-driven development)
• Familiarity with distributed event streaming platforms such as Apache Kafka
• Knowledge of database principles and consistency models (including eventual/strong consistency) and experience with Postgres, ClickHouse or columnar databases
• Ability to work with platform users and partner teams to translate requirements into scalable tech solutions
• Nice to have: data engineering platforms, ML infrastructure, Ray/Flyte/Spark, batch processing and resource prioritisation, shared library/tooling experience

• Collaborative with platform users and partner teams
• Strong problem-solving and system thinking
• Ability to translate requirements into scalable solutions
• Python
• Distributed systems
• Apache Kafka

…