Senior Machine Learning Engineer - Perception

As a Perception Engineer, you will be instrumental in designing and implementing cutting-edge detection models, utilizing fused sensor data. In particular, the role will be on advanced projects that are aimed at the next generation of driving software, including looking at joint detection and tracking models as well as ways to send rich embeddings to downstream models to relay semantic meaning and capture uncertainty.

This role offers a unique opportunity to directly impact Zoox's expansion into new areas. By developing more generalizable and adaptable models, you will help us navigate diverse and challenging circumstances, accelerating our mission to deliver safe and reliable autonomous mobility. We are looking for a highly motivated individual passionate about pushing the boundaries of perception in the autonomous vehicle space.

In this role, you will

Train ML models, perform various studies into incorporating SOTA approaches as well as ablations/modifications of existing models

Document experimental outcomes and drive towards deploying these models into Zoox robots

Visualize your data at the input and output to understand the issues

Collaborate with teams such as ML optimization, data labeling, metrics and planner to ensure project is successful for Zoox releases

Qualifications

MS/PhD in Computer Science or related field

Experience with PyTorch or related ML frameworks

Experience deploying learned models into production

Excellent collaboration and teamwork skills with proven track record of working on large-scale problems

Bonus Qualifications

Prior experience in the AV or related space with joint detection and tracking models

Deep understanding of how to setup end-to-end training and evaluation processes