Evaluation Lead

Job Description

Job Description

Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology that's powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.

With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit:

We are looking for a hands-on leader to build a new centralized Evaluation team. This team will  be responsible for providing comprehensive and holistic analysis on all aspects of performance of the autonomy system. In this role, you will collaborate closely with the systems & safety team, responsible for defining the requirements & evaluation criteria, as well as the autonomy teams to understand their evaluation needs. You will get to work with Waabi World, our highly realistic closed-loop simulation engine built with the latest in generative AI technologies to deliver the evaluation capabilities needed to support the safe development of  the next generation of autonomous vehicles!

You will...

- Lead and build a cross functional team of software engineers, data analysts, and data scientists supporting automated workflows that provide high signal on autonomy performance. 

- Design scalable production frameworks for sampling evaluation sets, developing and improving metrics, and systematically measuring the performance of both autonomy and the eval ecosystem itself.

- Design pipelines, tools, and dashboards to characterize autonomy performance for technical teams and executive leadership, collaborating closely with platform teams on implementation, and autonomy, systems and safety and product teams on requirements. 

- Work closely with simulation and software teams to build solutions that leverage our data, metrics and simulation platforms effectively. 

- Lead technical projects; contributing as an IC while also managing the team.

- Participate and share ideas in technical and architecture discussions, collaborating with researchers and engineers.

- Conduct regular one-on-one meetings to offer guidance and constructive feedback to direct reports.

Qualifications:

- Minimum of 6+ years of autonomous vehicle industry experience including at least 2+ years managing high performing teams

- Experience evaluating AI or machine learning models, ideally in self-driving or related fields

- MS/PhD or Bachelors degree in Computer Science, Data Science, Robotics and/or similar technical field(s) of study

- Strong statistical background 

- Experience working with internal cross-functional partners/stakeholders  

- Experience with system design/architecture and algorithms

- Open-minded and collaborative team player with willingness to help others

- Passionate about self-driving technologies, solving hard problems, and creating innovative solutions.

Bonus/nice to have:

- Previous experience leading Autonomy Evaluation teams 

- Experience with large scale databases and analytics 

The US yearly salary range for this role is: $159,000 - $260,000 USD in addition to competitive perks & benefits. Waabi (US) Inc.’s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. The salary base range is reflective of the minimum and maximum target for new hire salaries for the position across all US locations.  Note: The Company provides additional compensation for employees in this role, including equity incentive awards and an annual performance bonus.

Perks/Benefits:

- Competitive compensation and equity awards.

- Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).

- Unlimited Vacation.

- Flexible hours and Work from Home support.

- Daily drinks, snacks and catered meals (when in office).

- Regularly scheduled team building activities and social events both on-site, off-site & virtually.

- As we grow, this list continues to evolve! 

Waabi is a technology start-up building technologies to transform the way the world moves. Join our talented team to be a part of the future and to make an impact!

Waabi is an equal opportunity employer. We celebrate diversity and are committed to creating a supportive, inclusive, and accessible workplace for all our employees. We seek applicants of all backgrounds and identities, across race, color, ethnicity, national origin or ancestry, age, citizenship, religion, sex, sexual orientation, gender identity or expression, military or veteran status, marital status, pregnancy or parental status, caregiver status, disability, or any other characteristic protected by law. We make workplace accommodations for qualified individuals with disabilities as required by applicable law. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.