Senior Software Engineer, ML Evaluation

Mission We are seeking a highly skilled and motivated Senior Data Analysis Engineer for our large-scale AI model and software evaluation framework – Ground Truth Regression. The ideal candidate will have a strong background in data engineering, machine learning principals and statistical analysis. At Motional, large scale orchestration for data analysis plays a critical role in delivering our ML-centered autonomous driving vehicle. Our robo-taxi ML Models and software are developed by hundreds of developers and deployed multiple times a day - The Ground Truth Regression team provides the large scale perception analysis framework for validating all changes to perception which can impact the autonomous vehicle behavior. The GTRegression team validates the end impact of ML and software changes to the autonomous vehicle while those changes are in development, providing the tools for Root Cause Analysis, and safety consideration. We monitor for model errors, anomalies, rare objects & long-tail driving scenarios across thousands of driving hours. The team develops the full stack - AWS Kubernetes orchestration framework, ReSimulation, model metrics, regression reports, and deep dive analysis UI’s. The team works together with all other perception and ML teams to develop the metrics and analyze results. Responsibilities Work with ML Engineers and Autonomy Software Developers to develop new data analysis metrics and KPI’s for the validation of the autonomous vehicle performance. Drive innovation by researching and developing new large scale data analysis systems. Own large-scale data analysis workflows that surface unexpected impacts of planned and unplanned changes to the ML models and software. Build high-quality datasets to improve ML products through training & edge case validation. Provide statistical depth on model performance & generalization through rigorous error and change analysis. Qualifications Bachelor's or Master's degree in Computer Science, Data Science, or a related field. Strong programming skills in Python, SciPy, and related data analysis frameworks. Experience in machine learning, data mining, and statistical analysis. Experience with large-scale data processing and distributed computing technologies. Strong communication and software development skills: goal setting, design documentation, test frameworks, collaborative cross team development. Bonus Points Ph.D. in Computer Science or a related field. Experience with cloud platforms such as AWS, Google Cloud, or Azure. Experience with machine learning in the autonomous driving domain. Publications or contributions to the AI/ML community. Benefits Candidates for certain positions are eligible to participate in Motional’s benefits program. Motional’s benefits include but are not limited to medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance, and more. Compensation Salary Range: $159,000 - $207,000 USD Motional AD Inc. is an EOE. We celebrate diversity and are committed to creating an inclusive environment for all employees. To comply with Federal Law, we participate in E-Verify. All newly-hired employees are queried through this electronic system established by the DHS and the SSA to verify their identity and employment eligibility. #J-18808-Ljbffr Motional