Senior Machine Learning Test Engineer
Autodesk
- # Senior Machine Learning Test EngineerApplylocations: Boston, MA, USA: New Jersey, USA - Remote: New Hampshire, USA - Remote: Massachusetts, USA - Remote: West Virginia, USA - Remotetime type: Full timeposted on: Posted Yesterdayjob requisition id: 26WD98377**Job Requisition ID #**26WD98377**Senior Machine Learning Test Engineer****Location: United States East Coast****Position Overview**As a Senior Machine Learning Test Engineer in the Research Enablement team, you will work side-by-side with researchers, Machine Learning developers and developers, and software developers and developers to define and uphold quality standards for ML systems. You are a quality-focused developer who is passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps, with a strong software engineering base. You are excited to collaborate across research and product to ship ML capabilities with clear quality gates. You are comfortable working at the intersection of research and product and are competent in using Autodesk CAD software.Reporting Structure: You will report to an Engineering Manager in Research Enablement.Location: United States, East Coast Time Zone.We are a global team, located in London, San Francisco, Toronto, and remotely. Autodesk is a hybrid-first company, allowing workers to work remotly, in an office, or a mix of both.**Responsibilities*** Define ML quality strategy and acceptance criteria across data, model, and system levels* Design and maintain model evaluation suites, metrics, and test datasets* Evaluating CAD RL model outputs for geometric validity or policy stability* Defining structured rubrics that translate qualitative findings into measurable evaluation gates* Testing ML Models from product side* API Testing* Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins)* Create and maintain test harnesses for ML services and APIs* Mentor teams on ML QA best practices and consistent evaluation standards* Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection)* Contribute to multi-team projects and codebases, ensuring code quality and consistency* Participate in code reviews and provide constructive feedback to peers* Document and present findings and ideas across the company**Minimum Qualifications*** Bachelor’s degree in Computer Science, Engineering, or equivalent experience* 7+ years of professional experience in software engineering or QA for ML/AI systems* Strong programming skills in Python, with experience in test automation* Familiarity with popular CAD environments tooling* Proficient in Automation and UAT test suite/framework* Experience designing QA frameworks or platforms used by multiple teams* Excellent problem-solving skills and attention to detail* Strong communication and collaboration skills* Understanding of software architecture and design patterns* Ability to work in an agile development environment**Preferred Qualifications*** Experience with data validation tooling (e.g., Great Expectations) or labeling workflows* Familiarity with ML frameworks (e.g., PyTorch, TensorFlow)* Experience with CI/CD tools and processes* Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)* Familiarity with MLOps practices (model monitoring, drift, deployment checks)* Experience with ML evaluation methods, metrics, and benchmarking* Passion for learning new technologies and improving existing systems* Experience with cloud providers (e.g., AWS, Azure, Google Cloud Platform)* Experience testing ML services in production environments* Knowledge of experiment tracking tools (e.g., Comet, MLflow, Weights & Biases)**The Ideal Candidate*** You demonstrate initiative to provide solutions and to learn and develop new technologies* Comfortable building QA systems from scratch and writing maintainable automation* You enjoy learning and collaborating across global locations* You are comfortable working in newly forming ambiguous areas* You are comfortable building scalable and maintainable systems that will be relied on by others* You can communicate well with othersAt Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.## **Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers.**
- J-18808-Ljbffr Autodesk, Inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Machine Learning Test Engineer in New York, NY vacancy
- ...We are looking for a Machine Learning Engineer to join the Personalization team - an area of hardworking engineers that are passionate about understanding what drives user satisfaction with Spotify - and who make impactful changes to Home recommendation systems to achieve...Senior
Spotify
New York, NY5 days ago $215k
...Engineer: First Mile Group, Inc. seeks Senior Machine Learning Engineer, Client Insights in New York, NY to develop customer-facing models. $215,000 - $215,000/yr. Telecomm prmtd. Apply jobpostingtoday.com ref# 41194. JobiqoTJN. Keywords: Machine Learning Engineer,...SeniorFirst Mile Group, Inc.
New York, NY3 days ago- ...Senior Machine Learning Engineer (AI Integration) New York, New York, United States $ 5,000.00 - 8,000.00 (US Dollar) About the job Senior... ...applications. Develop and maintain robust model training, testing, and validation pipelines. Mentor junior engineers and...Senior
Recroot
New York, NY2 days ago $184.05k - $262.93k
...Machine Learning Engineer The Rewards team in Personalization (PZN) is defining the next generation of large-scale personalization at Spotify... ...Lead collaborations and align across PZN to integrate and A/B test mid-term signals in various recommendation and discovery...SeniorWork from homeFlexible hoursSpotify
New York, NY3 days ago$184.05k - $262.93k
...systems. What You'll Do Design and ship production-grade machine learning systems powering conversational and agentic AI experiences... ...and guide iteration Partner closely with product, engineering, and design to deliver seamless, user-facing experiences...SeniorWork from homeFlexible hoursSpotify
New York, NY4 days ago- ...Machine Learning Engineer Our client is a public safety product that's looking to add a machine learning engineer to their team. This particular role is focused on NLP/NLU for their real-time audio translation team. If you're excited about the future of video, audio...Senior
NxT Level
New York, NYa month ago $150k - $180k
...Description ChasmTeam Senior Machine Learning Engineer at JudiHealth Location: Remote (For Non-Local) or Hybrid (Local to NYC area)... ...validation, and deployment. Participate in code reviews, testing, and quality assurance processes. Troubleshoot and resolve...SeniorLocal areaRemote workFlexible hoursChasm Select
New York, NY1 day ago$146.16k - $219.24k
...for our audiences and our employees - and aim to leave a positive mark on culture. Overview We are seeking a Senior Machine Learning Engineer to join the PlutoTV pod. Your "North Star" mission is the personalization of the Linear/FAST experience, specifically...SeniorShift workParamount
New York, NY5 days ago$148.7k - $199.4k
...Machine Learning Engineer ESPN is investing in large-scale data infrastructure and real-time processing platforms that power next-generation... ...ML use cases. In this role, you will work closely with senior MLEs, data engineers, platform/SRE, and product teams to develop...SeniorThe Walt Disney Studios
New York, NY3 days ago$153k - $198k
...Senior Machine Learning Engineer Button's mission is to empower the companies shaping the creator and affiliate economy - fueling mobile growth... ...code with strong software engineering practices including testing, documentation, debugging, and thoughtful system design....SeniorLocal areaButton
New York, NY4 days ago$148.7k - $199.4k
...Technology is a global organization of engineers, product developers, designers, technologists... ..., Product, and Data teams to apply machine learning methods to meet strategic product... ...and establish new algorithm development, testing, and deployment standards * Collaborate...SeniorWork at officeDisney Entertainment and ESPN Product & Technology Careers
New York, NY1 day ago$210k - $260k
...teams. Promote best practices in ML systems development, testing, and experimentation within the team. Collaborate with Data... ...systems. Who You Are You have a strong background in machine learning and enjoy applying theory to real-world applications, with...SeniorFlexible hoursSpotify
New York, NY1 day ago$184.05k - $262.93k
...Spotify better understand audio, text, and visual content through machine learning. The team develops technologies that power experiences... ...product innovation, the squad partners closely with Product, Engineering, and Data Science teams to build intelligent systems that...SeniorWork from homeFlexible hoursSpotify
New York, NY3 days ago$125k - $150k
...transformative investments in machine learning products, algorithms, and... ...technically proficient, hands-on engineers who are passionate about... ...hypotheses, design rigorous A/B tests to validate them, and... ...Technical Leadership: As a senior member of the team, you will...SeniorWork at officeClarityPay Program Services LLC
New York, NY3 days ago$195k - $408k
...growing Roku's advertising business. The mission of the Ad Engineering Team is to build this platform. The Ad Serving team designs,... ...critical to the business. We are looking for a staff-level machine learning engineer with deep research and data science expertise to lead...SeniorWork at officeLocal areaRemote workMonday to ThursdayFlexible hoursRoku
New York, NY1 day ago$170k - $240k
...commercial intent beyond legacy search engines. Today, our Native Search solutions... ...We are seeking an experienced Senior Machine Learning Engineer passionate about building impactful... .... Establish and utilize robust A/B testing and experimentation frameworks to evaluate...SeniorSummer workWork at officeadMarketplace
New York, NY2 days ago- ...team is building models that improve how millions of users understand and grow their financial lives. We’re looking for machine learning engineers with experience applying state-of-the-art machine learning and modeling techniques, including natural language processing...SeniorWork experience placementLocal area
PLAID
New York, NY3 days ago $244k - $320k
...Senior Machine Learning Engineer Attentive® is the AI marketing platform for 1:1 personalization redefining the way brands and people connect.... ...Proactively safeguard model and system quality through testing, monitoring, validation, and alerting Collaborate cross...SeniorFull timeMetaProp.vc
New York, NY1 day ago$176k - $191k
GrubHub Inc. is seeking a Senior Machine Learning Engineer in New York to enhance food discovery through innovative recommendation systems. You will work closely with cross-functional teams to analyze data performance and model effectiveness. The ideal candidate will have...Senior$165k - $260k
...Senior Machine Learning Engineer - Search AI, BLAW/BTAX/BGOV Location New York Business Area Engineering and CTO Ref # 10051660 Description... ...AI-powered capabilities into production Design, write, test, and maintain modular, production-quality code while...SeniorTemporary workFor contractorsWork experience placementBloomberg
New York, NY4 days ago$148.7k - $199.4k
...Senior Machine Learning Engineer - News Technology is at the heart of Disney's past, present, and future. Disney Entertainment and ESPN Product... ...Champion engineering best practices across code quality, testing, CI/CD, observability, and incident response Mentor and...SeniorWork experience placementLocal areaDay shiftDisney
New York, NY4 days ago$176k - $191k
...Data Scientist Or Machine Learning Engineer At Grubhub, we believe food is more than just a meal: It's a source of discovery, connection, and... ...algorithmic approaches to improve our current system, designing A/B tests, and identifying creative solutions to bridge state of the...SeniorTemporary workWork at office3 days per weekWonder
New York, NY1 day ago$138k - $208k
...Comscore, Total Visits, March 2025) Day to Day As a Senior Machine Learning Engineer on our Sourcing team, you will work on developing and deploying... ..., scale them in production, and run iterative A/B tests to improve our Sourcing product Estimate potential business...SeniorWork experience placementLocal areaIndeed
New York, NY6 days ago$148.7k - $199.4k
...is a global organization of engineers, product developers, designers... ...data pipelines and advanced machine learning platforms that deliver... ...recommendation algorithms. As a Senior Machine Learning Engineer, you... ...across code quality, testing, CI/CD, observability, and incident...SeniorWork experience placementLocal areaDay shiftDisney Entertainment and ESPN Product & Technology Careers
New York, NY1 day ago- AI Chopping Block, Inc. is seeking a Senior Data Scientist (Algorithm Engineer) in New York, NY. This role involves leading the development of AI-driven... ...a Master's or PhD, with expertise in Python, deep learning, and data-driven modeling. Responsibilities include mentoring...Senior
$175k - $200k
A healthcare innovation firm is seeking a Senior Machine Learning Engineer to advance healthcare through AI. This role focuses on building production-grade machine learning systems, implementing scalable infrastructure, and collaborating across teams to drive impactful...Senior$140.7k - $198.9k
...love. The Advertiser Growth team is the engine of this mission, ensuring that as our marketplace... ...-velocity experimentation, including A/B testing, switchback tests, and long-term holdouts... ...-quarter technical roadmaps and mentor senior engineers in a high-growth environment....SeniorWork at officeWorldwideRelocation packageUnity
New York, NY4 days ago- 5014 Disney Entertainment & Sports LLC in New York is seeking a Senior Machine Learning Engineer to build robust data pipelines and deliver personalized experiences across media platforms including ABC News and Good Morning America. The ideal candidate is experienced in...SeniorDay shift
- General Information RaceOn is seeking a Senior Machine Learning Engineer as well as a Junior Machine Learning Engineer to architect and build production ML systems that create a competitive advantage on race day. The tasks are slightly different but candidates will be...SeniorRemote workWeekend work
$70 - $80 per hour
...traditional agencies while maintaining a high level of transparency and client service. Role Overview Our client is seeking a senior Machine Learning Engineer / Data Scientist on a contract basis to support the development and delivery of a machine-learning-powered media...SeniorPermanent employmentFull timeContract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Machine Learning Test Engineer. Be the first to apply!
Related searches
- computer vision machine learning engineer New York, NY
- machine learning ai engineer New York, NY
- senior ml engineer New York, NY
- machine learning software engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- ai ml engineer New York, NY
- junior machine learning research engineer New York, NY
- graduate machine learning engineer New York, NY
- test engineer remote New York, NY