Senior Machine Learning Test Engineer
Autodesk
Job Requisition ID #
26WD98377
Senior Machine Learning Test Engineer
Location: United States East Coast
Position Overview
As a Senior Machine Learning Test Engineer in the Research Enablement team, you will work side-by-side with researchers, Machine Learning developers and developers, and software developers and developers to define and uphold quality standards for ML systems. You are a quality-focused developer who is passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps, with a strong software engineering base. You are excited to collaborate across research and product to ship ML capabilities with clear quality gates. You are comfortable working at the intersection of research and product and are competent in using Autodesk CAD software.
Reporting Structure: You will report to an Engineering Manager in Research Enablement.
Location: United States, East Coast Time Zone.
We are a global team, located in London, San Francisco, Toronto, and remotely. Autodesk is a hybrid-first company, allowing workers to work remotly, in an office, or a mix of both.
Responsibilities
Define ML quality strategy and acceptance criteria across data, model, and system levels
Design and maintain model evaluation suites, metrics, and test datasets
Evaluating CAD RL model outputs for geometric validity or policy stability
Defining structured rubrics that translate qualitative findings into measurable evaluation gates
Testing ML Models from product side
API Testing
Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins)
Create and maintain test harnesses for ML services and APIs
Mentor teams on ML QA best practices and consistent evaluation standards
Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection)
Contribute to multi-team projects and codebases, ensuring code quality and consistency
Participate in code reviews and provide constructive feedback to peers
Document and present findings and ideas across the company
Minimum Qualifications
Bachelor's degree in Computer Science, Engineering, or equivalent experience
7+ years of professional experience in software engineering or QA for ML/AI systems
Strong programming skills in Python, with experience in test automation
Familiarity with popular CAD environments tooling
Proficient in Automation and UAT test suite/framework
Experience designing QA frameworks or platforms used by multiple teams
Excellent problem-solving skills and attention to detail
Strong communication and collaboration skills
Understanding of software architecture and design patterns
Ability to work in an agile development environment
Preferred Qualifications
Experience with data validation tooling (e.g., Great Expectations) or labeling workflows
Familiarity with ML frameworks (e.g., PyTorch, TensorFlow)
Experience with CI/CD tools and processes
Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)
Familiarity with MLOps practices (model monitoring, drift, deployment checks)
Experience with ML evaluation methods, metrics, and benchmarking
Passion for learning new technologies and improving existing systems
Experience with cloud providers (e.g., AWS, Azure, Google Cloud Platform)
Experience testing ML services in production environments
Knowledge of experiment tracking tools (e.g., Comet, MLflow, Weights & Biases)
The Ideal Candidate
You demonstrate initiative to provide solutions and to learn and develop new technologies
Comfortable building QA systems from scratch and writing maintainable automation
You enjoy learning and collaborating across global locations
You are comfortable working in newly forming ambiguous areas
You are comfortable building scalable and maintainable systems that will be relied on by others
You can communicate well with others
At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.
Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers (Careers%20%View email address on click.appcast.io%3E) .
$185k
...founding team and a group of highly-skilled engineers to shape the future of AI-enabled... ...Will... Design, train, and evaluate machine learning models across a range of research and applied... ...Run rapid, iterative experiments to test hypotheses and surface insights that...SeniorTemporary workRemote work$126.2k - $264.1k
...Job Description Implements machine learning (ML) models for production. Ensures the readiness of machine learning models for deployment... ...experimentation, data collection and analyses, model building). – Tests and reviews code for bugs. MachineLearning Expertise:...SuggestedTemporary workFlexible hoursShift work- Title: Senior Industrial EngineerLocation: Trenton, SC 29847 (onsite) Direct HireResponsibilitiesLeads projects or processes of diverse... ...to operating methodsAssists manufacturing plant/facilities engineers with facility planning and designSupports relationships through...Senior
$107.66k - $161.7k
...topics and providing a unique platform to learn and connect with others. Poe : a... ...About the Team and Role: Our small engineering team works on challenging problems every... ...product and our company. At Poe, we use Machine Learning in various parts of the product...SuggestedRemote jobFull timeWork experience placementInternship- ...building community through regular in-person events. Learn more about our flexible approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with senior engineers and product leaders as part of your...SuggestedPermanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
- ...Bloomberg's Buy-Side Automation Frameworks team seeks an eager engineer who is passionate about quality and scalable solutions for other... ...across the department. Location: Princeton. You will architect testing foundations, apply AI to drive efficiency, and promote...Senior
- ...Veregy in Lawrenceville, NJ is seeking a Project Engineer III to lead energy conservation and facility improvement projects. You will identify and develop ECMs and FIMs, coordinate with operations, and ensure accurate scopes of work, energy savings, and M&V plans to support...Senior
- ...including e-commerce, advertising, and fulfillment. We use machine learning and Internet-scale data to elevate customer experience,... ...Discovery ML team at Instacart works alongside world-class engineers, data scientists, and product managers to shape the future of...Remote jobPermanent employmentWork experience placementInternshipWork at officeWork from homeFlexible hours
$155k - $175k
...profoundly impact health for humanity. Learn more at jnj.com. As guided by Our Credo... ...& Johnson Services, Inc. Job Title: Senior AI/ML Engineer Job Code: A011.10000 Job Location: Titusville... ...2. Python or R along with associated machine learning packages TensorFlow, PyTorch,...SeniorFull timeLocal areaImmediate startRemote work$105k - $150k
...Company: Gelest Inc. Job Description: Gelest, Inc., part of the Mitsubishi Chemical Group, is hiring a Senior Quality Assurance Engineer to support our continued growth in specialty materials. Join a collaborative team where your expertise will help advance...SeniorTemporary workWork experience placementWork at office3 days per week- ...MissionHires is collaborating with a global biopharmaceutical organization to hire an AI/ML & Analytics Platform Engineer in a hybrid role based in Plainsboro Township, NJ. The role involves designing and optimizing AI/ML platforms, collaborating with cross-functional...
$106.8k - $194.8k
...help to build a better working world. WAF Operations Solution Engineer PRACTICE DESCRIPTION: As a WAF Operations Solution... ...in a diverse and inclusive culture of globally connected teams. Learn more . We offer a comprehensive compensation and benefits...SeniorSummer holidayFlexible hours$90k - $160k
...: 10 S&P Global Corporate The Role: Senior Data Scientist Location: Princeton, NJ... ...solves diverse problems using applied machine learning and web development with an end-to-end... ....g., OpenAI, Anthropic, Llama), prompt engineering, fine-tuning/customization, and embedding...SeniorFull timeSecond jobLive inWorldwideFlexible hours2 days per week- Senior Litigation Attorney / Litigation PartnerPosition Overview We are seeking an experienced Senior Litigation Attorney / Litigation Partner to join our dynamic legal team. The ideal candidate will have a strong background in litigation, particularly in business litigation...Senior
- ...NWL, Inc. is seeking a Senior HR Generalist to support a broad range of HR programs including employee relations, recruitment, onboarding, payroll, benefits, and compliance. You will serve as a trusted resource for employees and managers while ensuring adherence to policies...Senior
$84.63k - $112.84k
...through data and AI. We are seeking a Senior Data Scientist who is excited by the opportunity... ...Apply statistical, forecasting, and machine learning techniques to solve business problems... ...of experience in data science, data engineering, analytics, or a related role ~ Strong...SeniorFull timeTemporary workRemote workWork from home$56k - $64k
A leading travel management firm is seeking a Travel Consultant to provide exceptional service to government clients. You will advise on travel arrangements, utilizing your strong GDS expertise, particularly in Sabre. The ideal candidate will have over 5 years of consulting...SeniorFlexible hours- ...GS1 US is seeking an Executive Assistant to provide high-level administrative support to the Senior Vice President. The role requires exceptional organization, discretion, and the ability to handle multiple priorities in a fast-paced environment. The position is based...Senior
- ...Asplundh Electrical Testing in Trenton, New Jersey seeks an experienced individual to lead protective relay testing and calibration on medium- to high-voltage systems. The role requires 5+ years of hands-on experience, strong technical skills in relay technology, and the...Senior
$124.7k - $207.8k
...and operational procedures. Mentor junior engineers and contribute to knowledge sharing... ...offer employees a broad range of benefits. Learn more about what working at Deloitte can mean... ...development From entry-level employees to senior leaders, we believe there’s always room...SeniorFlexible hours$296.3k - $423.9k
...combines deep technical leadership in machine learning and robotics with people leadership and... ...You will lead a high-performing team of engineers building ML-driven trajectory generation... ...can set technical direction, mentor senior engineers, and lead large cross-functional...Local areaRemote workWork from homeRelocationRelocation packageFlexible hours$186.07k - $218.9k
...process, and transform that data for analytics, machine learning, and powering end-user experiences. As an engineer on the team you will contribute to the full spectrum... ...as the candidate. The above pilots are for testing purposes and Coinbase will not use AI to make...SeniorLocal area$160k
...Job Description Senior Hospital Sales Executive A pathology laboratory is expanding its services and seeking experienced Senior Hospital Sales Executives for field-based roles across multiple U.S. regions. This opportunity is ideal for sales professionals with...SeniorPart timeImmediate start- ...Capital One is looking for a Senior Principal Relationship and Business Development Manager for its International Markets team. This remote-eligible role involves managing client relationships and driving business development strategies that increase transaction volume...SeniorRemote work
- ...Veriff is seeking a Senior Technical Support Engineer for its USA region. In this role, you'll solve complex technical problems for major customers and mentor fellow engineers. Responsibilities include diagnosing issues, writing bug reports, and managing production incidents...SeniorRemote work
- ...manufacturer of custom color masterbatch, functional additives, engineered compounds and performance technologies. Our business is built... ...problem solver, adept at integrating data from multiple testing disciplines.Systems and operations mindset, continuously looking...Senior
$118k - $158k
...excellent health benefits.Position SummaryThe Manufacturing Science & Technology (MS&T) function is seeking a highly motivated Senior Process Engineer to be responsible for early and late stage AAV development, commercialization, and lifecycle management. Reporting to the...SeniorFull timeTemporary workLocal areaShift work- ...Senior Power Electronics Engineer Location: Syracuse, NY - Onsite Education: BS / MS in Electrical / Electronics with 8 years experience Responsibilities... .../ inverters / contactors - High voltage / wattage test and integration - VFD integration, filters and VFD...Senior
- ...A leading insurance company is seeking a Senior Actuarial Analyst in Trenton, New Jersey. This role involves developing and supporting a pricing framework and leading projects while mentoring entry-level analysts. Candidates should have over 4 years in actuarial roles...SeniorRemote work
- ...New Jersey, offering professional services in non-destructive testing and evaluation (NDT/NDE) of highway infrastructure (bridges... ...concrete materials testing laboratory. Job Description The “Senior Engineer” position will involve performing engineering tasks, in the...SeniorFull timeWork at officeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Machine Learning Test Engineer. Be the first to apply!
- lead performance test engineer Trenton, NJ
- senior manager tax Trenton, NJ
- senior international accountant Trenton, NJ
- senior vmware engineer Trenton, NJ
- senior resident engineer Trenton, NJ
- senior performance engineer Trenton, NJ
- senior storage engineer Trenton, NJ
- senior director diversity & inclusion Trenton, NJ
- senior construction accountant Trenton, NJ
- senior manager Trenton, NJ



