Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Machine Learning Test Engineer

Autodesk

Job Requisition ID #

26WD98377

Senior Machine Learning Test Engineer

Location: United States East Coast

Position Overview

As a Senior Machine Learning Test Engineer in the Research Enablement team, you will work side-by-side with researchers, Machine Learning developers and developers, and software developers and developers to define and uphold quality standards for ML systems. You are a quality-focused developer who is passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps, with a strong software engineering base. You are excited to collaborate across research and product to ship ML capabilities with clear quality gates. You are comfortable working at the intersection of research and product and are competent in using Autodesk CAD software.

Reporting Structure: You will report to an Engineering Manager in Research Enablement.

Location: United States, East Coast Time Zone.

We are a global team, located in London, San Francisco, Toronto, and remotely. Autodesk is a hybrid-first company, allowing workers to work remotly, in an office, or a mix of both.

Responsibilities

  • Define ML quality strategy and acceptance criteria across data, model, and system levels

  • Design and maintain model evaluation suites, metrics, and test datasets

  • Evaluating CAD RL model outputs for geometric validity or policy stability

  • Defining structured rubrics that translate qualitative findings into measurable evaluation gates

  • Testing ML Models from product side

  • API Testing

  • Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins)

  • Create and maintain test harnesses for ML services and APIs

  • Mentor teams on ML QA best practices and consistent evaluation standards

  • Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection)

  • Contribute to multi-team projects and codebases, ensuring code quality and consistency

  • Participate in code reviews and provide constructive feedback to peers

  • Document and present findings and ideas across the company

Minimum Qualifications

  • Bachelor's degree in Computer Science, Engineering, or equivalent experience

  • 7+ years of professional experience in software engineering or QA for ML/AI systems

  • Strong programming skills in Python, with experience in test automation

  • Familiarity with popular CAD environments tooling

  • Proficient in Automation and UAT test suite/framework

  • Experience designing QA frameworks or platforms used by multiple teams

  • Excellent problem-solving skills and attention to detail

  • Strong communication and collaboration skills

  • Understanding of software architecture and design patterns

  • Ability to work in an agile development environment

Preferred Qualifications

  • Experience with data validation tooling (e.g., Great Expectations) or labeling workflows

  • Familiarity with ML frameworks (e.g., PyTorch, TensorFlow)

  • Experience with CI/CD tools and processes

  • Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)

  • Familiarity with MLOps practices (model monitoring, drift, deployment checks)

  • Experience with ML evaluation methods, metrics, and benchmarking

  • Passion for learning new technologies and improving existing systems

  • Experience with cloud providers (e.g., AWS, Azure, Google Cloud Platform)

  • Experience testing ML services in production environments

  • Knowledge of experiment tracking tools (e.g., Comet, MLflow, Weights & Biases)

The Ideal Candidate

  • You demonstrate initiative to provide solutions and to learn and develop new technologies

  • Comfortable building QA systems from scratch and writing maintainable automation

  • You enjoy learning and collaborating across global locations

  • You are comfortable working in newly forming ambiguous areas

  • You are comfortable building scalable and maintainable systems that will be relied on by others

  • You can communicate well with others

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers (Careers%20%View email address on click.appcast.io%3E) .

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Machine Learning Test Engineer in Trenton, NJ vacancy
  • $185k

     ...founding team and a group of highly-skilled engineers to shape the future of AI-enabled...  ...Will... Design, train, and evaluate machine learning models across a range of research and applied...  ...Run rapid, iterative experiments to test hypotheses and surface insights that... 
    Senior
    Temporary work
    Remote work

    Cribl, Inc

    Trenton, NJ
    5 days ago
  • $126.2k - $264.1k

     ...Job Description Implements machine learning (ML) models for production. Ensures the readiness of machine learning models for deployment...  ...experimentation, data collection and analyses, model building). – Tests and reviews code for bugs. MachineLearning Expertise:... 
    Suggested
    Temporary work
    Flexible hours
    Shift work

    Oracle

    Trenton, NJ
    3 days ago
  • $107.66k - $161.7k

     ...topics and providing a unique platform to learn and connect with others. Poe : a...  ...About the Team and Role: Our small engineering team works on challenging problems every...  ...product and our company. At Poe, we use Machine Learning in various parts of the product... 
    Suggested
    Remote job
    Full time
    Work experience placement
    Internship

    Quora

    Trenton, NJ
    3 days ago
  •  ...building community through regular in-person events. Learn more about our flexible approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with senior engineers and product leaders as part of your... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Trenton, NJ
    3 days ago
  •  ...Bloomberg's Buy-Side Automation Frameworks team seeks an eager engineer who is passionate about quality and scalable solutions for other...  ...across the department. Location: Princeton. You will architect testing foundations, apply AI to drive efficiency, and promote... 
    Senior

    Bloomberg

    Princeton, NJ
    1 day ago
  •  ...Veregy in Lawrenceville, NJ is seeking a Project Engineer III to lead energy conservation and facility improvement projects. You will identify and develop ECMs and FIMs, coordinate with operations, and ensure accurate scopes of work, energy savings, and M&V plans to support... 
    Senior

    VeregyLLC

    Lawrence, NJ
    10 hours ago
  •  ...including e-commerce, advertising, and fulfillment. We use machine learning and Internet-scale data to elevate customer experience,...  ...Discovery ML team at Instacart works alongside world-class engineers, data scientists, and product managers to shape the future of... 
    Remote job
    Permanent employment
    Work experience placement
    Internship
    Work at office
    Work from home
    Flexible hours

    Instacart

    Trenton, NJ
    1 day ago
  • $105k - $150k

     ...Company: Gelest Inc. Job Description: Gelest, Inc., part of the Mitsubishi Chemical Group, is hiring a Senior Quality Assurance Engineer to support our continued growth in specialty materials. Join a collaborative team where your expertise will help advance technologies... 
    Senior
    Temporary work
    Work experience placement
    Work at office
    3 days per week

    Mitsubishi Chemical Group

    Morrisville, PA
    5 days ago
  • $155k - $175k

     ...Employer: Johnson & Johnson Services, Inc. Job Title: Senior AI/ML Engineer Job Code: A011.10000 Job Location: Titusville, NJ...  ...operationalization and scaling; # Python or R along with associated machine learning packages TensorFlow, PyTorch, and Keras; # Setting up,... 
    Senior
    Full time
    Immediate start
    Remote work
    Shift work
    Day shift

    Johnson & Johnson Services, Inc.

    Titusville, NJ
    9 hours ago
  •  ...MissionHires is collaborating with a global biopharmaceutical organization to hire an AI/ML & Analytics Platform Engineer in a hybrid role based in Plainsboro Township, NJ. The role involves designing and optimizing AI/ML platforms, collaborating with cross-functional... 

    MissionHires

    Plainsboro, NJ
    1 day ago
  • $90k - $160k

     ...: 10 S&P Global Corporate The Role: Senior Data Scientist Location: Princeton, NJ...  ...solves diverse problems using applied machine learning and web development with an end-to-end...  ....g., OpenAI, Anthropic, Llama), prompt engineering, fine-tuning/customization, and embedding... 
    Senior
    Full time
    Second job
    Live in
    Worldwide
    Flexible hours
    2 days per week

    S&P Global

    Princeton, NJ
    20 hours ago
  •  ...NWL, Inc. is seeking a Senior HR Generalist to support a broad range of HR programs including employee relations, recruitment, onboarding, payroll, benefits, and compliance. You will serve as a trusted resource for employees and managers while ensuring adherence to policies... 
    Senior

    NWL

    Bordentown, NJ
    1 day ago
  • $106.8k - $194.8k

     ...help to build a better working world. WAF Operations Solution Engineer PRACTICE DESCRIPTION: As a WAF Operations Solution...  ...in a diverse and inclusive culture of globally connected teams. Learn  more . We offer a comprehensive compensation and benefits... 
    Senior
    Summer holiday
    Flexible hours

    EY

    Trenton, NJ
    4 days ago
  • $56k - $64k

    A leading travel management firm is seeking a Travel Consultant to provide exceptional service to government clients. You will advise on travel arrangements, utilizing your strong GDS expertise, particularly in Sabre. The ideal candidate will have over 5 years of consulting...
    Senior
    Flexible hours

    American Express Global Business Travel

    Ewing, NJ
    2 days ago
  •  ...GS1 US is seeking an Executive Assistant to provide high-level administrative support to the Senior Vice President. The role requires exceptional organization, discretion, and the ability to handle multiple priorities in a fast-paced environment. The position is based... 
    Senior

    GS1 US

    Ewing, NJ
    1 day ago
  •  ...Asplundh Electrical Testing in Trenton, New Jersey seeks an experienced individual to lead protective relay testing and calibration on medium- to high-voltage systems. The role requires 5+ years of hands-on experience, strong technical skills in relay technology, and the... 
    Senior

    Asplundh Electrical Testing

    Ewing, NJ
    3 days ago
  •  ...Veriff is seeking a Senior Technical Support Engineer for its USA region. In this role, you'll solve complex technical problems for major customers and mentor fellow engineers. Responsibilities include diagnosing issues, writing bug reports, and managing production incidents... 
    Senior
    Remote work

    Veriff

    Ewing, NJ
    1 day ago
  • $160k

     ...Job Description Senior Hospital Sales Executive A pathology laboratory is expanding its services and seeking experienced Senior Hospital Sales Executives for field-based roles across multiple U.S. regions. This opportunity is ideal for sales professionals with... 
    Senior
    Part time
    Immediate start

    Comet Medical Staffing

    Trenton, NJ
    1 day ago
  • $296.3k - $423.9k

     ...combines deep technical leadership in machine learning and robotics with people leadership and...  ...You will lead a high-performing team of engineers building ML-driven trajectory generation...  ...can set technical direction, mentor senior engineers, and lead large cross-functional... 
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Trenton, NJ
    1 day ago
  •  ...Senior Power Electronics Engineer Location: Syracuse, NY - Onsite Education: BS / MS in Electrical / Electronics with 8 years experience Responsibilities...  .../ inverters / contactors - High voltage / wattage test and integration - VFD integration, filters and VFD... 
    Senior

    Kasmo Global

    Princeton, NJ
    1 day ago
  • $186.07k - $218.9k

     ...process, and transform that data for analytics, machine learning, and powering end-user experiences. As an engineer on the team you will contribute to the full spectrum...  ...as the candidate. The above pilots are for testing purposes and Coinbase will not use AI to make... 
    Senior
    Local area

    Coinbase

    Trenton, NJ
    2 days ago
  •  ...Capital One is looking for a Senior Principal Relationship and Business Development Manager for its International Markets team. This remote-eligible role involves managing client relationships and driving business development strategies that increase transaction volume... 
    Senior
    Remote work

    Capital One

    Ewing, NJ
    3 days ago
  •  ...A leading insurance company is seeking a Senior Actuarial Analyst in Trenton, New Jersey. This role involves developing and supporting a pricing framework and leading projects while mentoring entry-level analysts. Candidates should have over 4 years in actuarial roles... 
    Senior
    Remote work

    Ally

    Ewing, NJ
    3 days ago
  •  ...New Jersey, offering professional services in non-destructive testing and evaluation (NDT/NDE) of highway infrastructure (bridges...  ...concrete materials testing laboratory. Job Description The “Senior Engineer” position will involve performing engineering tasks, in the... 
    Senior
    Full time
    Work at office
    Immediate start

    ADVANCED INFRASTRUCTURE DESIGN

    Robbinsville, NJ
    26 days ago
  • An automotive retailer in Hamilton Township is seeking an Experienced Finance Manager to build customer relationships and support sales staff. The role includes presenting finance products, maintaining relationships with lenders, and ensuring compliance with regulations...
    Senior

    Asbury Automotive

    Hamilton, NJ
    4 days ago
  • A leading data technology company seeks a Senior Product Manager to drive cloud networking initiatives. You will manage product development from conception to launch, ensuring user experience and cost efficiency. Responsibilities include conducting user research, defining... 
    Senior
    Remote work

    Confluent

    Ewing, NJ
    1 day ago
  • $95k - $105k

    Accounting Professional Salary: $95k-$105k plus bonus for a total comp of $110k - $121k Responsibilities Play a key role in the month end close process Complete account reconciliations and variance analysis Collaborate with internal teams on processes...
    Senior

    KNM Resources

    Trenton, NJ
    1 day ago
  • Position: Healthcare Regulatory Attorney Interview Mode: In Person Equipment: Computer/Laptop Software: Microsoft 365 Suite and Microsoft Dynamics Job Responsibilities Support the development of enforcement actions against licensed healthcare facilities and Certified Nurse...
    Senior

    CloudIngest

    Ewing, NJ
    4 days ago
  • $27 - $30 per hour

     ...Senior Warehouse Associate Sub-Zero Group, Inc. is looking for a Sr. Warehouse Associate for our Hamilton, NJ regional facility....  ...paternity leave This position requires a pre-employment drug test and background check, which will be administered after a conditional... 
    Senior

    Sub-Zero & Wolf Appliance

    Trenton, NJ
    4 days ago
  • FTTDC - Ohio Logistics is seeking an Operations Leader for our Newark-area warehouse. You will drive safety programs, coordinate drivers and staff to ensure on-time deliveries, and lead talent development on the floor in alignment with the General Manager’s people strategy...
    Senior

    FTTDC - Ohio Logistics

    Trenton, NJ
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Machine Learning Test Engineer. Be the first to apply!