Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI & LLM Quality Engineering Coordinator

DASSAULT SYSTÈMES

Role Description & Responsibilities We are seeking a sharp, communicative, and technically grounded AI & LLM Quality Engineering Coordinator to lead and advance the testing of Large Language Model (LLM) features integrated into our 3DEXPERIENCE physics and simulation applications.In this role, you will bridge the gap between cutting-edge generative AI and complex engineering simulation software. You will coordinate cross-functional testing efforts, design automated evaluation frameworks, and ensure our AI-driven workflows meet the high standards of accuracy, reliability, and scientific rigor our engineering customers depend on.Key ResponsibilitiesCoordinate LLM Testing Initiatives: Plan, organize, and track end-to-end validation efforts across multiple physics simulation applications, ensuring alignment between AI developers, domain physics engineers, and QA teams.Advance Automated Evaluation: Design, build, and maintain automated test harnesses to evaluate LLM outputs—focusing on accuracy, hallucination detection, reasoning consistency, and adherence to physical and engineering constraints.Expand Test Coverage & Methodologies: Develop scalable testing methodologies, including synthetic dataset generation, regression benchmarks, and LLM-as-a-judge evaluation pipelines.Communicate Quality & Release Readiness: Translate complex model performance metrics, failure modes, and risk assessments into clear, actionable insights for R&D leadership and engineering stakeholders.Drive Continuous Improvement: Stay current with emerging LLM evaluation frameworks and industry best practices to continuously modernize our AI quality engineering processes.QualificationsEducation: Master’s degree in Artificial Intelligence, Computer Science, Data Science, Computational Linguistics, or an equivalent technical discipline.Deep LLM Expertise: Strong theoretical and practical understanding of Large Language Models, prompt engineering, Retrieval-Augmented Generation (RAG), agentic workflows, and common LLM failure modes.Test Automation Experience: Proven ability to write clean, maintainable code (e.g., Python) to automate software testing, build evaluation pipelines, and integrate automated checks into CI/CD workflows.Exceptional Communication Skills: Demonstrated ability to collaborate across diverse technical teams, clearly document test strategies, and present findings to both technical and non-technical stakeholders.Preferred QualificationsPrior hands-on experience in software quality engineering (QE/SDET), AI/ML model validation, or automated testing in a production R&D environment.Familiarity with modern LLM evaluation frameworks and tooling (e.g., DeepEval, RAGAS, LangSmith, PyTest, or custom benchmarking suites).Academic or professional background in mechanical engineering, physics, CAD/CAE, or scientific simulation software.

Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the AI & LLM Quality Engineering Coordinator in Johnston, RI vacancy
  • $103.71k - $138.28k

     ...Lumen is the trusted network for the AI‑powered world, connecting people, data,...  ...join us today. The Role The Field Engineering Quality Control Engineer is responsible for overseeing...  ..., budgets, risks, and deliverables. Coordinate project activities across logistics,... 
    Suggested
    Full time
    Temporary work
    For contractors

    Lumen

    Providence, RI
    2 days ago
  • $66k - $106k

     ...a versatile and forward-thinking QA Test Engineer to join our development team supporting the...  ...you will be responsible for ensuring the quality reliability and performance of both our...  ...identity. Use of artificial intelligence (AI) tools of any kind during Peraton... 
    Suggested
    Permanent employment
    Full time
    Contract work
    Temporary work
    Local area
    Shift work

    Peraton

    Cranston, RI
    4 days ago
  • $95k - $110k

     ...you will do- Aspen is seeking a motivated and collaborative Quality Systems Engineer to drive and continuously improve the East Providence...  ...requirements, and alignment with the Global Aspen QMS. Develop, coordinate, and continuously improve the East Providence audit... 
    Suggested
    Full time

    Aspen Aerogels

    East Providence, RI
    3 days ago
  •  ...future of mobility with us?Your Role Develop, apply and maintain quality requirements and standards for development and manufacturing...  ...a customer liaison for customer complaints.Support concurrent engineering efforts by participating in design development projects... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Relocation package

    Control Tec

    Warwick, RI
    1 day ago
  •  ...Job Description Job Description About this position as a Quality & Compliance Coordinator Under the direction of the Quality & Compliance Manager, the Quality & Compliance Coordinator coordinates the administrative workflow for the Patient Notification of Hospice... 
    Suggested
    Daily paid
    Full time
    Part time
    Work at office
    Flexible hours

    HopeHealth

    Providence, RI
    6 days ago
  •  ...Automated Test Engineer Anywhere Type: Contract Category: Quality Assurance (QA) Industry: Technology Workplace Type: Remote Standard Hours: Open Reference ID: JN -112026-109434 Date Posted: 11/09/2026 Shortcut: Description: Remote Our client seeks an Automated Test... 
    Hourly pay
    Contract work
    Remote work

    Eliassen Group

    Providence, RI
    1 day ago
  • $90.6k - $150.59k

     ...United StatesPosted: 2026-09-11This OpportunityWSP is currently initiating a search for a Bridge Inspection Team Leader, Structural Engineer to join our exceptional Bridge & Infrastructure Inspection Team in New England, which includes offices in Boston. MA; Worcester,... 
    Work at office
    Local area
    Relocation package
    Flexible hours
    Night shift

    WSP Group

    Providence, RI
    4 days ago
  •  ...connecting the space, air, land, sea and cyber domains in the interest of national security. Job Title: Lead Integration & Test Engineer Job Code : 46948 Job Location: Providence RI Schedule: 9/80: Employees work 9 out of every 14 days- totaling 80 hours... 
    Local area

    Harris Corporation

    Providence, RI
    1 day ago
  • $66.43k - $83.04k

     ...sites, and 3 R&D/technology sites, and employ more than 2,700 people across North America.General Purpose Of The Job:Supervise the quality process to ensure the production environment has what is needed to meet key business/manufacturing metrics which satisfy customer needs... 
    Shift work

    Tremco

    East Greenwich, RI
    1 day ago
  •  ...Description Job Description Construction Quality Control (QC) Manager Location: Newport...  ...project’s major construction trades. Coordinate inspections, testing, and quality...  ...Superintendent, QC Manager, Project Manager, Project Engineer, or Construction Manager on contracts of... 
    Contract work
    For contractors
    For subcontractor

    Elite Recruiting & Consulting Services

    Providence, RI
    26 days ago
  •  ...Description Job Description Construction Quality Control (QC) Manager Location: Cape...  ...project’s major construction trades. Coordinate inspections and maintain accurate...  ...Superintendent, QC Manager, Project Manager, Project Engineer, or Construction Manager. Experience... 
    Contract work
    For subcontractor

    Elite Recruiting & Consulting Services

    Providence, RI
    26 days ago
  •  ...position will be working closely with key customers, sales, and engineering to ensure revenue and customer satisfaction goals are met....  ...Department Assist Product Manager in Trade Show planning and coordination including walking Trade Shows as needed Ongoing... 

    Igus Bearings Inc

    Rumford, RI
    26 days ago
  •  ...Consulting Services is seeking a Construction Quality Control Manager (QCM) for a federal...  ...for each definable feature of work. Coordinate required inspections and testing. Verify...  ...on projects for the U.S. Army Corps of Engineers (USACE) or Naval Facilities Engineering... 
    Contract work
    For contractors
    For subcontractor

    Elite Recruiting & Consulting Services

    Providence, RI
    9 days ago
  • $150k

     ...Description Job Description Construction Quality Control Manager, Federal Construction...  ...project’s major construction trades. Coordinate inspections and maintain accurate QC...  ...Superintendent, QC Manager, Project Manager, Project Engineer, or Construction Manager. At least... 
    Daily paid
    Contract work
    For subcontractor

    Elite Recruiting & Consulting Services

    Providence, RI
    11 days ago
  •  ...and maintain a technical understanding of the product lines to communicate quickly and effectively to customers and prospects Coordinate and conduct sales campaigns Train the local sales teams  Coordinate timelines, resources, and communication for all stakeholders... 
    Temporary work
    Work experience placement
    Work at office
    Local area

    Igus Bearings Inc

    Rumford, RI
    26 days ago
  •  ...technical support with escalation of more complex inquires to engineering or senior sales staff. Qualify inbound leads and route...  ...Support external sales efforts by preparing documentation, coordinating product demos, and assisting with proposal packages. Maintain... 
    Work at office

    AstroNova, Inc.

    West Warwick, RI
    26 days ago
  • $34.13 - $42.69 per hour

     ...Job Description: Senior Production Test Engineering Technician Saab, Inc.'s Autonomous and Undersea Systems manufacturing team...  ...production testing activities. Monitor and verify product quality in accordance with statistical process control and other quality... 
    Temporary work
    For contractors
    Work experience placement
    Casual work
    Local area

    SAAB

    Cranston, RI
    18 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI & LLM Quality Engineering Coordinator. Be the first to apply!