AI & LLM Quality Engineering Coordinator
DASSAULT SYSTÈMES
Role Description & Responsibilities We are seeking a sharp, communicative, and technically grounded AI & LLM Quality Engineering Coordinator to lead and advance the testing of Large Language Model (LLM) features integrated into our 3DEXPERIENCE physics and simulation applications.In this role, you will bridge the gap between cutting-edge generative AI and complex engineering simulation software. You will coordinate cross-functional testing efforts, design automated evaluation frameworks, and ensure our AI-driven workflows meet the high standards of accuracy, reliability, and scientific rigor our engineering customers depend on.Key ResponsibilitiesCoordinate LLM Testing Initiatives: Plan, organize, and track end-to-end validation efforts across multiple physics simulation applications, ensuring alignment between AI developers, domain physics engineers, and QA teams.Advance Automated Evaluation: Design, build, and maintain automated test harnesses to evaluate LLM outputs—focusing on accuracy, hallucination detection, reasoning consistency, and adherence to physical and engineering constraints.Expand Test Coverage & Methodologies: Develop scalable testing methodologies, including synthetic dataset generation, regression benchmarks, and LLM-as-a-judge evaluation pipelines.Communicate Quality & Release Readiness: Translate complex model performance metrics, failure modes, and risk assessments into clear, actionable insights for R&D leadership and engineering stakeholders.Drive Continuous Improvement: Stay current with emerging LLM evaluation frameworks and industry best practices to continuously modernize our AI quality engineering processes.QualificationsEducation: Master’s degree in Artificial Intelligence, Computer Science, Data Science, Computational Linguistics, or an equivalent technical discipline.Deep LLM Expertise: Strong theoretical and practical understanding of Large Language Models, prompt engineering, Retrieval-Augmented Generation (RAG), agentic workflows, and common LLM failure modes.Test Automation Experience: Proven ability to write clean, maintainable code (e.g., Python) to automate software testing, build evaluation pipelines, and integrate automated checks into CI/CD workflows.Exceptional Communication Skills: Demonstrated ability to collaborate across diverse technical teams, clearly document test strategies, and present findings to both technical and non-technical stakeholders.Preferred QualificationsPrior hands-on experience in software quality engineering (QE/SDET), AI/ML model validation, or automated testing in a production R&D environment.Familiarity with modern LLM evaluation frameworks and tooling (e.g., DeepEval, RAGAS, LangSmith, PyTest, or custom benchmarking suites).Academic or professional background in mechanical engineering, physics, CAD/CAE, or scientific simulation software.
$103.71k - $138.28k
...Lumen is the trusted network for the AI‑powered world, connecting people, data,... ...join us today. The Role The Field Engineering Quality Control Engineer is responsible for overseeing... ..., budgets, risks, and deliverables. Coordinate project activities across logistics,...SuggestedFull timeTemporary workFor contractors$66k - $106k
...a versatile and forward-thinking QA Test Engineer to join our development team supporting the... ...you will be responsible for ensuring the quality reliability and performance of both our... ...identity. Use of artificial intelligence (AI) tools of any kind during Peraton...SuggestedPermanent employmentFull timeContract workTemporary workLocal areaShift work$95k - $110k
...you will do- Aspen is seeking a motivated and collaborative Quality Systems Engineer to drive and continuously improve the East Providence... ...requirements, and alignment with the Global Aspen QMS. Develop, coordinate, and continuously improve the East Providence audit...SuggestedFull time- ...future of mobility with us?Your Role Develop, apply and maintain quality requirements and standards for development and manufacturing... ...a customer liaison for customer complaints.Support concurrent engineering efforts by participating in design development projects...SuggestedFull timeWork at officeVisa sponsorshipRelocation package
- ...Job Description Job Description About this position as a Quality & Compliance Coordinator Under the direction of the Quality & Compliance Manager, the Quality & Compliance Coordinator coordinates the administrative workflow for the Patient Notification of Hospice...SuggestedDaily paidFull timePart timeWork at officeFlexible hours
- ...Automated Test Engineer Anywhere Type: Contract Category: Quality Assurance (QA) Industry: Technology Workplace Type: Remote Standard Hours: Open Reference ID: JN -112026-109434 Date Posted: 11/09/2026 Shortcut: Description: Remote Our client seeks an Automated Test...Hourly payContract workRemote work
$90.6k - $150.59k
...United StatesPosted: 2026-09-11This OpportunityWSP is currently initiating a search for a Bridge Inspection Team Leader, Structural Engineer to join our exceptional Bridge & Infrastructure Inspection Team in New England, which includes offices in Boston. MA; Worcester,...Work at officeLocal areaRelocation packageFlexible hoursNight shift- ...connecting the space, air, land, sea and cyber domains in the interest of national security. Job Title: Lead Integration & Test Engineer Job Code : 46948 Job Location: Providence RI Schedule: 9/80: Employees work 9 out of every 14 days- totaling 80 hours...Local area
$66.43k - $83.04k
...sites, and 3 R&D/technology sites, and employ more than 2,700 people across North America.General Purpose Of The Job:Supervise the quality process to ensure the production environment has what is needed to meet key business/manufacturing metrics which satisfy customer needs...Shift work- ...Description Job Description Construction Quality Control (QC) Manager Location: Newport... ...project’s major construction trades. Coordinate inspections, testing, and quality... ...Superintendent, QC Manager, Project Manager, Project Engineer, or Construction Manager on contracts of...Contract workFor contractorsFor subcontractor
- ...Description Job Description Construction Quality Control (QC) Manager Location: Cape... ...project’s major construction trades. Coordinate inspections and maintain accurate... ...Superintendent, QC Manager, Project Manager, Project Engineer, or Construction Manager. Experience...Contract workFor subcontractor
- ...position will be working closely with key customers, sales, and engineering to ensure revenue and customer satisfaction goals are met.... ...Department Assist Product Manager in Trade Show planning and coordination including walking Trade Shows as needed Ongoing...
- ...Consulting Services is seeking a Construction Quality Control Manager (QCM) for a federal... ...for each definable feature of work. Coordinate required inspections and testing. Verify... ...on projects for the U.S. Army Corps of Engineers (USACE) or Naval Facilities Engineering...Contract workFor contractorsFor subcontractor
$150k
...Description Job Description Construction Quality Control Manager, Federal Construction... ...project’s major construction trades. Coordinate inspections and maintain accurate QC... ...Superintendent, QC Manager, Project Manager, Project Engineer, or Construction Manager. At least...Daily paidContract workFor subcontractor- ...and maintain a technical understanding of the product lines to communicate quickly and effectively to customers and prospects Coordinate and conduct sales campaigns Train the local sales teams Coordinate timelines, resources, and communication for all stakeholders...Temporary workWork experience placementWork at officeLocal area
- ...technical support with escalation of more complex inquires to engineering or senior sales staff. Qualify inbound leads and route... ...Support external sales efforts by preparing documentation, coordinating product demos, and assisting with proposal packages. Maintain...Work at office
$34.13 - $42.69 per hour
...Job Description: Senior Production Test Engineering Technician Saab, Inc.'s Autonomous and Undersea Systems manufacturing team... ...production testing activities. Monitor and verify product quality in accordance with statistical process control and other quality...Temporary workFor contractorsWork experience placementCasual workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI & LLM Quality Engineering Coordinator. Be the first to apply!




