AI QA Engineer: AI Testing & Quality Frameworks
State Street Corporation
State Street's Charles River Development/State Street Alpha is seeking a Quality Assurance Engineer focused on AI testing to design scalable QA frameworks and validate AI-driven product behavior within CRIMS/Alpha. You will work in a scrum team with product, software engineers, and architects to ensure AI-enabled capabilities are testable, reliable, and aligned with client needs. The role emphasizes testing AI guardrails, model-driven outputs, and integration across CI/CD pipelines, with #J-18808-Ljbffr State Street Corporation
$80k - $140k
Quality Assurance Engineer - AI Testing, Charles River Development/State Street AlphaWhy this role is important... ...design and implement scalable test frameworks, validate AI-driven product behavior... ...This role is ideal for a mid-level QA professional who combines strong software...QualityFull timeTemporary workFlexible hours$150k - $180k
...looking for a Senior AI Engineer to design and build production... ...a strong focus on quality, safety, and real-... ...and Agent evaluation frameworks and automated regression... ...Engineering,Product, QA, and other teams to deliver... ..., rate limiting, testing, logging, and cross-service...Quality$180k - $200k
...organization is seeking an AI Engineer to help design, build, and scale... ...and evaluation frameworks, and ensuring performance, scalability... ...using established metrics and quality frameworks Familiarity with... ...creating AI evaluation, testing, or monitoring frameworks Background...QualityFull timeFlexible hours3 days per week$137.35k - $206.09k
...interfaces and the supporting engineering (authentication,... ...meet relevant safety, quality, and compliance... ...including AZ’s sovereign AI compute platform built... ...code, version control, testing, and the judgment to build... ...with LLMs and agent frameworks, including tool and...QualityFull timeTemporary workWork at officeRemote work$115.2k - $172.8k
...difficult yield, device performance, quality, and reliability issues. Onto... ...-based and system level testing across projects and platforms... ..., collaborating with systems engineers, software developers, and... ...applicationsExperience developing automation frameworks or automated tests and...QualityPermanent employmentFull time$145.9k - $234.2k
...RoleModerna is seeking a Senior AI Engineer in Cambridge, MA/ Warsaw,... ...standards across development, test, validation, and production environments... ...services for Supply Chain, Quality, Manufacturing, Finance, and... .../JavaScript and a modern framework such as React, Angular, Vue,...QualityPermanent employmentFull timeWork at officeWork from home$230k - $280k
...000 yearlyTeam: Data & AI / Artificial IntelligenceCompany... ...SummaryThe Staff AI Engineer will serve as a senior... ..., IT, security, quality, and business teams, and... ...management, evaluation frameworks, secrets handling, deployment... ...harnesses that test factuality, retrieval quality...QualityFull timeRemote work$133.9k - $223.9k
We are the global test and automation specialists, powering next... ...OverviewAs a Senior ML / AI Engineer at Teradyne, you will design,... ...pipelines that increase speed, quality, and reliability of AI solution... ...patterns, and reusable frameworks the team needs to build and operate...QualityRemote workFlexible hours$90.2k - $112.8k
...will experience these qualities of passion, pride and... ...Automation and AI-Driven Quality Engineer to design, implement,... ...strong ownership across test automation, performance... ..., modular automation frameworks for API, backend, and... ...dashboards for engineering, QA, and leadership...QualityFull timeShift work$126.1k - $201.8k
We are the global test and automation specialists, powering... ....Opportunity OverviewThe QA/Validation Lead Engineer for AI Initiatives is responsible... ...validation, testing, and quality assurance of all AI/ML systems... ...pipelines, and governance frameworks are validated and...QualityFlexible hoursShift work- ...Materials, Inc. is seeking a Senior Software QA Engineer III in Billerica, MA to lead test automation efforts and ensure product quality across complex software. The role... ...extensive experience with test automation frameworks, Gherkin scenarios, and Python, with a strong...Quality
- ...leader in both basic and applied AI/ML, our group is shaping... ...possess a PhD in electrical engineering, computer science or other relevant... ...refinement. Agentic-AI framework experience - hands-on work with... ...reviews), continuous-integration testing, environment reproducibility...
$140k - $160k
...$160k Job Description Senior Robotics AI Software Engineer Physical AI • Machine Learning Systems... ...boundaries Experience with CI/CD, automated testing, code reviews, and modern software... ...Lite, or similar ML deployment frameworks Experience with computer vision systems...Full timeFlexible hours$170k - $220k
...capabilities. As a Lead Software I&T Engineer you will integrate, test, and verify C++ software... ...lessons learned, establish reusable frameworks and processes, and lay the groundwork... ...automated testing frameworks, and code quality tools in software development processes...QualityFull timeLocal areaNight shift$85.67k - $159.11k
...mobility.Job Responsibilities: As a Senior Quality Assurance Engineer at Magna New Mobility, you will play a key role in setting up the testing strategy and tools for testing cloud... ...experience with automated testing frameworks, tools and servicesExperience in at least...QualityFull timeLocal area$161.7k - $258.8k
We are the global test and automation specialists, powering next-... ...Opportunity OverviewTeradyne’s AI Ops team is building knowledge... ...infrastructure that helps engineering teams use AI agents and developer... ...freshness, failures, retrieval quality, latency, and relevant cost....QualityFlexible hours- ...most difficult yield, device performance, quality, and reliability issues. Onto... ...efficient.Job Summary & ResponsibilitiesLead AI Engineer — Semiconductor AI InnovationDriving AI... ...Language Models - RAG, fine-tuning, agent frameworks, prompt optimization.Predictive...QualityPermanent employmentFull timeWork at officeWorldwide
$127k - $220k
Waltham, MAHybridFull Time$127k - $220k Job Description AI Solutions Engineer Location: Waltham, MAWork Schedule: Hybrid, 3 Days Onsite... ...agent-based workflows Familiarity with AI evaluation, testing, and quality measurement techniques Knowledge of observability and production...QualityFull timeFlexible hours3 days per week$115k - $137k
...Senior Full Stack Software Engineer to join our engineering... ...architecture through testing and validation.... ...emphasis on integrating AI capabilities to solve customer problems.Own quality across the development... ...experience in modern web frameworks (React or Angular), and...QualityWork experience placement- ...services. We’re a nonprofit engineering, applied research, and... ...delivering the highest quality software solutions?We'... ...of-the-art agentic and AI-enabled software... ...includeDesign, develop, test, and deploy mission software... ...calling, orchestration frameworks) in production,...QualityInternshipLocal areaImmediate start3 days per week
$90.2k - $112.8k
...will experience these qualities of passion, pride and aspiration... ...alongside experienced engineers to enhance existing... ...and maintain unit tests and integration tests to... ...emerging technologies, frameworks, and development tools... ...workflows. Knowledge of AI-assisted development tools...QualityFull timeInternship$144k - $198k
...combines analog, digital, AI, and software... ...Robotic System Application Engineer to turn frontier technologies... ...run models, prepare test scenarios, and assess robot... ...systems, verify data quality, and explain their... ...as ROS 2 or comparable frameworks.Working knowledge of sensor...QualityPermanent employmentFull timeWork at officeDay shift- ...process. Establish new tests, best practices, and capabilities for the QA function to bring organization... ...Model and TestNG test framework Partner with other engineering disciplines to develop automated... ...bug fixes Analyze quality key performance indicators...QualityImmediate start
$129k - $172.5k
...teams that span robotics, AI, Machine Learning,... ...pharmaceuticals are made, tested, and released for... ...business.The Staff Software Engineer reports to the Development... ..., and deploying high-quality software. As the... ...database designEntity Framework or equivalent ORM technologiesAuthentication...QualityFull timeCasual workWork at office3 days per week- ...is seeking a Software Engineer (Mid-level) with good experience... ..., build, deployment, testing, and support.... ...application development, testing frameworks, and understanding and... ...develop a robust, high-quality software system that... .... Experience using AI code assist tools as...QualityWork at officeLocal areaRemote work
$100 per hour
...Job Title: Cloud Test Automation Engineer (Software Test Engineer) Job Description... ...deliver production-ready quality. Responsibilities Own... ...Experience with Hydra (AWS testing framework) or comparable cloud test... ...of Artificial Intelligence (AI): We may use Artificial...QualityContract workTemporary work- ...We're a nonprofit engineering, applied research,... ...and applying modern AI/ML tools -... ...applications using modern frameworks such as React,... ...Writing clean, well-tested code in Python, Java... ...improve software quality. Collaborating... ...through structured QA, automated test...QualityFull timeInternshipLocal area3 days per week
- ...Join to apply for the Software Test Engineer role at Mettler-Toledo International, Inc... ...on time and adhering to development and quality standards. Understanding and implementing... ...insights directly into each article, started with the help of AI. #J-18808-LjbffrQualityFull timeTemporary workWork experience placementInternshipWorldwideFlexible hours
$145.9k - $234.2k
...adversarial simulation campaigns to test Moderna’s cyber resilience... ...environments with a focus on AI and the attack surface it... ...Intelligence, and Detection Engineering to convert findings into durable... ...for covert operations (C2 frameworks, payload obfuscation, cloud-based...Permanent employmentFull timeWork at officeRemote workWork from home- ...JobBerkshire Grey is a leader in AI-enabled robotics,... ....As a Software Engineer on Berkshire Grey’s Scoop... ...will design, implement, test, deploy, monitor, and maintain... ...identify reliability, quality, and throughput... ...Python Asyncio or similar frameworks.Experience with messaging...Quality
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI QA Engineer: AI Testing & Quality Frameworks. Be the first to apply!
- quality tech Burlington, MA
- quality inspection Burlington, MA
- quality lead Burlington, MA
- air quality Burlington, MA
- quality Burlington, MA
- water quality Burlington, MA
- quality improvement nurse Burlington, MA
- vice president of quality Burlington, MA
- quality manufacturing Burlington, MA
- rn quality Burlington, MA



