Senior QA Engineer - AI Eval & Quality Infra
Third Way Health, Inc.
A healthcare innovative company is seeking a Senior QA / Eval Engineer to enhance evaluation infrastructures for their AI-powered patient engagement platform. The role involves extending the evaluation pipeline, driving improvements to metrics, and ensuring quality in interactions. Ideal candidates will possess 5+ years in software engineering, proficiency in Python, and a strong understanding of quality systems in AI, particularly in a healthcare setting. Communication skills and a passion for healthcare innovation are essential. #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior QA Engineer - AI Eval & Quality Infra in Cambridge, MA vacancy
- ...backgrounds to have a better healthcare experience. About the position We're seeking a Senior QA / Eval Engineer to own and evolve the quality and evaluation infrastructure behind our AI-powered patient engagement platform. Our eval system is multi-factorial (...QualitySeniorLive inShift work
Third Way Health
Cambridge, MA2 days ago - ...I.T. is partnering with Via to find a Senior Quality Assurance Engineer. See details below: About the Role: VIA... ...is not a traditional ‘downstream’ QA role, you will be responsible for building... ...as a force multiplier by leveraging AI-driven automation to replace manual processes...QualitySenior
Dormont Manufacturing Company
Somerville, MA4 days ago $107k - $125k
...Senior QA Engineer The Senior QA Engineer is an integral member of an Engineering squad, analyzing and testing a high quality Vestmark product suite. The Senior QA Engineer will be responsible... ...notes for new versions Leverage AI tools (e.g., Claude, Glean) to accelerate...QualitySeniorWork experience placementVisa sponsorshipWork visaVenturefizz Product Management Community
Wakefield, MA3 days ago$178.13k - $198.63k
...team members to contribute to releasing quality software. Execute and monitor results and... ...Explore novel approaches to testing RHEL AI software, focusing on all aspects ranging... ...project stakeholders, such as other Red Hat AI Engineering teams, product managers and management....QualitySeniorContract workWork experience placementWork at officeImmediate startRemote workFlexible hoursDormont Manufacturing Company
Boston, MA4 days ago$146k - $194k
...of systems is powered by Lattice OS, an AI‑powered operating system that turns thousands... ...a skilled and detail‑oriented Software QA Engineer to join our team. The ideal candidate... ...software defects, and ensuring the overall quality of our products. WHAT YOU'LL DO Develop and...QualitySeniorFull timeWork experience placementSlope
Lexington, MA4 days ago$146k - $194k
...of systems is powered by Lattice OS, an AI-powered operating system that turns thousands... ...a skilled and detail-oriented Software QA Engineer to join our team. The ideal candidate... ...software defects, and ensuring the overall quality of our products. WHAT YOU'LL DO Develop...QualitySeniorFull timeWork experience placementImmediate start- ...Software Testing Engineer Test Case Development: Design, develop, and execute comprehensive test cases and test plans to validate software... ...teams, including software developers, hardware engineers, and quality assurance professionals, to ensure cohesive and efficient...QualitySenior
RIT Solutions
Boston, MA1 day ago $100k - $135k
...continue to grow. Job Description The Opportunity: We, at Flywire, are looking for an experienced Sr. QA Engineer I ideally with a background in FinTech The Quality Assurance team at Flywire is a group of engineers dedicated to improving the productivity of...QualitySeniorFull timeTemporary workImmediate startFlywire
Boston, MA2 days ago$99k - $163.4k
...Join CD PROJEKT RED and help shape the future of QA Engineering across our projects and Shared Development Services initiatives. We're looking for a Senior QA Engineer to help build and scale technical quality solutions, automation frameworks and testing infrastructure...QualitySeniorCasual workWork at officeHome officeFlexible hoursCD Projekt RED
Boston, MA1 day ago$121.4k - $218.6k
...team! Our Networks Software Quality Assurance (SQA) team ensures our... ...and collaborate with Networks Engineering teams to validate network... ...their implementation. As a Senior Software Development Engineer... ...moments without a glitch. AI : Enabling our customers to build...QualitySeniorWork experience placementWork at officeWorldwideAkamai
Boston, MA2 days ago$135.2k - $306.4k
...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical... ...practices for tracing, monitoring, eval suites, regression testing, experimentation... ...and ability to contribute high-quality production code, reviews, tests,...QualitySeniorTemporary workFlexible hoursOracle
Boston, MA3 days ago- ...Job Title: QA Engineer - ETL & HL7 (Data Pipeline QA) Location: Remote - India (UK Working... ...custom development, cloud data platforms, AI/ML integrations, and data analytics. With... ...testing , ensuring data accuracy, quality, and integrity as it moves across systems...QualityFull timeRemote work
Saviance
Boston, MA1 day ago - ...About Yuma AI: Yuma is building a next-generation orchestration... ...joining Yuma as one of the core engineers on a tight, high-performing... ...and care deeply about product quality and user value. Over the past... ...predictably Build and own A/B tests, eval pipelines, and agentic...QualitySeniorImmediate start
Yuma AI
Boston, MA4 days ago - ...QA Automation Engineer At Liaison, we've helped higher education institutions build better, more... ...automated test scripts that ensure the quality, reliability, and performance of our applications... ...and automation. ~ Familiarity using AI tools as part of the automation process...Quality
Venturefizz Product Management Community
Watertown, MA2 days ago $146.4k - $263.6k
Senior II Software Development Engineer in Test (SDET) Are you passionate about system performance, reliability,... ...improve the platform running Akamai's AI and Compute platform excite you?... ...Providing technical leadership, setting quality standards, and mentoring junior...QualitySeniorWork experience placement$50 - $60 per hour
...DataAnnotation is committed to creating high-quality AI. Enjoy the flexibility of remote work and the freedom to set your own schedule. This is an opportunity to work with us as an independent contractor. We're currently expanding into an exciting new area – teaching...QualitySeniorHourly payContract workFor contractorsWork experience placementRemote workData Annotation
Boston, MAmore than 2 months ago- ...A leading AI company is seeking a Senior Equity Analyst to work remotely and evaluate AI models in finance. The role requires expert-level financial... ...own schedule, with hourly payments starting at $50–$60 and potential bonuses for high-quality work. #J-18808-Ljbffr...QualitySeniorHourly payRemote work
DataAnnotation
Boston, MA1 day ago - ...Project Management Office team, within our expansive Technology department, is looking to bring on an experienced QA engineer to help us release high-quality software in a timely manner. A typical day would have you working closely with other Development, offshore team...QualitySenior
CERES Group
Waltham, MA1 day ago $155k - $235k
...Databricks, to the semantic and AI layers that sit on top.... ...data work for everyone — engineers, analysts, and business users... ...Role We’re looking for a Senior AI Data Engineer to lead the... ...outputs, including building eval harnesses, defining quality metrics, and catching...QualitySeniorLocal areaHome officeFlexible hoursScribd
Boston, MA3 days ago- ...Analytical Software QA Engineer Location: Remote (CST Hours) - Houston, TX Duration: Full... ...to data analytics and machine learning/AI integrations. As a one-stop shop, we attract... ...the Role The Analytical Software Quality Assurance Engineer will be responsible for...QualityFull timeRemote workShift work
Saviance
Boston, MA1 day ago - ...ensuring that user needs and business strategies translate into high-quality, scalable designs. You'll lead teams, mentor junior designers,... ...7 years of experience in product design and a strong grasp of AI integration within design processes. The position offers a...QualitySenior
$90k - $105k
...Senior Life Sciences Knowledge Engineer Company: Norstella Location: Remote, United States... ...life sciences data and AI solutions provider... ...centers on curating high-quality fine-tuned datasets which... ...matter expert graders running eval rounds, including translating...QualitySeniorFull timeTemporary workWork at officeLocal areaRemote workFlexible hoursNorstella
Boston, MA2 days ago- Bristol Myers Squibb is seeking a Senior Manager, Principal Business Analyst for the LIMS/ELN Product Team in Cambridge... ...evolve ELN/LIMS and related data platforms, enabling AI-powered workflows and enhanced data quality. The role requires deep lab informatics knowledge,...QualitySenior
$148k - $222k
Senior Software Engineer - Customer Agent Engineering Boston, MA In this role, you... ...how autonomous service, AI-driven support, and agentic... ...mentor, driving engineering quality, execution, and decision-making... ...retrieval systems, embeddings, eval frameworks, or LLM...QualitySenior- ...is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems to train... ...field and strong writing skills. Competitive pay is offered, with hourly rates up to $60 and bonuses for quality work. #J-18808-Ljbffr...QualitySeniorHourly payRemote workFlexible hours
DataAnnotation
Boston, MA1 day ago - LILT AI in Boston seeks a Senior AI Researcher / Machine Learning Engineer specializing in Automatic Speech Recognition (ASR). You will architect and scale multilingual ASR models and develop quality benchmarks for conversational AI. The ideal candidate should have a Master...QualitySenior
$120k - $170k
Tempus AI in Boston is looking for a skilled data modeler to help integrate clinical data from various systems into a unified model... ...collaborate with clinicians and data scientists to ensure data quality and transform source data. Ideal candidates will possess domain...QualitySenior- Expert Technology Services is seeking a Senior Java Developer to join our Ai Lab team in Boston, Massachusetts. This role is perfect for a seasoned engineer eager to influence technical... ...design, develop, and maintain high-quality applications, mentor junior developers...QualitySenior
- Nextinsurance66 is seeking a Global Senior Manager of Learning & Development to drive the design... ...focused on technical skills and AI enablement. You will collaborate with stakeholders... ...with business priorities, ensuring high-quality training across multiple locations. The...QualitySenior
$120k - $189k
...Boston is looking for an experienced candidate to act as a senior reference point, delivering high-quality analytical execution and engaging with stakeholders to shape strategic decisions. The role involves using AI to enhance analytical workflows and requires strong...QualitySeniorWork experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior QA Engineer - AI Eval & Quality Infra. Be the first to apply!
Related searches
- senior robotics software engineer Cambridge, MA
- senior research manager Cambridge, MA
- senior director clinical development Cambridge, MA
- senior technical designer Cambridge, MA
- senior consulting engineer Cambridge, MA
- senior staff systems engineer Cambridge, MA
- senior dynamics crm developer Cambridge, MA
- senior application security Cambridge, MA
- senior inventory accountant Cambridge, MA
- senior accountant part time Cambridge, MA