Senior QA Engineer ML/LLM End-to-End Testing & Eval
$160k - $300kSolstice
Solstice is seeking a dedicated QA lead to manage quality for AI-powered pharmaceutical marketing content. This senior engineering role demands expertise in building test infrastructure and conducting both automated and manual tests. You will work on developing evaluation systems, ensuring product reliability, and implementing CI/CD practices. Other responsibilities include designing tests for non-deterministic systems and running exploratory QA. Benefits include health insurance, equity opportunities, 401(k) with match, and competitive NYC compensation ranging from $160,000 to $300,000. #J-18808-Ljbffr Solstice
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Senior QA Engineer ML/LLM End-to-End Testing & Eval in New York, NY vacancy
- About the job Senior/Staff Front-End Engineer An early-stage open-source platform is building the feedback... ...more efficient large language model (LLM) applications turning real-world data... ...learning Experimentation: Built-in A/B testing, smart routing, and fallback...Senior
- ...Job Title: Full Stack Software Engineer (Front-End Focus) Location: New York City, NY (Hybrid or... ...cutting-edge technologies, including AI/ML, they aim to improve patient outcomes,... ...practices. Participate in code reviews, testing, and debugging to ensure quality and...SeniorFull timeFlexible hours
Next Ventures
New York, NY26 days ago $152.93k - $254.88k
...rubrics; automated eval harnesses in CI; and... ...methods (including LLM-as-a-judge) so... ...prototype. Design testing strategies for multi... ...relevant. Evaluate end-to-end agent behaviour... ...improvements with DS and AI Engineering. Champion... ...applications or AI/ML systems and quality...SuggestedLocal area$90k - $155k
...This is a foundational QA position, and the person... ...will be hands-on manual testing, workflow validation, and... ...and sign-off Document end-to-end business... ...technical direction to the QA Engineer on the team Contribute... ...Experience testing AI or ML outputs is a strong plus...SeniorTemporary workImmediate startRemote workFlexible hoursShift workNight shiftAlteva RCM
New York, NY15 days ago- UnitedHealth Group is seeking a Quality Assurance Analyst to lead end-to-end testing and elevate QA practices across the product area. You will plan, execute, and document tests while coordinating with Product, Engineering, and Operations to ensure high-quality releases. The...SeniorRemote job
- Wilson Elser is hiring a software QA/Automation Engineer in New York to design, implement, and maintain... ...across UI, API, and integration testing. The role emphasizes embedding quality... ...into CI/CD pipelines and ensuring robust end-to-end validation of user workflows. The...
- Rekluti, Comunidad de Inteligencia Artificial y Arquitectura Avanzada, busca científicos de datos y especialistas en ML para liderar el ciclo end-to-end de modelos predictivos y su despliegue en arquitecturas en la nube. Formar parte del pool implica dirigir frentes de...SeniorRemote job
- Senior Software Quality EngineerAs a Senior Software Quality Engineer at vCluster Labs, you aren't just writing test cases; you are the architect of how... ...test strategy end-to-end across a fast... ...: 7+ years in QA or software testing... ...for running AI, ML, and GPU-intensive...SeniorRemote workShift work
- CEI in Pittsburgh, PA is seeking a Senior Front-End Developer to lead development of enterprise web applications using React and Next.js. The... ....js skills, and expertise in TypeScript, API integration, testing, security, and mentoring others. Remote-friendly with on-site...SeniorRemote job
$160k - $300k
Senior QA Lead (AI Systems) About the Company We’re... ...This is a hands-on engineering role focused on building testing infrastructure, evaluation... ...for everything from LLM evaluations and... ...and Playwright Own end-to-end testing across... ...with AI, ML, or LLM-based systems...Visa sponsorshipRelocation package- ...guidance and subject matter expertise to engineers on testing and Quality Assurance (QA) methodologies and processes• Works... ...with Web Services testing and back-end service/API tools such as SoapUI ,... ...TechnologyExperience level: Mid-Senior LevelIndustry: Computer SoftwareSeniorWork experience placement
EROS Technologies
New York, NY2 days ago $136k - $175k
...client is seeking experienced software engineering professionals to develop enterprise-grade... ...is currently a need to hire a Front-End Senior Engineer to join their team. The organization... ...software development best practices, testing, and code reviews. Contribute to...SeniorHourly payCurrently hiringAtrium
New York, NY4 days ago- ...drive sustained customer loyalty. Stord's end-to-end commerce solutions combine best-in... ...We're standing up a net-new Software Engineer in Test (SET) function — not to take quality ownership... ...'re comfortable with rapidly evolving AI/ML technologies and tools. You stay current...SeniorContract work
STORD
New York, NY4 days ago - ...innovative developments in precision medicine, the full-time Senior Front-end Engineer will design and implement user interfaces for an at-home... ...application performance and ensure high-quality code through testing and debugging Required qualifications Proven experience...SeniorFull timeRemote work
$150k - $165k
...maintain responsive, high-performance front-end applications for the modernized Bruin... ...patterns, state management, build tooling, and testing strategy. Create and own a versioned... ...-functional teams. Use AI-assisted engineering tools to generate, refactor, and validate...SeniorFull timeMetTel
New York, NY11 days ago$184.96k - $246k
The Bank of New York Mellon seeks a Senior Vice President, Front-End Engineer for its New York, NY location.DUTIES: Consult with internal business groups... ...testable, efficient/ code. Analyze, design and develop tests and test-automation suites. Develop flowcharts, layouts...SeniorTemporary workRemote workFlexible hoursThe Bank of New York Mellon
New York, NY2 days ago$184.9k - $250.2k
...exploration to mission-critical pipelines. The Engine Front End team is responsible for the query... ...that customers depend on every day. As a senior engineer on the team you will own... ...services end to end: shape designs, build, test, ship through our release pipelines, and...SeniorInternshipFlexible hoursAmazon
New York, NY19 hours ago- ...clean architecture and complex data problems, the full-time Senior Back-End Engineer will architect, design, and maintain core services for CRM... ...performance tuning Solid background in designing, building, and testing scalable backend services Experience building and consuming...SeniorFull timeRemote work
- ...Employment Type: Contract Experience: 8+ Years About the Role We are looking for an experienced Senior QA Engineer (8+ years) to lead end-to-end regression testing across our enterprise MarTech ecosystem. In this role, you will own the validation of interconnected...SeniorFull timeContract work
Geysers International
New York, NY2 days ago - ...software, data infrastructure, and AI/ML with deep agricultural expertise and hands... ...from the ground up and looking for engineers who want meaningful ownership over product... ...The Role: We're looking for a QA Engineer who tests data as rigorously as features - and keeps...Senior
NIBBANA
New York, NY1 day ago - ...countries and employs 5,200 people. Role Overview The Front‑End Senior Engineer will play a key role in designing and implementing user‑facing... .... Ensure code quality through best practices, including testing and code reviews. Work closely with back‑end engineers to integrate...Senior
$130k - $160k
...About the role We're looking for a Senior QA Engineer to join a strong, collaborative QA team... ...We want someone who is exceptional at testing: sharp enough to learn a complex product... ...process tooling. Experience testing AI/ML systems, NLP outputs, transcription accuracy...SeniorFull timeWork at officeHealthie Inc
New York, NY1 day ago$136k - $175k
...Our client is a global organization seeking an experienced Senior Front-End Engineer (Java/Swing) to join its technology team. This individual will... ...and resolve front-end issues. Ensure code quality through testing, code reviews, and development best practices. Contribute...SeniorHourly pay- ...Senior QA Engineer Location - NYC Mode - Hybrid Key Responsibilities Lead end-to-end QA efforts across multiple projects and Agile teams Define and implement QA... ..., develop, and maintain scalable automated test frameworks Oversee functional, regression...Senior
Georgia IT Inc
New York, NY4 days ago - ...you find the best job for you. Role: Senior Back-End Developer Location: New York NY... ...build will have a combination of general engineering and distributed ledger/blockchain work... ...systems Conduct regular code reviews unit testing CI and maintain high code quality and...SeniorPermanent employmentContract workTemporary workRemote work
Tekfortune
New York, NY7 days ago $32 - $38 per hour
...has a client that is seeking a QA Engineer in New York, NY.... ...develop, and maintain automated test suites for AI platforms and services... ...functional, integration, and end-to-end testing frameworks* Collaborate... ...& Data* Generative AI* LLM Evaluation* Prompt Testing* Golden...KForce
New York, NY19 hours ago$80 - $90 per hour
...facing applications.The QA Tester will be... ...continuously improving testing strategies for... ...securely Validate LLM-driven features, including... ...to UAT testers, end users, and external... ...scientists, AI engineers, and product managers... ...Experience testing AI/ML and Generative AI...Contract workTemporary workShift workTEKsystems
New York, NY19 hours ago- ...We are looking for... talented engineers who possess infinite curiosity... ...product to perform experiments and test new ideas Build performant,... ...technologies Experience building ML and AI solutions Experience... ...creativity and energy to that end. Audacious Ambition: We dream big...SeniorShift work
$127k - $235k
...'re looking for a Senior Software Engineer - AI to join the CoCounsel... ...workflows, LLM orchestration, and... ...LLM-as-judge or eval-driven quality gates — serving real end users at scale. Technical... ...with AI/ML infrastructure including... ...opinions on testing, automation, and operational...SeniorFull timeWork at officeLocal areaWorldwideFlexible hoursThomson Reuters
New York, NY3 days ago$150k - $165k
...and enjoy a rewarding career. We are seeking a Senior Software Engineer – Front-End to join a new Bruin Platform Modernization team in NYC!... ...patterns, state management approach, build tooling, and testing strategy the modernized Bruin. Design System & Component...SeniorMetTel
New York, NY12 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior QA Engineer ML/LLM End-to-End Testing & Eval. Be the first to apply!
Related searches
- sdet qa automation engineer New York, NY
- senior quality assurance engineer New York, NY
- qa automation engineer New York, NY
- senior automation test engineer New York, NY
- qa automation engineer remote New York, NY
- junior software test automation engineer New York, NY
- software quality engineer New York, NY
- junior qa automation engineer New York, NY
- senior software test automation engineer New York, NY
- qa engineer New York, NY