Senior AI Test Engineer — Build Scalable QA for LLM Apps
$190k - $250kTWG AI
TWG AI is seeking a Senior or Staff AI Software Engineer in Test to join our AI Engineering team in New York. This role focuses on building test automation frameworks for our cutting-edge AI products. You'll collaborate closely with AI engineers and data scientists to ensure high-quality software delivery.
Ideal candidates will possess expert-level Python skills, experience with test automation, and a Bachelor's degree in Computer Science or Engineering. A competitive compensation package, including a base salary of $190,000-$250,000 and comprehensive benefits, is offered.
#J-18808-LjbffrVacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Test Engineer — Build Scalable QA for LLM Apps in New York, NY vacancy
$229.9k - $262.4k
Senior Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview... ...to continuing to build world-class applied science... ...product experiences and scalable, high-performance AI infrastructure... .... Design, develop, test, deploy, and support AI...ApplicationSeniorFull timePart timeLocal areaCapital One Financial Corporation
New York, NY1 day ago- ...Wealth.com seeks a Software Engineer, AI to build the next generation of AI-powered applications. This is a builder role delivering production... ...AI, product, and engineering, turning ambiguous ideas into scalable, user-facing experiences. You will design systems for...ApplicationSenior
Wealth Inc.
New York, NY10 hours ago $229.9k - $262.4k
...Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital One, we are... ...committed to continuing to build world-class applied science... ...breakthrough product experiences and scalable, high-performance AI... ...One. Design, develop, test, deploy, and support AI software...ApplicationSeniorFull timePart timeLocal areaCapital One
New York, NY4 days ago- A leading tech firm in New York is seeking a Senior AI Engineer to join its Equities Technology AI group. This role entails managing the design... ...will have a strong background in Python, experience with LLM frameworks, and a PhD or Master's with substantial work experience...ApplicationSeniorWork experience placement
- Capgemini is seeking a GEN AI Developer to design, develop, and deploy end-to-end AI... ..., PyTorch, TensorFlow). You will build LLM-powered solutions, ML pipelines, and AI-... ...integrations, collaborating with product and engineering teams to translate strategic requirements...Application
- Bloomberg’s Engineering AI group is hiring a Senior Software Engineer to advance production machine learning systems and applications that power... ...and software engineers to design, implement, test, and maintain scalable, fault-tolerant code, and you will lead cross-team...ApplicationSenior
$229.9k - $262.4k
...Overview Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview:... ...committed to continuing to build world-class applied science... ...product experiences and scalable, high-performance AI infrastructure... ...One. Design, develop, test, deploy, and support AI...ApplicationSeniorFull timePart timeLocal areaCapital One
New York, NYmore than 2 months ago- ...EvolutionIQ in New York, NY, seeks an ambitious Software Engineer to leverage modern AI tools and enhance coding workflows. This role focuses on system architecture, quality assurance, and scalable application development. The ideal candidate will drive engineering...ApplicationSeniorRemote workFlexible hours
EvolutionIQ
New York, NY10 hours ago - ...the United States is seeking a Senior Software Engineer – AI to join the CoCounsel International team. You will build backend services that enable AI agents and scalable workflows for global legal professionals... ..., integrate with leading LLM providers, ensure reliability...Senior
Refinitiv
New York, NY10 hours ago - ...Tailorbird is building an agentic AI platform for institutional... ...workflows. Senior Software Engineer Tailorbird is... ...for reliable, scalable AI-native... ...developer experience (testing, observability,... ...management, LLM calls, and output... ...building modern web apps. ~ Good with...ApplicationSenior3 days per week
Tailorbird
New York, NY10 hours ago $139.2k - $208.8k
...Job Title : Senior Applied AI Engineer Team : Global... ...Engineer to architect, build, and... ...Vertex AI to deliver scalable, resilient , and... ...bug prediction, app confidence scoring... ...releases, flaky test detection, intelligent... ...techniques o hybrid LLM architectures ●...ApplicationSeniorLocal areaNew York, NYmore than 2 months ago- ...leveraging data and AI as core assets.... ...The Role Senior or Staff AI Software Engineer in Test to join our AI Engineering team building commercial-grade... ...testing AI agents and LLM-powered... ...actually touch: iOS apps, plugins, and Chrome... ...and build scalable, reusable test automation...ApplicationSeniorContract work
TWG AI
New York, NY10 hours ago - ...Talent Network for Founding AI Engineer Roles at VC-Backed Startups... ...who are: ✔ Passionate about building AI/ML models from the ground... ...learning models Building scalable data pipelines for preprocessing... ...pipelines, agent architectures, and LLM-powered systems Common...ApplicationSeniorFull time
Signal Fire Inc
New York, NY1 day ago $35 - $50 per hour
...to: Director of Engineering Company:... ...hire their first AI employee. Our AI... ...platform. We don't build tools — we... ...looking for a Senior Mason to help lead... ...integrations, LLM orchestration,... ...Write automated tests — unit tests for... ...for quality, scalability, and maintainability...ApplicationSeniorRemote jobFull timeFor contractorsInfinity
New York, NY1 day ago$175k
...SummaryAssured Guaranty is seeking a Senior AI Software Engineer to build production-grade AI applications... ...translating business workflows into scalable, governed software that integrates AI... ...experienceExperience building production LLM-based applications (prompting,...ApplicationSenior$100 per hour
...world’s fastest-growing AI startups. At... ...As our Applied AI Engineer , you'll design and ship... ...workflows and financial data, building the intelligence layer... ...experience with production LLM applications, RAG... ...has the most theoretical scalability - we use Postgres until...ApplicationSeniorFull timeImmediate startWeekend workDualentry
New York, NY1 day ago$198k - $247.5k
...enterprises.About Forward Deployed Engineering (FDE) at ClouderaCloudera’s... ...sits within the Applied AI organization, and is a... ...technical use cases, and ship scalable enterprise AI/ML solutions... ...AI Engineer you will:Build & Prototype AI Apps - Develop full-stack AI/ML...ApplicationSeniorFull timeRemote workWork from homeRelocation- ...Senior Software Engineer –Gen AI Platforms Job Req Id: 269616... ...security, modern app stacks, open-source... ...evaluation of LLM behaviours at scale... ...scale: You will build scaled, robust services... ...that are robust, scalable, and easy to use.... ...by constantly testing, learning, and...ApplicationSeniorFull timeWork at office
Citi
New York, NY10 hours ago $230k - $350k
...States Permanent Senior Generative AI EngineerNew York, NY... ...Series A AI startup building the AI operating... ...As they scale their engineering team, they are looking... ...You will work across LLM applications, agent architectures... ...frameworks, and scalable backend services.This...ApplicationSeniorPermanent employmentWork at office3 days per week- ...leveraging data and AI as core assets.... ...looking for a Senior Software Engineer with with deep experience... ...Design, build, and maintain AI... ...models Architect scalable systems and... ...Drive code quality, testing, and engineering... ...logic, and modern LLM frameworks (e.g.,...ApplicationSeniorFull timeRemote workRelocation
Twg Global Ai
New York, NY1 day ago - Ramp is looking for an iOS Engineering Leader in New York. You will design, build, and launch new products on Ramp’s iOS App while driving our core product engineering roadmap. This position requires strong leadership in managing teams and projects from inception to scaling...ApplicationSenior
$120k - $165k
...innovation to build the connections... ...is a Software Engineering position at the... ...Analytics teams, Senior management, and... ...of Python-based AI applications... ...and implement scalable solutions for risk... ...production-grade AI or LLM-based... ...Practitioner of unit testing, integration...ApplicationSeniorTemporary work$195k - $225k
...are pioneering a new AI development team... ...deeply technical AI Engineer to be a foundational... ...execution.As a Senior AI Engineer, you will design and build agentic systems that... ...workflows into automated, scalable solutions. You will... ...building LLM-powered applications...ApplicationSeniorFull time- As a Senior AI Engineer at Intapp, you’ll work on an AI-powered... ...processes by combining LLM reasoning, structured... ...frameworks to support scalable, maintainable agent systems... ...architecture, testing, and documentation. This role focuses on building production AI agents and...ApplicationSeniorFull timeWork at officeLocal areaFlexible hours
$123k - $215.25k
...benefitsJob Function: Engineering &... ...technology teams and build a unique career... ...American Express, AI is reshaping... ...scale.THE ROLEAs a Senior AI Engineer -... ...responsible, scalable AI solutions.TECHNICAL... ..., testing, debugging, and... ...practices for LLM and agentic systems...ApplicationSeniorWorldwideVisa sponsorship$182k - $242k
...Essential Cloud for AI. Built for pioneers... ...innovators to build and scale AI with confidence... ...a Software and AI Engineer, IT Systems, you’ll... ...frameworksDevelop scalable backend services in... ...development, testing, and documentationEnsure... ...Node.js and Go.AI/LLM Experience: Solid...ApplicationSeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$185k - $200k
...Danaher, you can build an incredible career... ...possible. The Senior Legal Engineer is responsible for... ...building, and deploying AI-powered solutions... ...pipelines. Build scalable ingestion, parsing... ...Write clean, well-tested code (Python and/... ...applications using LLM APIs,...ApplicationSeniorFull timeContract workRemote workWork from homeFlexible hours$137.4k - $161.7k
Are you ready to make an impact?Senior AI Software Engineer - Technology & Experience (TechEx) West... ...hands-on engineering role focused on building scalable, production-grade software applications... ...copilots, workflow automation, and LLM-powered experiences Develop...ApplicationSeniorLocal areaImmediate startFlexible hours$150k - $160k
...technology platforms, the build of a Publishing... ...of AI capabilities across... ...role.THE ROLEAs a Senior AI Engineer (Full-Stack / Applications... ...capabilities into robust, scalable, and high-quality... ..., user-facing apps.Backend: Deep... ...and security.Solid testing discipline across...ApplicationSeniorFull timeContract workTemporary workWork at officeLocal areaRemote work$124k - $177k
...UnitTechnology, Data, AI and Ventures (TDAV)Business... ...Life's businesses. We build solutions that power... ...AI Application Security Engineer, you will help ensure these... ...a passion for building scalable security capabilities... ..., OWASP Top 10 for LLM Applications, NIST AI RMF...ApplicationSeniorLocal area3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Test Engineer — Build Scalable QA for LLM Apps. Be the first to apply!
Related searches
- ai ml engineer New York, NY
- machine learning ai engineer New York, NY
- ai developer New York, NY
- ai engineer New York, NY
- ai research engineer New York, NY
- ai prompt engineer New York, NY
- senior ai engineer New York, NY
- ai engineer remote New York, NY
- api test engineer New York, NY
- lead performance test engineer New York, NY