AI QA Tester for GenAI & LLM Systems (Remote)
SmallArc Inc
SmallArc Inc. is seeking an AI Tester to join a Medicaid modernization initiative focused on AI/GenAI capabilities, conversational AI, RAG, and guardrails.
You will develop test plans, validate AI outputs against requirements, and track readiness metrics, working remotely with occasional travel to Albany, NY. Strong QA/testing experience in AI domains and familiarity with Jira are preferred.
#J-18808-LjbffrVacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the AI QA Tester for GenAI & LLM Systems (Remote) in Washington DC vacancy
- ...Cloud and Things is seeking an AI Tester to support a NYS Medicaid MECM modernization program in Albany. The role involves testing AI and... ...RAG, to ensure alignment with requirements and safeguards. Remote options are available and the position is an exempt, 12-month engagement...Remote workHourly pay
Cloud & Things Inc
Albany, NY7 hours ago - ...a Forward Deployed Engineer - AI to transform complex client challenges... ...engineering, data science, GenAI, and agentic AI across... ...integrating AI with enterprise systems, and ensuring reliability and... ...practices. This role supports remote work from anywhere in the US....Remote work
International Business Machines Corporation
Detroit, MI1 day ago - ...Pavago is seeking an AI Operations Specialist to own and improve production AI conversation systems for our telehealth SMS lead recovery platform. You will onboard clients... ...This is a hands-on role requiring you to run LLM systems, test changes, and document improvements...Remote work
Pavago
New York, NY2 days ago - Satalia, fully remote in Greece, seeks a Data Scientist to design and deploy ML/AI models in production, including LLM-powered systems. The role emphasizes end-to-end ownership—from data handling to evaluation—collaborating with engineers and stakeholders across the organisation...Remote job
$28 per hour
...scalable to supercharge their AI models. As a Welocalize... ...languages to remote field audio collection.... ...models for search, ads, and LLM output. Want to join... ...Slovenian Localization QA Testers / Proofreaders for a project... ...internal bug‑tracking system as well as verify the...Remote workHourly payPrice workContract workMonday to Friday- Principal/Staff Data Scientist, GenAI/LLM EvaluationOur direct client, a prestigious global... ...technology organization. They are standing up AI evaluation as a first-class function and... ...decide how to measure non-deterministic systems. You will find where they fail, including...Long term contractFull timeImmediate startWork from home
Benchmark IT
Upper Saddle River, NJ3 days ago $272k - $431.25k
...framework for serving generative AI and reasoning models across... ...accelerators feel like a single system at datacenter scale. As large language... ...deployment of cutting-edge LLM workloads.We are seeking a... ...accessible memory, SSD tiers, and remote file/object/cloud storage to support...Remote workFull timeLocal areaNvidia
Santa Clara, CA3 days ago$124.8k
...applications and next steps. Our partner is looking for a Senior AI Engineer – Agentic Systems and LLM based in the United States. We are looking for an... ...Models (LLMs) and agentic systems. In this fully remote role, you will take ownership of the entire development...Remote workHourly payFull time- ...Department of Labor in Albany is seeking a Senior Tester to perform comprehensive testing of enterprise web applications and distributed systems. The role focuses on functional,... ...across multiple layers, including REST APIs and AI-enabled components. The position requires...
Saathi Digital
Albany, NY3 days ago - ...Accord Technologies Inc. in Columbia, SC (remote) seeks a Mainframe Quality Assurance Tester to support Medicaid system changes. You will design and execute test scenarios, analyze results, and coordinate UA testing with users and external partners, ensuring alignment...Remote work
Accord Technologies Inc
United States5 days ago - ...Scientist to join an enterprise GenAI programme focused on building... ...ready solutions using LLMs, RAG, AI Agents and modern Generative AI... .... Location: Poland - 100% Remote Contract: B2B Language: English... ...design, with a strong focus on RAG, LLM applications and AI agents. Key...Remote workContract work
Senovo IT
New York, NY3 days ago $100k - $140k
...Peregrine Advisors is a rapidly growing AI and data innovation hub helping government... ...where the hardest problems are. This is a remote position. The initial engagement requires... ...notifications. You help prove that the system works for its users from submission to decision...Remote workFull timeTemporary work- ...skilled Quality Assurance Tester who is native in the... ...years of experience in QA or Linguistic Testing, along... ....com Location: Remote Employment Type: Part... ...Centific is a frontier AI data foundry that curates... ...innovation™ solutions for GenAI can reduce GenAI costs by...Remote workPart time
Centific
United States7 hours ago $50k - $70k
# **Junior Software QA Tester****Location:** Remote, based within approximately 1.5 hours of Mooresville,... ...applications integrate closely with our clients systems, so you'll need to be comfortable... ...is reviewed by a real person, not an AI. We value your time and take each...Remote workFull timeNew Charter, LLC
Mooresville, NC4 days ago$15 per hour
...USD $15 per hour, paid weekly Location: Remote - United States Schedule: Flexible, no... ...independent contractor Outlier is an AI training platform owned and operated by... ...your expertise helps shape how advanced AI systems reason, learn, and improve. Through Outlier...Remote workHourly payWeekly payContract workFor contractorsWork experience placementFreelanceInternshipFlexible hoursNight shiftOutlier
United States5 days ago- ...Consulting seeks a Forward Deployed Engineer – AI to work directly with clients,... .... You will prototype, deploy, and scale GenAI, RAG, and agentic AI applications, collaborating... ...teams. You will build end-to-end AI systems, design LLM-powered agents with orchestration, and...Remote work
International Business Machines Corporation
Houston, TX1 day ago - ...IBM Consulting is seeking a Forward Deployed Engineer - AI to work directly with clients, transforming complex business challenges into... ...-ready AI solutions. You will prototype, deploy, and scale GenAI, RAG, and agentic AI applications across cloud platforms while ensuring...Remote work
International Business Machines Corporation
San Jose, CA1 day ago - ...HTEC is seeking an experienced AI engineer to design and build AI applications across customer SDLCs and enterprise systems. You will ship production‑ready solutions that integrate with customer environments and scale with use cases, collaborating with customer teams...Remote work
Coley S Home Remodeling
San Francisco, CA1 day ago - ...Typeform is seeking a Senior AI Engineer to build and evolve the AI capabilities behind... ...other AI products. You will ship production systems and influence quality and performance.... ..., RAG, and modern data tooling. This is a remote role for US-based candidates in the ET timezone...Remote work
Typeform
Eastern, KY1 day ago - Join to apply for the 1.20. QA Tester role at Focused HR Solutions 1 year... ...at Focused HR Solutions Get AI-powered advice on this job and... .... The position is mostly remote with on-site meetings in Raleigh... ...activities related to a critical system being developed in-house at...Remote workHourly payContract workLocal areaImmediate start
- ...technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This... ...career growth potential. We are seeking a Secure AI Systems Engineer to lead the design and implementation of security controls...Remote work
Bright Vision Technologies
Overland Park, KS1 day ago - ...Kinetic plc is seeking a Senior Software Engineer for the AI Platform team to own and evolve the agent orchestration layer. You will... ...insurance lifecycle, with a focus on safe, scalable production systems and cost-aware tooling. You will work closely with product and...Remote work
Kinetic plc
San Mateo, CA1 day ago - ...landscape, virtual recruiting and remote work are critical for the future of... ...best job for you. Position: Agentic QA Engineer Generative AI & Agentic Systems (Agent, Multi-Agent Testing) Location... ...times across orchestration layers (LLM calls, tool invocations, queues)....Remote workPermanent employmentContract workNight shift
Tekfortune Inc
Dallas, TX1 day ago - ...to support a specialized AI security evaluation... ...applications, particularly LLM agents and Retrieval-Augmented Generation (RAG) systems. You will build small, runnable... .... LOCATION: Remote EXPERIENCE: 5+ years in... ...engineering PROJECT: GenAI application security evaluation...Remote workContract work
- ...QA Engineer Start Date: As soon as possible, but open to discussion Type: Full-time Reports... ...Specification Driven Development with AI coding agents doing much of the first-draft... .... Testing Celery or other queue-based systems; Multi-tenant SaaS isolation testing; Contract...Remote workFull timeContract workWork at officeImmediate startShift work
de Anda Capital
New York, NY2 days ago $152k - $241.5k
NVIDIA is seeking a Senior GenAI Algorithms Engineer to... ...efficiency, multimodal AI, and open-source AI infrastructure... ..., optimize existing systems, and contribute to... ...long-context attention. LLM/VLM Post-Training: Supervised... ..., Santa Clara; US, NY, Remote; US, VA, Remote; US, CO,...Remote workFull timeNvidia
Santa Clara, CA4 days ago$206.1k - $269.08k
...Engineering | Remote, Americas | Remote, Remote | San Francisco, United States | Austin, United States | Mountain View,... ...of being a distributed-first company. As a Senior ML System Engineer in the Rovo GenAI Platform team, you will build and maintain the core infrastructure...Remote workFull timeWork at officeAtlassian
Eastern, KY1 day ago- ...QA Tester II job at Insight. Indiana. QA Tester, Agent Builder Factory... ...deep expertise in cloud, data, AI, cybersecurity, and... ...and execute test strategies for LLM‑powered applications. This includes... ...to ensure data integrity and system reliability in a serverless environment...Local areaImmediate startShift work
kozmetickesluzby.vecnakraska.sk - Jobboard
Indiana, PA3 days ago $162k
...RoleThe Program Leader, GenAI & Voice AI Innovation sits within... ...guardrails suitable for GenAI/LLM-driven automation.... ....Run recurring QA review and calibration... ...considerations in production AI systems, and comfort acting as... ...approved for full remote work, employees must spend...Remote workFull timeWork at officeUber
San Francisco, CA1 day ago- ...advancing through innovative AI solutions. The successful... ...creating scalable and robust LLM/RAG frameworks tailored to customer... ...edge. This role is 100% Remote, Work from Home based.... ...Retrieval-Augmented Generation (RAG) QA/search systems that connect to multi-source...Remote workWork from home
Remote Services Inc.
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI QA Tester for GenAI & LLM Systems (Remote). Be the first to apply!
Related searches
- support specialist remote Washington DC
- quality manager remote Washington DC
- remote reviewer Washington DC
- marketing assistant remote Washington DC
- remote director Washington DC
- automation engineer remote Washington DC
- it manager remote Washington DC
- global remote customer service jobs Washington DC
- remote secretary Washington DC
- remote design intern Washington DC