Remote AI Agentic Tester: LLM & RAG Validation
Delan Associates Inc
Delan Associates, Inc. is seeking an AI Agentic Tester in Denver, MO (Remote) to validate AI agent workflows and end-to-end AI applications. The role emphasizes testing of LLM responses, tool calls, and RAG pipelines, with an emphasis on accuracy and hallucination metrics. The ideal candidate will develop automation scripts in Python and leverage Postman, Swagger, Selenium, Playwright, or PyTest to ensure high-quality AI solutions across Azure OpenAI, AWS Bedrock, and Gemini platforms. #J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote AI Agentic Tester: LLM & RAG Validation in Denver, MO vacancy
- ...Delan Associates, Inc. is seeking an AI Agentic Tester in Denver, MO (Remote) to validate AI agent workflows and end-to-end AI applications. The role emphasizes testing of LLM responses, tool calls, and RAG pipelines, with an emphasis on accuracy and hallucination metrics...Remote work
Delan Associates Inc
United States3 days ago - AI Agentic Tester Denver, MO (Remote) Must-Have Skills AI Agentic Testing Functional Testing Generative... ...Retrieval-Augmented Generation (RAG) Prompt Engineering Validation AI Model Validation & Evaluation... ...-end AI applications. Validate LLM responses for accuracy,...Remote work
- ...insurance, is seeking an AI Software Engineer to join... ...including web scraping and agentic AI initiatives. The... ...Opportunity to work 100% remotely with EST hours. Being... ...production-grade Generative AI/LLM solutions. ~ Experience with LLMs, RAG, OCR, and Responsible AI...Remote work
Optomi
Charlotte, NC2 days ago - ...Accordion’s Data & Analytics team seeks engineers to build agentic AI solutions, writing multi-agent logic, RAG pipelines, and eval harnesses for live client... ...from week one. The role offers hybrid work with two remote days weekly and is based in the US; compensation ranges...Remote work
Accordion USA
San Francisco, CA2 hours ago - Smart Tech Skills LLC is seeking a Principal Machine Learning Engineer to architect and advise on end-to-end AI solutions using LLMs, RAG, and agentic systems. This senior IC role focuses on technical strategy and architectural guidance rather than people management. You...Remote job
- ...ChronosLocation: San Francisco, CARemote Working: 100% remote working possibleSalary: On ApplicationSector: IT & Tech, Enterprise Software, AI and Machine Learning, SaaS & PaaS,... ...lead the developer-facing products for LLM and agentic applications, acting as the bridge...Remote workPermanent employmentFull timeImmediate startFlexible hours
Chronos Consulting
San Francisco, CA5 days ago - ...Job Title: Lead AI/ML Engineer – GenAI, LLM, RAG Location: Eden Prairie, MN (Remote) Employment Type: Contract (W2 through ZipStaff — No C2C or 1099) About the Opportunity ZipStaff is seeking a Lead AI/ML Engineer to design, build, and deploy enterprise Generative...Remote workContract work
ZipStaff Inc.
Eden Prairie, MN2 days ago - ...SummaryThe Senior Manager, Agentic AI Delivery will be a... ...agentic AI solutions (LLM-powered copilots/agents... ...strong understanding of RAG, tool/function calling... ...stakeholders.For all virtual remote positions, in order to... ...or unsure about validity of a job posting, we strongly...Remote workFull timeContract workSecond job
Ascensus
Charlotte, NC6 days ago - ...Analyze GitHub issues and evaluate LLM performance on real-world code... ...– LLM Evaluation & Repository Validation About the projects: we... ...the world’s fastest-growing AI companies accelerating the... ...Turing: Work in a fully remote environment. Opportunity...Remote workPart timeFor contractorsFreelance
Turing
San Francisco, CA10 days ago - ...Role: Agentic AI Engineer Location: The team is... ...also open to all US-based remote candidates. If you are... ...associate will own LLM-driven orchestrator... ...delegation, memory, response validation, capability discovery.... ...retrieval (vector RAG over a capability registry...Remote workContract workWork at officeLocal area
Hallmark Global Solutions Ltd
United States1 day ago $150k - $200k
...Multiple AI roles_FDE–Agentic AI/AI Prompt Engineer/AI Lead Engineering... ...hybrid, with no fully remote option. Travel:... ...memory patterns. - RAG, embeddings, chunking,... ...- Experience building LLM applications and agent... ...minimum two-year EAD validity requirement has been confirmed...Remote workH1bWork at officeBestinfo Systems LLC
Chicago, IL20 hours ago- ...company that deploys AI-assisted teams to... ...building, and deploying Agentic AI systems in... ...of productionizing LLM-driven workflows (reasoning... ...direction. 100% Remote (Full-Time) Key... ...experimentation to validate novel agent... ...), embeddings, and RAG/advanced memory retrieval...Remote workPermanent employmentFull timeTemporary work
ImagineX Consulting
Remote25 days ago $201.3k - $352.3k
...ServiceNow is the AI control tower for business... ...Manager, Agentic & GenAI Benchmarking... ...infrastructure, rigorous validation frameworks, and... ...Validate Grounding & RAG Pipelines: Partner... ...ROUGE, BLEU, G-Eval, LLM-as-a-judge patterns... ...(flexible, remote, or required in office...Remote workWork experience placementWork at officeImmediate startFlexible hoursShift workServiceNow
Santa Clara, CA3 days ago- ...Agentic AI Engineer We're on a mission to change the future of clinical... ...workflows such as intake and validation of imaging data, metadata... ...retrieval-augmented generation (RAG) patterns grounded in controlled... .... Experience implementing LLM-based systems (agentic workflows...Remote work
Perceptive
United States3 days ago $190.9k - $334.1k
...Staff Software Engineer - Agentic AI Full-time... ...systems Prototype and validate new approaches; share learnings... ...‑on of experience with LLM/AI systems at scale,... ...orchestration frameworks, RAG architectures,... ...Work personas (flexible, remote, or required in office)...Remote workFull timeTemporary workWork experience placementWork at officeImmediate startFlexible hoursServiceNow
Santa Clara, CA1 day ago- **FULLY REMOTE** ScolerTec is seeking multiple AI/ML Engineers to design, develop, deploy, and govern production AI/ML solutions, including Generative AI, Agentic AI, LLM applications, RAG pipelines, predictive models, forecasting, and advanced analytics . Key...Remote workFull time
ScolerTec Inc
United States20 hours ago - ...highly skilled Conversational & Agentic AI Architect to design, build,... ...Microsoft Copilot Studio). LLM Engineering & NLU Design:... ..., LLM Models, MCP, Vector DB, RAG, Vertex AI, Agentic AI frameworks... ...Where you'll be workingIn this remote role, you'll work from home with...Remote workTemporary workPart timeWork experience placementWork from homeShift work
Verizon
Irving, TX3 days ago $167.5k - $203.9k
...United States – Remote Clearance: Ability to obtain... ...a Senior Front-End Agentic AI Engineer to own the experience... ...that allow users to validate AI-generated answers by... ...AI-native products, LLM-powered applications,... ...-Augmented Generation (RAG), vector search, embeddings...Remote workFull time$125k - $225k
...the world’s most advanced AI-native platform. We work... ...the next generation of agentic systems for... ...agentic systems — evals, LLM-as-judge pipelines, and... ...algorithms, and concepts #LI-Remote #LI-RC1 Benefits of... ...recreational programs--on valid job requirements. If...Remote workPermanent employmentWork experience placementWork at officeLocal areaRemote16 days ago- ...fully on-site with no remote work. We are unable... .... AI Engineer II (Mid-Level), Agentic Systems System... ...accuracy with validation rules and reconciliation... ...least one agentic or RAG system to real users... ...evaluation methods for LLM outputs...Remote workFull timeLocal areaImmediate startRelocation
System One
Pittsburgh, PA10 days ago $160k - $175k
...capabilities range from C5ISR, AI and Big Data, cyber... ...experienced Senior AI/RAG Back-End Developer (Python... ...schemas, documentation, validation, authentication,... ...integrating applications with AI/LLM or RAG services.... ...time of considerationFully Remote position; must align with...Remote workFull timeWork at officeLocal areaWork from homeWorldwideHome officeHII Mission Technologies Division
Arlington, VA8 days ago$150k - $230k
...is seeking a Full Stack Agentic Developer to help build... ...and evolve a web-based AI platform that enables... ...expertise into scalable, validated AI-driven workflows.... ...and has advanced into LLM-powered agentic systems... ...services, and isolated remote execution environments...Remote workWork at officeLocal areaWork from home3 days per weekCRA International
Boston, MA5 days ago- Satalia, fully remote in Greece, seeks a Data Scientist to design and deploy ML/AI models in production, including LLM-powered systems. The role emphasizes end-to-end ownership—from data handling to evaluation—collaborating with engineers and stakeholders across the organisation...Remote job
- ...security can do in the AI era. Cyberattacks... ...We're building an agentic attacker swarm.... ...in three days and validated 38 attack paths. That... ...Attack LLMs, agents, RAG pipelines, and the... ...hands-on AI offense. LLM and agent... ...credentials. Location Remote in United States...Remote workOdd jobFull timeWork at officeFlexible hoursShift work
$200k - $250k
...Senior / Staff Software Engineer (Agentic AI Infrastructure) $200000 - $25... ...: Five days per week, with 13 remote days available per quarter.... ...-augmented generation (RAG), context management, or knowledge... ...Familiarity with multi-provider LLM architectures, inference optimization...Remote workPermanent employmentFull timeLocal areaJobot
New York, NY2 days ago$55 - $60 per hour
...Immediate need for a talented Windchill Validation Tester . This is a 06-12+months contract opportunity with long-term potential and is located in Bentonville, AR (Remote). Please review the job description below and contact me ASAP if you are interested. Job ID...Remote workContract workLocal areaImmediate startPyramid Consulting
Bentonville, AR4 days ago- ...Solutions Architects to put AI agents in front of... ...and want to apply that to agentic AI at real scale, this team... ...augmented generation (RAG), and prompt strategies,... ...building or integrating LLM powered systems,... ...Flexible work location: remote, hybrid, or onsite in the...Remote workFull timeFor contractorsFlexible hours
ETHOS - Talent & Advisory
Washington DC20 hours ago - ...consulting firm specializing in AI, Data & Analytics, is... ...Engineer, AI & Agentic Systems to join our team... ...industry. We will consider remote candidates with the right... ...strong understanding of LLM platforms and orchestration... ...Experience We Value RAG, embeddings, vector...Remote workFull time
BICP
Carlsbad, CA2 days ago - ...AI Chatbot Tester MCI is one of the fastest-growing tech-enabled business services companies... ...centers are powered by both on-site and remote agents, leveraging advanced technologies... ...an AI Chatbot Tester to evaluate, validate, and improve AI-powered chatbot and conversational...Remote workTemporary workWork at officeLocal area
AI Support Positions
United States3 days ago $140k - $200k
...capabilities span Data & AI, Cybersecurity, Risk &... ...AI/ML platforms, agentic workflows, and cloud-native... ...with quant teams, model validation, risk, and platform engineering... ..., Claude, or similar LLM frameworks. Build... ...parental leave. ~ Remote/hybrid work environment...Remote workTemporary workWorldwideBIP US
New York, NY20 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agentic Tester: LLM & RAG Validation. Be the first to apply!
