Test Engineering Analyst - ML/AI Chatbot - W2 DMV Areas

Title: Test Engineering Analyst ML/AI Chatbot

Location: Baltimore/Canton, MD, or Washington, DC



Duration: 6+ months, likely extension







Work: Hybrid-onsite 1 day/week

Interview: 1 2 video + in-person

What the client is looking for

They need a hands-on Testing Analyst with GenAI/Chatbot testing experience . This is not a lead role . The person will test AI chatbots, analyze whether responses are accurate, identify issues, and provide feedback to developers/AI engineers.

Must Have

• 3+ years software testing / test automation
• Strong Healthcare experience
• 3+ years GenAI/ML experience - GenAI is more important
• Experience testing AI/ML chatbots and LLM outputs
• Selenium + Java + BDD
• Python + SQL
• Selenium / Playwright + API testing
• Experience with Snowflake or Oracle
• Cloud experience - AWS preferred
• Jira and/or Confluence
• Experience with microservices/containerized applications
• Understanding of AI hallucinations, model accuracy, and output validation

Strong Plus

• AWS Bedrock / SageMaker
• Databricks
• LangChain
• Data pipelines between Snowflake and Oracle
• Salesforce / Einstein
• AI testing agents, self-healing automation, or AI-based test generation

Ideal Candidate

A QA/Test Engineer or Test Analyst with strong GenAI/Chatbot testing experience who can test chatbot responses, validate accuracy, analyze AI outputs, and communicate issues clearly to the development/AI team.

Important: Don't submit a traditional QA candidate who only has Selenium. Actual GenAI/Chatbot testing experience is a key requirement.