SDET / AI Test Automation Engineer | GenAI, LLM & RAG | Healthcare Claims | In-Person Interview

KMM Technologies, Inc.

Columbia, MD

Job Description

Position Details:

Job Title: SDET / Automation Engineer

Location: DMV Area (Maryland, Washington, DC, and Virginia)

Work Arrangement: Hybrid

Interview Process: Two rounds — one virtual and one in-person

Key Responsibilities:

Design and execute test strategies for AI/ML and Generative AI applications.

Validate LLM outputs, prompt behavior, RAG pipelines, and AI-generated responses.

Develop and maintain automated test suites using Selenium, BDD, and other automation tools.

Perform manual, exploratory, UI, API, and backend testing.

Write complex SQL queries to validate data across multiple databases, including Oracle.

Identify and evaluate model drift, AI hallucinations, bias, accuracy, relevance, and output safety.

Test Salesforce applications integrated with AI/ML capabilities and external LLM services.

Support quality assurance activities during Snowflake-to-AWS migration.

Collaborate with developers, data scientists, product owners, and business stakeholders.

Required Skills and Qualifications:

Strong SDET / Software QA / Automation Engineering experience.

Mandatory healthcare claims industry experience.

Hands-on experience testing AI/ML and Generative AI applications, including LLMs, RAG, and prompt engineering.

Experience with AI test automation and validation of AI-generated outputs.

Strong SQL skills and relational database experience; Oracle knowledge is important.

Experience with Selenium and BDD automation frameworks.

Experience testing Salesforce applications and AI-enabled features.

Knowledge of AWS AI/ML services, particularly SageMaker and Bedrock, or equivalent platforms.

Exposure to Snowflake, Databricks, Jenkins, or CloudBees is beneficial.

Familiarity with Agile methodologies, Jira, and Confluence.

Excellent analytical, communication, and problem-solving skills.

Bachelor's degree required; a technical degree is preferred.

Ideal Candidate Profile:

We are specifically seeking an SDET / Automation Engineer with a strong background in healthcare claims, AI/ML testing, GenAI, LLMs, RAG, prompt engineering, SQL, Salesforce, and test automation.

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the SDET / AI Test Automation Engineer | GenAI, LLM & RAG | Healthcare Claims | In-Person Interview in Columbia, MD vacancy

Senior SDET (healthcare, Gen AI, AWS)
...NOTE: Looking for SDET/Automation Engineer with mandatory healthcare claims industry experience... ...deep expertise in testing AI/ML and Gen AI systems (LLMs, RAG, prompt engineering... ...Engineering, AI ML, GenAI, AI Test Automation... ...including testing LLM outputs, prompts, and...
Claims
KMM Technologies, Inc.
Columbia, MD
4 days ago
Software Quality Engineer
$90k - $125k
...cardiometabolic health through AI-powered, personalized digital tech, with a... ...technology partner across the healthcare industry. We're a team... ...will interface with the R&D engineering team located in Bangalore,... ...increase your chances of interviewing at Welldoc by 2x. Get notified...
Suggested
Full time
WellDoc
Columbia, MD
1 day ago
UNIX CNO Developer
$86.9k - $198k
...application developers, reverse engineers, and vulnerability... ...will work with applied AI developers, AI/ML... ...including design, develop, test, validate, or deployTS/... ...to be on camera during interviews and assessments. We... ...interviews (whether in-person or virtual) is prohibited...
Suggested
Full time
Contract work
Part time
Local area
Remote work
Flexible hours
Booz Allen Hamilton
Columbia, MD
17 hours ago
Forward Deployed BI Engineer
...Description Who We Are Healthcare quality is complex.... ...connecting clinical and claims information into a... ...in advanced analytics, AI, and new capabilities that... ...experienced Forward Deployed BI Engineer to join our team.... ...often be the first person building it. What...
Claims
Shift work
Medisolv, Inc.
Clarksville, MD
a month ago
ML Engineer
$90k - $120k
...are looking for an ML Engineer to own model... ...on a federal data and AI program: self-supervised... ...in the following; the interview will test it. Area Expected... ...over event data, or LLM evaluation. Model... ...optimization at scale. Healthcare claims or other...
Claims
Full time
Remote work
iAdeptive Technologies
Columbia, MD
3 days ago
SDET - AI Test Automation (AWS, Playwright, CloudBees)
$62.4 per hour
...Job Title: SDET – AI Test Automation (AWS, Playwright, CloudBees) Location: Columbia, MD Type:... ...Automation (ITA) strategies • Apply context engineering to ensure AI-driven testing relevance... ...AI solutions, including LLMs, RAG architectures, prompt engineering, and...
Contract work
Temporary work
Local area
Remote work
System One
Columbia, MD
5 days ago
Building Automation Systems Specialist
$58.98k - $101.1k
...Building Automation Systems Specialist This... ...Operational testing, verification, and... ...system documents to engineering for as-built drawings... ..., transport, and healthcare. From more... ...job application, interviewing, completing any pre... ...notices about their personal information. To...
Permanent employment
For contractors
Work at office
Local area
Immediate start
Night shift
Siemens
Laurel, MD
3 days ago
Software Quality Engineer, Secure Firewall
$138.1k - $198.2k
...System and Integration Test (SIT) and System Test (... ...ImpactAs a Software Quality Engineer, you will independently... ...-on system testing, automation, network-security... ...functional quality reviews.Use AI-assisted engineering... ...4 paid days off for personal wellness determined by...
Full time
Temporary work
Local area
Remote work
Flexible hours
CISCO Systems
Fulton, MD
2 days ago
Medical Billing & Collections Specialist
...Overview We are seeking a Medical Billing & Collections Specialist to join a healthcare revenue cycle team in Columbia, MD. This role is heavily focused on insurance collections, complex claim denials, and appeals management. The ideal candidate has experience working...
Claims
Full time
Insight Global
Columbia, MD
2 days ago
Sr. Director, Platform Engineering
...Description Who We Are Healthcare quality is complex.... ...clinical and claims information into a single... ...in advanced analytics, AI, and new capabilities... ...Sr. Director, Platform Engineering to join our team.... ...Engineering Practices & Automation • Drive standardization...
Claims
Medisolv, Inc.
Columbia, MD
3 days ago
Junior Systems Analyst
...activities.Assist with testing, validation,... ...with Systems Engineering and Software... ....Healthcare industry experience... ...application or interview process, please... ...request sensitive personal information... ...communication claiming to be from Sparksoft... ...Intelligence (AI) Policy: While...
Claims
Hourly pay
Internship
Work at office
Immediate start
Flexible hours
Shift work
Night shift
Sparksoft
Columbia, MD
4 days ago
Personal Injury Attorney
$140k - $180k
...Description: Gordon Feinblatt is seeking an experienced Personal Injury Attorney to join our team. The primary focus of this position is the settlement and litigation of personal injury claims. We are looking for a motivated attorney with strong leadership, negotiation...
Claims
Gordon Feinblatt
Fulton, MD
1 day ago
EEO and Workplace Investigator
...government, commercial, nonprofit, healthcare, and educational... ...and appropriately sensitive interviews. Prepare interview summaries... ...potential delays. Protect personally identifiable information and... ...documentation, or multiple claims. Engagement Information...
Claims
Temporary work
For contractors
Remote work
HR Anew
Columbia, MD
more than 2 months ago
Senior SDET/QA Automation Engineer
***This is NOT a remote position*** Job Description Eccalon is seeking a Senior SDET / QA Automation Engineer to build and own the automated testing strategy across our web applications and backend services supporting DoD, Intelligence, and enterprise programs....
Shift work
Eccalon, LLC
Hanover, MD
2 days ago
Test Automation Engineer
...01:2005 Information Security Management System (ISMS), and CMMI-DEV Level 3"Job DescriptionCandidate must have a background in test automation, Web Application front-end development, or Siebel. Candidates with previous experience on Agile teams especially within Government...
Flexible hours
Comtech
Beltsville, MD
4 days ago
Cyber Operations Engineer, Senior
$86.9k - $198k
Cyber Operations Engineer, SeniorThe Opportunity... ..., physical test environments, embedded... ...CI/CD pipelines, automated testing, and secure... ...using generative AI and large language... ...on camera during interviews and assessments. We... ...interviews (whether in-person or virtual) is...
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Annapolis Junction, MD
2 days ago
Building Automation Engineering Internship
$22 per hour
...Building Automation Specialist Internship Here... ...with our engineering and project management... ..., transport, and healthcare. From more resource... ...job application, interviewing, completing any pre-employment testing, or otherwise... ...notices about their personal information. To learn...
Hourly pay
Permanent employment
Internship
H1b
Work at office
Local area
Immediate start
Relocation
Siemens
Beltsville, MD
2 days ago
Automation Engineer, Senior
$86.8k - $198k
Automation Engineer, SeniorThe Opportunity:Integrate security practices... ...builds, regression testing, monitoring, and... ...to be on camera during interviews and assessments. We reserve... ...fraud.Candidate AI Usage PolicyAI is a part... ...interviews (whether in-person or virtual) is...
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Laurel, MD
3 days ago
Automation Engineering Technical Support
...Automation Engineer Location: laurel, MD any special... ...mandatory interview process: 1 hour video... ...Leadership experience - this person will be a leader to... ...solutions including AI capabilities where... ...automation engineering, test automation, DevOps...
Contract work
Anveta
Laurel, MD
1 day ago
Data Operations Engineer (Hybrid) - 30039
$137.51k - $195k
...software and systems engineering, cyber capabilities, and... ...and collaborate in-person to get the job done—while... ...employee premium for healthcare, vision and dental plans... ...recruiter during the interview process.Job... ...our data pipelines are automated, documented, and precisely...
Work experience placement
Work at office
Immediate start
Work from home
2 days per week
1 day per week
HII Mission Technologies Division
Columbia, MD
1 hour ago
HPC Test Automation Engineer
...Perks and Benefits 100% Paid Healthcare 10% 401k in every paycheck 100% Fully Vested! NOTE – Our positions require... ...reliability, and readiness of HPC systems through disciplined test engineering and automation. In this role, you will develop and execute test plans,...
Full time
Visa sponsorship
Work visa
GIGATEC Engineering
Annapolis Junction, MD
18 days ago
Senior Manager, Process & Project Engineering
$88k - $118k
...1881, is a global leader in engineering solutions, serving industries... ...Employee Assistance Program for personal or professional guidanceSave... ...of engineering design and testing challenges.Improve engineering... ...project performance and support claim resolution and negotiations...
Claims
Full time
For contractors
Work at office
Local area
Worldwide
Flexible hours
GEA Group
Columbia, MD
3 days ago
Automation Engineer SkillBridge
$80k - $150k
...through the DoD SkillBridge program as an Automation Engineer. This program provides active service... ...you can thrive both professionally and personally. We believe in transparency and... ...hire software engineers, web designers, test engineers, systems engineers, systems administrators...
Full time
Contract work
Work experience placement
Flexible hours
Belay Technologies
Columbia, MD
a month ago
Personal Lines Insurance Agent
...Personal Lines Sales Agent Holman Insurance Services is currently... ...policy changes, billing questions, claims inquiries and assistance, or... ...at any organization may view AI tools for tasks such as... ...use AI tools to: Answer interview questions on their behalf, or...
Claims
Full time
Temporary work
Part time
Work experience placement
Work at office
Local area
Flexible hours
Afternoon shift
Holman Automotive Group
Laurel, MD
2 days ago
Pharmacy Manager
$5,863.2 - $6,438.2 per week
...Offers preventive and clinical healthcare services, including immunizations, diagnostic testing, and patient outcome services.... ...technology. Ensures insurance claims are processed accurately and resolves... ...maintains morale. Training & Personal Development Maintains required...
Local area
Walgreens
Clarksville, MD
7 hours ago
GTM Operations Analyst
...Description Who We Are Healthcare quality is complex... ...clinical and claims information into a... ...analytics, AI, and new capabilities... ...Medisolv's go-to-market engine. You'll manage the... ...workflows and automations, keep the CRM... ...when priorities or personalities compete • Analytical...
Claims
Medisolv, Inc.
Clarksville, MD
26 days ago
Test Engineer
$86.9k - $198k
Test EngineerThe Opportunity:Test software following a formal automated testing method using various telephony and networking... ...be on camera during interviews and assessments. We... ...fraud.Candidate AI Usage PolicyAI is a part... ...interviews (whether in-person or virtual) is...
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Annapolis Junction, MD
1 day ago
Test Automation Engineer - Cypress
$66.16 - $85.94 per hour
...be considered. Location & In-Person Requirement All positions require... ...users' confidence. Build useful automated coverage, investigate failures, and give engineers fast feedback. The mission... ...and maintain Cypress UI and API tests • Execute suites and analyze...
Hourly pay
Full time
Temporary work
Local area
2 days per week
CTRL + LLC
Annapolis Junction, MD
19 days ago
Senior Automation Test Engineer
...JOB TITLE: Senior Automation Test Engineer LOCATION: Bethesda MD (5 Days Onsite) EMPLOYMENT... ...EXPERIENCE LEVEL: 12 Years INTERVIEW NOTE: Local candidates are required and... ...automation API testing integration testing and AI-assisted quality engineering practices...
Full time
Contract work
H1b
Local area
Prologic Consulting Inc
Maryland, MD
4 days ago
Senior Software Test Engineer (Engineer Software Quality 3) - 30214
$98.06k - $145k
...network architecture, reverse engineering, software and hardware development... ...and driven Senior Software Test Engineer to join our rapidly... ...troubleshooting.Design of both manual and automated test procedures.Prepare... ...range from C5ISR, AI and Big Data, cyber operations...
Full time
Work experience placement
Work at office
Local area
Worldwide
HII Mission Technologies Division
Columbia, MD
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SDET / AI Test Automation Engineer | GenAI, LLM & RAG | Healthcare Claims | In-Person Interview. Be the first to apply!