Software Development Engineer in Test (SDET II)

Job Title: Software Development Engineer in Test (SDET II)

Location: Jersey City NJ 07310-1686

Duration: 12+ Months

  US citizens and Green Card Holders and those authorized to work in the US are encouraged to apply. We are unable to sponsor  H1b candidates at this time

Job Description:

Role Summary

We are seeking a self-driven Software Development Engineer in Test (SDET II) with experience testing AI-powered applications, Generative AI solutions, and Agentic AI systems. This role is responsible for designing and executing quality engineering activities, developing automation solutions, validating APIs and integrations, supporting CI/CD and release readiness, and promoting a quality-first engineering mindset across traditional and AI-driven platforms.

Key Experience Requirements

• 8+ years of software quality engineering, test automation, or SDET experience in Agile development environments.
• Strong proficiency in Python, Pytest, Pandas, and object-oriented programming principles.
• 6+ years of experience with UI automation frameworks such as Playwright or Selenium.
• 6+ years of experience testing RESTful APIs and microservices.
• Hands-on experience with CI/CD pipelines and DevOps practices.
• Experience working with SQL and NoSQL databases.
• Experience with AWS or other cloud-based platforms.
• Understanding prompt engineering, prompt validation, hallucination detection, bias testing, guardrail validation, and AI output evaluation.
• Knowledge of LLMs, Retrieval-Augmented Generation (RAG), AI agents, MCP, and AI-assisted workflows.
• Ability to develop QA strategies, test frameworks, and automation solutions for AI-driven applications.
• Analytical, problem-solving mindset with continuous learning and quality-first engineering habits.
• Key Responsibilities
• Design and execute functional, integration, system, regression, and automation testing activities.
• Apply Shift-Left testing practices by participating in requirement reviews and defining test scenarios early in the SDLC.
• Build, maintain, and enhance UI automation frameworks using Python, PyTest, and Playwright.
• Perform manual and automated API testing using industry-standard tools and frameworks.
• Collaborate with developers, product owners, business analysts, and DevOps teams to ensure product quality.
• Work with SQL and NoSQL databases for backend validation and data testing.
• Support CI/CD pipelines and ensure automated tests are integrated into deployment processes.
• Create test plans, test cases, test data strategies, and quality metrics dashboards.
• Manage lifecycle defect activities and provide clear reporting of quality risks.
• Develop AI test datasets, benchmarks, evaluation frameworks, and automated validation approaches.
• Experience with performance and load testing using JMeter or similar tools.
• Knowledge of AI observability, model monitoring, and evaluation platforms.
• Experience with monitoring tools such as New Relic, Datadog, Splunk, or CloudWatch.

Preferred Qualifications

• Experience testing Generative AI and Agentic AI applications.
• Ability to validate AI outputs for accuracy, reliability, and business relevance.
• Knowledge of AI agent workflows, prompt testing, hallucination detection, and model evaluation.
• Understanding AI safety, guardrails, security, compliance, and responsible AI practices.
• Experience with LangChain, LangGraph, MCP, OpenAI, Anthropic, Azure OpenAI, Kiro or Amazon Bedrock.
• Familiarity with AI governance, risk management, and AI quality metrics.

A reasonable, good faith estimate of the minimum and maximum hourly wage for this position is $60 to $65/hr. 

Benefits of our contractor

At Harvey Nash, we know that great technology professionals deserve great support. That’s why we offer a comprehensive benefits package designed to help you thrive—professionally and personally. From company-contributed medical, dental, and vision plans to a 401(k), we invest in your health and future. You’ll also enjoy perks like referral bonuses, commuter savings, a mobile payroll app for easy access to your pay and benefits, and a variety of voluntary insurance options to fit your lifestyle. Join a global IT leader that values your expertise, rewards your contributions, and supports your well-being every step of the way.

* The pay range listed above reflects the expected starting salary /Pay rate for this role. This range may be adjusted based on market conditions, location, and other relevant factors. The Company will determine the final starting salary/Pay rate in consultation with the selected candidate(s), in full compliance with applicable laws