Automation Engineer II

Automation Engineer IIOur client, a Financial company, is looking for an Automation Engineer II for their Jersey City, NJ location. Responsibilities include designing and executing quality engineering activities, developing automation solutions, validating APIs and integrations, supporting CI/CD and release readiness, and promoting a quality-first engineering mindset across traditional and AI-driven platforms.Design and execute functional, integration, system, regression, and automation testing activities.Apply Shift-Left testing practices by participating in requirement reviews and defining test scenarios early in the SDLC.Build, maintain, and enhance UI automation frameworks using Python, PyTest, and Playwright.Perform manual and automated API testing using industry-standard tools and frameworks.Collaborate with developers, product owners, business analysts, and DevOps teams to ensure product quality.Work with SQL and NoSQL databases for backend validation and data testing.Support CI/CD pipelines and ensure automated tests are integrated into deployment processes.Create test plans, test cases, test data strategies, and quality metrics dashboards.Manage defect lifecycle activities and provide clear reporting of quality risks.Develop AI test datasets, benchmarks, evaluation frameworks, and automated validation approaches.Requirements include a self-driven Software Development Engineer in Test (SDET II) with experience testing AI-powered applications, Generative AI solutions, and Agentic AI systems. The candidate should have 8+ years of software quality engineering, test automation, or SDET experience in Agile development environments. Strong proficiency in Python, Pytest, Pandas, and object-oriented programming principles is required. Additionally, the candidate should have 6+ years of experience with UI automation frameworks such as Playwright or Selenium, 6+ years of experience testing RESTful APIs and microservices, hands-on experience with CI/CD pipelines and DevOps practices, experience working with SQL and NoSQL databases, experience with AWS or other cloud-based platforms, understanding prompt engineering, prompt validation, hallucination detection, bias testing, guardrail validation, and AI output evaluation, knowledge of LLMs, Retrieval-Augmented Generation (RAG), AI agents, MCP, and AI-assisted workflows, ability to develop QA strategies, test frameworks, and automation solutions for AI-driven applications, analytical, problem-solving mindset with continuous learning and quality-first engineering habits, experience with performance and load testing using JMeter or similar tools, knowledge of AI observability, model monitoring, and evaluation platforms, and experience with monitoring tools such as New Relic, Datadog, Splunk, or CloudWatch.Experience testing Generative AI and Agentic AI applications.Ability to validate AI outputs for accuracy, reliability, and business relevance.Knowledge of AI agent workflows, prompt testing, hallucination detection, and model evaluation.Understanding AI safety, guardrails, security, compliance, and responsible AI practices.Experience with LangChain, LangGraph, MCP, OpenAI, Anthropic, Azure OpenAI, Kiro or Amazon Bedrock.Familiarity with AI governance, risk management, and AI quality metrics.Why Should You Apply? Includes health benefits, a referral program, and excellent growth and advancement opportunities. Iconma