IT Software Engineer 4 (AI Architect for Testing)

Role Description

We’re looking for an AI Architect to lead how our testing organization uses AI to improve quality, speed, coverage, and insight across the software delivery lifecycle. This person will define the AI strategy for QA and testing, design AI-enabled testing solutions, guide tool selection and integration, and help teams adopt AI responsibly in day-to-day testing activities.

• Define the AI vision and architecture for the testing function.
• Identify testing activities that can be improved with AI, including:
  • Test case generation
  • Test data creation
  • Automated test maintenance
  • Defect prediction
  • Root cause analysis
  • Log and failure analysis
  • Requirements-to-test traceability
  • Risk-based test prioritization
  • Intelligent regression selection
• Design and implement AI-enabled frameworks for:
  • Functional testing
  • API testing
  • UI automation
  • Performance testing
  • Security testing support
  • Exploratory testing augmentation
• Partner with QA, developers, DevOps, product managers, and data teams to embed AI into CI/CD and quality engineering workflows.
• Evaluate and recommend AI/ML, GenAI, and test automation tools.
• Establish standards for AI governance, privacy, security, explainability, and responsible usage in testing.
• Create architecture for integrating LLMs, test repositories, defect systems, observability tools, and CI platforms.
• Define metrics to measure the effectiveness of AI in testing, such as:
  • Defect leakage
  • Automation coverage
  • Test execution efficiency
  • Flaky test reduction mean time to diagnose failures
  • Release quality trends
• Mentor QA engineers and SDETs on AI-assisted testing practices.
• Lead pilots, proofs of concept, and scaled rollout of AI testing capabilities.
• Ensure compliance with enterprise policies for data handling and model usage.

Qualifications

• 8-10 years of experience.
• Bachelor’s degree and 8+ years of experience.

Requirements

• 8+ years in software testing, QA automation, quality engineering, or test architecture.
• 3+ years designing or implementing AI/ML or GenAI-based solutions in enterprise environments.
• Strong understanding of:
  • Software testing methodologies
  • Test automation frameworks
  • SDLC/STLC
  • CI/CD pipelines
  • Quality Engineering Practices
• Experience with AI technologies such as:
  • Machine Learning models
  • NLP
  • LLMs
  • Prompt Engineering
  • Retrieval-augmented generation concepts
  • AI agents/workflow automation
• Hands-on experience with tools/languages such as:
  • Python
  • Java
  • JavaScript
  • SQL
  • Test tools like Selenium, Playwright, Cypress, Appium, JUnit, TestNG, PyTest, or similar.
• Experience integrating with platforms such as:
  • Jira
  • Azure DevOps
  • GitHub
  • Jenkins
  • GitLab
  • Cloud test platforms
• Knowledge of test analytics, data pipelines, and observability/log analysis tools.
• Strong architecture and design skills for scalable, secure enterprise solutions.

Desired Skills

• Experience building AI copilots or assistants for QA teams.
• Familiarity with vector databases, model evaluation, and MLOps/LLMOps concepts.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Understanding of regulated environments and compliance requirements.
• Certifications in test architecture, cloud, AI/ML, or enterprise architecture.
• Hands-on experience with Python.
• Development experience in AWS Cloud technology.
• Experience in TDD, continuous integration, and code review practice is strongly desired.
• Experience with Apigee or other API gateways is a plus.
• Experience with DevOps concepts and tools (e.g., CI/CD, Jenkins, Git).
• At least 2 years working on an Agile team with a solid understanding of Agile/Lean practices.
• Understanding of a microservice architecture.
• Experience in load and performance testing.
• Strong documentation skills.

Key Skills

• AI strategy for testing
• Test Architecture
• Quality Engineering Leadership
• GenAI and LLM application design
• Automation Framework design
• Data-Driven decision making
• Stakeholder communication
• Governance and risk management
• Team Enablement

Soft Skills Required

• Ability to adapt quickly to a complex environment.
• Pro-active, flexible, and creative.
• Very strong communication skills and the ability to collaborate with developers and business users.