Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Practice Architect AI/ML Test

$128k - $192k

TEKsystems

Think of TEKsystems Global Services (TGS) as the growth solution for enterprises today. We unleash growth through technology, strategy, design, execution and operations with a customer-first mindset for bold business leaders. We deliver cloud, data and customer experience solutions. Our partnerships with leading cloud, design and business intelligence platforms fuel our expertise. We value deep relationships, dedication to serving others and inclusion. We drive positive outcomes for our people and our business, and we stay true to our commitments and act in harmony with our words. We exist to create significant opportunity for people to achieve fulfillment through career success. Ready to join us? Heres what the opportunity supported through our TGS Talent Acquisition Team requires:We are seeking a Practice Architect to lead the design and delivery of AI-driven quality engineering solutions across client engagements. You will architect test strategies and frameworks for both traditional and AI-enabled systems, including ML models, GenAI, LLMs, RAG, and agentic applications, and apply AI to transform how testing itself is designed, automated, and governed. This is a senior, client-facing architecture role. You will shape solutions and Statements of Work, build reusable AI testing accelerators, guide delivery teams, and advise clients on trustworthy, responsible AI adoption. Proven architecture experience is required; AI is central to the role, grounded in strong quality engineering fundamentals. KEY RESPONSIBILITIES Solution Architecture and Practice Leadership Architect end-to-end quality engineering solutions and reference architectures for enterprise applications, data platforms, and AI-enabled systems.Provide architectural direction across engagements; review designs, set standards, and ensure solutions are scalable, secure, and maintainable.Evaluate and recommend tools, platforms, and AI models based on fit, cost, risk, security, and client constraints.Grow the CQ practice by identifying improvement opportunities, defining best practices, and documenting reusable patterns.AI Quality EngineeringDesign testing methodologies for deterministic and non-deterministic systems, covering data quality and lineage, model behavior and performance, bias, fairness, explainability, drift, robustness, and security.Define evaluation approaches for GenAI, RAG, and agentic systems, including golden datasets, LLM-as-judge, rubric-based scoring, groundedness, hallucination, prompt injection, and tool-use validation.Embed AI quality gates into CI/CD and MLOps/LLMOps workflows, with production monitoring, observability, and drift detection.Define and track AI quality metrics (accuracy, precision/recall/F1, drift, bias indicators, latency, cost, production stability) and support AI governance aligned with client, regulatory, and risk requirements.AI-Driven Testing Accelerators Architect and build reusable accelerators using LLMs, copilots, prompt engineering, agentic AI, and MCP-based integrations, such as AI-assisted test generation, self-healing automation, prompt validation, and AI regression suites.Establish guardrails for AI-assisted delivery: human review, deterministic validation, traceability, secure data handling, and measurable ROI.Client Advisory and Delivery Leadership Serve as a trusted AI quality advisor through workshops, AI quality assessments, solution design, demos, proofs of concept, and proofs of value.Lead creation and revision of Statements of Work, estimates, and proposals with clear assumptions, dependencies, and scope boundaries.Provide technical leadership and mentorship across delivery teams, scaling AI testing capability and raising maturity in CQ principles, test automation, and quality architecture.Partner with engineering, data science, product, and security teams to embed quality early and continuously across Agile, Waterfall, and hybrid delivery.REQUIRED QUALIFICATIONS 10+ years in software development or quality engineering, or system integration, including at least 3 years in an architect role (test, solution, or QE architect) at a recognized technology organization.Proven track record designing enterprise test strategies, automation architectures, and frameworks from scratch using Java, Python, or JavaScript/TypeScript.Demonstrated hands-on experience designing and executing testing strategies for AI/ML and GenAI systems, with a strong understanding of AI risks such as drift, bias, hallucination, and security.Expertise in using open-source and commercial AI models, copilots, prompt engineering, and agentic AI to build testing solutions or accelerators.Strong knowledge of UI and API automation (e.g., Playwright, Selenium, Rest Assured, Karate), CI/CD, and cloud platforms (AWS, Azure, or GCP).Familiarity with model evaluation metrics, AI observability, and data validation strategies for data-driven applications.Experience shaping Statements of Work, proposals, and estimates in a consulting or client-facing environment.Excellent communication, presentation, and executive stakeholder skills; able to explain AI risk and quality trade-offs to technical and business audiences.Bachelors degree in computer science or a related engineering field, or equivalent experience.Ability to travel to the United States or Canada, and satisfactory completion of standard employment screening.PREFERRED QUALIFICATIONS AI evaluation: Experience with evaluation frameworks such as DeepEval, Ragas, promptfoo, or Azure AI / Vertex AI evaluation tools.AI platforms: Exposure to MLOps/LLMOps platforms, vector databases, and AI observability tools.Specialization: Depth in one or more domains such as performance, ETL/data, security, or accessibility testing.Industry: Experience in financial services, healthcare, telecommunications, energy, or other regulated industries.Certifications: One AI testing or cloud certification (e.g., ISTQB CT-AI/CT-GenAI, Azure AI Engineer, AWS ML) and optionally SAFe. Valued, not required.WHAT SUCCESS LOOKS LIKE Clients adopt AI-enabled quality solutions with clear, measurable improvements in speed, coverage, and risk reduction.Reusable AI testing accelerators are adopted across multiple engagements.SOWs and solutions are well-scoped, delivered predictably, and positioned for expansion.Job Type & LocationThis is a Permanent position based out of Austin, TX.Pay and BenefitsThe pay range for this position is $128000.00 - $192000.00/yr. Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors.We reserve the right to pay above or below the posted wage based on factors unrelated to sex, race, or any other protected classification. Additional earnings may be available through incentive programs like annual bonuses, profit sharing, etc. Our full-time, internal employment benefits include the following: Medical, Dental, and Vision Critical Illness, Accident, and Hospital 401(k) Retirement Plan Pre-tax and Roth post-tax contributions available Life Insurance (Voluntary Life and AD&D for employee and dependents) Short and Long-Term Disability Health Spending Account (HSA) Transportation Benefits Employee Assistance Program Time Off/Leave (PTO, Vacation or Sick Leave)Job Type & LocationThis is a Permanent position based out of Austin, TX.Application DeadlineThis position is anticipated to close on Nov 27, 2026.Workplace TypeThis is a fully remote position.About TEKsystemsWe're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company. The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.About TEKsystems and TEKsystems Global Services Were a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. Were a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. Were strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. Were building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools.Job SummaryJob number: JP-006420697Profession: Architect

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Practice Architect AI/ML Test in Austin, TX vacancy
  •  ...DescriptionWe are seeking a highly experienced Test Architect to drive next-generation semiconductor test technology, with a focus on AI-enabled test development, simulation...  ...Python and related technologies.Knowledge of AI/ML applications, simulation environments, and data... 
    Suggested

    Renesas Electronics America

    Austin, TX
    3 days ago
  • $89.6k - $157k

    We are seeking a Lead Test Automation Architect to define and lead an enterprise-grade...  ...to support Agentic AI / LLM-based systems (probabilistic...  ...).Drive shift-left testing practices (contract testing, component...  ...and reliability.Partner with ML/AI, Product, and Engineering... 
    Suggested
    Full time
    Contract work
    Work at office
    Shift work
    Night shift

    Wolters Kluwer

    Austin, TX
    3 days ago
  • $230k

     ...Digital Advantage (TDA) practice focuses on helping...  ...Data & Digital Platforms, AI at Scale, Agile, Cybersecurity...  ...ll DoPrincipal AI Tech Architects at BCG Platinion are:...  ...proof-of-concepts to test model architectures,...  ...proposals with clear AI/ML technology choices and... 
    Suggested
    Work at office
    Local area

    The Boston Consulting Group

    Austin, TX
    3 days ago
  • $122.67k - $204.46k

     ...and Access Management (IAM) Architect with a strong AI and agent-integration focus...  ...architecture expertise with practical engineering skills—building...  ...delegated agent access).Configure/test identity flows; troubleshoot...  ...IAM with API gateways, AI/ML platforms, and modern... 
    Suggested
    Full time
    Work from home

    LPL Financial

    Austin, TX
    3 days ago
  • $272k - $431.25k

     ...Architecture group is solving some of AI’s hardest infrastructure...  ...interconnects. This Principal Architect role leads the research agenda...  ...networking. Understanding of ML systems concepts—transformer...  ...including in our hiring and promotion practices) on the basis of race,... 
    Suggested
    Full time
    Remote work

    NVIDIA

    Austin, TX
    13 hours ago
  • $155.94k - $259.87k

     ...financial goals. Job Overview The Principal Architect, AI is responsible for designing, building,...  ...AI architecture and platform best practices. What Are We Looking For? We want strong...  ...experience architecting and implementing AI/ML systems and data access layers — not... 
    Full time
    Immediate start
    Work from home

    LPL Financial

    Austin, TX
    13 hours ago
  • $142.9k - $235.8k

     ...Growing Team! As a member of AI and Emerging Technology...  ...class solutions. As a Senior Architect, you will partner with Technology...  ...your hands-on experience in AI/ML, Generative AI, and Agentic AI...  ...enterprise AI solutions architecture practice, contributing reusable... 
    Work experience placement
    Local area

    Travelers Insurance

    Austin, TX
    13 hours ago
  • $190k

     ...Digital Advantage (TDA) practice focuses on helping...  ...Data & Digital Platforms, AI at Scale, Cybersecurity...  ...You'll DoLead AI Tech Architects - AI Platforms at BCG Platinion...  ...for versioning, testing, deployment, and monitoring...  ...designing AI/ML or LLM-based systems in... 
    Work at office
    Local area

    The Boston Consulting Group

    Austin, TX
    13 hours ago
  • $155.94k - $259.87k

     ...Overview The Principal Architect, Artificial Intelligence...  ...for our enterprise AI portfolio, including advisor...  ...capacity, performance testing, and disaster recovery...  ...generative AI, agentic AI, or ML platforms from...  ...the wealth management practices of approximately 1,100... 
    Full time
    Work from home

    LPL Financial

    Austin, TX
    3 days ago
  • $150k

     ...Digital Advantage (TDA) practice focuses on helping...  ...Data & Digital Platforms, AI at Scale, Agile, Cybersecurity...  ...Do Senior AI Tech Architects - AI Platforms at BCG...  ...skills to build, test, and improve AI platform...  ...building or integrating AI/ML or LLM-based components... 
    Full time
    Work at office
    Local area
    Immediate start

    Boston Consulting Group

    Austin, TX
    3 days ago
  • $156.8k - $255.3k

     ...and sellers across the globe. AI is creating new possibilities for...  ...Technical Staff, AI & Agentic Architect within Global Platforms to help...  ...experience architecting and shipping AI/ML or Generative AI systems into...  ...or administer a lie detector test as a condition of employment or... 
    Work at office
    Immediate start
    Remote work
    Visa sponsorship

    eBay

    Austin, TX
    3 days ago
  • $165k - $216.56k

     ...this new era, we seek AI-native thinkers across...  ...mindset — who rapidly test emerging capabilities to...  ...scientists to design and architect AI solutions built on the...  ...of Snowflake’s AI & ML solutions.IN THIS ROLE...  ...GCP, etc.)1+ years of practical Snowflake experience.Knowledge... 

    Snowflake

    Austin, TX
    3 days ago
  • $150k

     ...intersection of people and technology. As a Senior AI Tech Architect, you will collaborate on...  ...as part of BCG Platinion’s Architecture practice, but also open to commercial and private...  ...planning.Next gen capabilities (e.g. AI/ML, IoT, Blockchain) and component technologies... 
    Contract work
    Work at office
    Local area

    The Boston Consulting Group

    Austin, TX
    2 days ago
  • We Are:The AWS Practice is home to our deepest AWS experts and supports Accenture’s more than 1,500 certified AWS architects across the company. Join our team and be among Accenture’s most...  ...and AWS at Accenture here:.You Are:An AI/ML Sr Architect delivering full-stack AI... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Austin, TX
    13 hours ago
  •  ...Skills: 8+ years of experience, AI Architecture, Python, Generative AI, LLMs, RAG, Machine...  ...-grade AI architectures. Define AI/ML strategies, technical roadmaps, and...  ...databases, and cloud platforms. Establish best practices for AI governance, security, responsible... 
    Contract work

    Dutech Systems, inc

    Austin, TX
    3 days ago
  •  ...healthcare and scientific discovery to powering AI and the technologies people rely on every...  ..., memory, and system interfaces.Build, test, and deliver high-quality firmware...  ...and promote effective firmware-development practices.PREFERRED EXPERIENCE:Expert-level embedded... 

    AMD

    Austin, TX
    4 days ago
  • $199.75k - $258.5k

     ...siteSchedule: Full timePosted: 2026-10-29SUMMARYSenior Principal AI Performance Architect Dell's Client Product Group (CPG) is looking for a Senior...  ...is committed to fair and equitable compensation practices. The salary range for this position Is $199,750 - $258,500... 
    Shift work

    Dell Technologies

    Austin, TX
    2 days ago
  • $190k

     ...intersection of people and technology. As a Lead AI Tech Architect, you will collaborate on...  ...as part of BCG Platinion’s Architecture practice, but also open to commercial and private...  ...planning. ~ Next gen capabilities (e.g. AI/ML, IoT, Blockchain) and component technologies... 
    Full time
    Contract work
    Work at office
    Local area

    Boston Consulting Group

    Austin, TX
    9 hours ago
  •  ...world are equally as important to us.Job descriptionOverviewThe AI Architect will lead the strategy, architecture, governance, and adoption...  ...platforms.• 7+ years of experience designing and delivering AI/ML, Generative AI, or Agentic AI solutions.• Deep expertise with Microsoft... 
    Full time
    Remote work
    Flexible hours

    Hitachi

    Austin, TX
    2 days ago
  •  ...entering a transformative era where Data & AI are reshaping industries, work, and...  ...defining solutions. You Are: As an Advanced AI Architect, you will be responsible for designing and...  ...engineering & operationalizing large scale AI/ML solutions on at least one of the large... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Austin, TX
    13 hours ago
  • $8.88k

     ...W-2Company: SRI Tech SolutionsAgentic AI Architect Location: Austin, TXJob Description - AI...  ...and lifecycle managementAgent hardening, testing, and evaluationGovernance and...  ...APIsEngineering Excellence· Ensure best practices in:o Code quality, scalability, and performanceCI... 
    Hourly pay
    Full time

    SRI Tech

    Austin, TX
    13 hours ago
  • $148.19k - $198.17k

     ...SalesforceSalesforce is the #1 AI CRM, where humans with agents...  ...01/31/2027.About the RoleOur architect team is organized into four...  ...state and memory, guardrails, testing.MCP & Capability Architecture...  ..., dev lifecycle and quality practices.AI Governance & Security (Governance... 
    Full time
    Remote work

    Salesforce

    Austin, TX
    4 days ago
  • $120k - $217.5k

     ...the RoleWe are seeking an experienced AI System Design Architect (VP) to lead enterprise AI system architecture...  ..., data controls, model risk, testing standards, security requirements, and...  ...architecture, platform architecture, or AI/ML architecture, including leadership of... 
    Full time
    Temporary work
    Flexible hours

    State Street Bank

    Austin, TX
    4 days ago
  •  ...Description Company Description Build the AI that replaces search with conversation....  .... We’re looking for the Principal Architect who will build the intelligence behind...  ...our organization. Not interested in best practices, lets build something better! Ability to... 
    Worldwide
    Shift work

    Travoom

    Austin, TX
    24 days ago
  •  ...The Principal AI Search & Conversation Architect will be responsible for designing and leading the architecture of a next-generation conversational...  ...support new ideas to our organization. Not interested in best practices lets build something better! Ability to adapt. An... 
    Full time
    Remote work
    Shift work

    Travoom

    Austin, TX
    23 days ago
  •  ...business architecture that disrupts conventional practices. Our expertise spans 40+ industries across...  ...into reality.We are Secure, Responsible AI & Data Protection professionals who enable...  ...AI-enabled operationsDesign, set-up, and test prototype and production secure AI... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Austin, TX
    13 hours ago
  •  ...AI Architect Austin, TX Contract Primary Expertise with LLM-based analysis and design is strongly desirable. Googles Vertex AI for...  ..., Rabbit MQ, SQL Server) Define BDD scenarios for automated testing using Gherkin syntax Create domain models and bounded contexts... 
    Contract work

    E-Solutions

    Austin, TX
    3 days ago
  • $121k - $173k

     ...to meet you. WHAT YOULL DO As an AI Architect you will accelerate adoption of BrazeAI...  ...add-ons Demonstrate and document best practices playbooks and AI solutions recipes to...  ...including prompt design guardrails evaluation testing and optimization. You have experience... 
    Full time
    Work at office
    Local area
    Flexible hours

    Braze

    Austin, TX
    5 days ago
  •  ...healthcare and scientific discovery to powering AI and the technologies people rely on every...  ...ROLE We are seeking an experienced SoC Architect to define next-generation SoCs for...  ...with depth in one or more areas such as AI/ML, automotive, robotics, multimedia/imaging,... 
    Full time
    Local area
    Night shift

    AMD

    Austin, TX
    3 days ago
  •  ...OleOle is seeking an exceptional hands-on Principal AI Architect to lead the architecture development deployment and ongoing evolution...  ...support new ideas to our organization. Not interested in best practices lets build something better! Ability to adapt. An ideal candidate... 
    Full time
    Remote work
    Shift work

    Travoom

    Austin, TX
    7 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Practice Architect AI/ML Test. Be the first to apply!