Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead AI Ops Engineer

Full-time

Mastercard

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary

Lead AI Ops Engineer

AI Ops

Overview:
Mastercard's Operational Intelligence team is building the next generation of data products and AI solutions that help customers access and use operational insights in new ways. As AI agents move from POC to production, their behavior keeps changing in real time: the context they retrieve, the skills they select, how they resolve exceptions. These agents are never really “finished.” They keep learning from production outcomes, so their reliability, safety, and trustworthiness need to be actively operated, not just monitored. That is the job of AI Ops: making sure each agent’s reasoning stays correct, its context stays current, and its behavior stays governed as it learns.

Role:
• Own end to end production monitoring for one or more AI agents, tracking key metrics, KPIs, accuracy, latency, SLA breaches, guardrail triggers, and out of scope rates through dedicated observability dashboards
• Serve as L1/L2 production support, providing first response monitoring, triage, and escalation to tech teams as new agentic services go live
• Identify and diagnose issues by monitoring eval scores and drift alerts, inspecting failing traces and patterns, and classifying root causes such as intent, tool, parameter, or hallucination errors
• Evaluate whether the agent’s reasoning remains correct in production, checking whether context retrieval stays current, whether resolutions match ground truth, and whether the learning loop is drifting
• Monitor and manage post production reliability, including API and authentication failures and issues originating from external AI endpoints, to protect revenue generating, client facing agents
• Partner with AI Engineering to prioritize fixes, run experiments on prompts, context, and routing in Dev, and validate improvements via evals before handing off proven changes for deployment
• Embed governance within the agent’s learning loop so that approval workflows and audit logging travel with every production change, rather than being added after the fact

All About You:
• Experience monitoring or operating production AI/ML or agentic systems, including observability, evaluation, and drift detection practices
• Strong analytical skills to diagnose root causes across intent classification, tool selection, parameter errors, and hallucination patterns
• Understanding of AI/LLM observability concepts such as tracing, telemetry, guardrails, and evaluation engineering including benchmarks, automated evals, human review, and regression testing
• Familiarity with governance, compliance, and responsible AI practices such as PII detection, access control, audit logging, and policy enforcement is a plus
• Ability to work independently alongside existing Tech teams while owning a dedicated agent’s post launch health
• Excellent communication skills to translate production signals into clear, prioritized asks for AI Product and AI Engineering teams
• Comfort working in a fast evolving environment where the process itself, not just the throughput, is what is being continuously operated on and improved Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

  • Abide by Mastercard’s security policies and practices;

  • Ensure the confidentiality and integrity of the information being accessed;

  • Report any suspected information security violation or breach, and

  • Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead AI Ops Engineer in India vacancy
  •  ...realize their greatest potential. Title and Summary Manager AI Engineering Mastercard's Business & Market Insights (B&MI) group empowers...  ...and sustained competitive advantage. We are looking for a Lead Engineer, Generative AI & ML Engineering for the Operational... 
    Suggested
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...and governments realize their greatest potential. Title and Summary Senior AI Data Engineer Overview As a Senior AI Data Engineer within Mastercard's AI Center of Excellence, you will lead the design, development, and optimization of enterprise data platforms and... 
    Suggested
    Full time
    Worldwide

    Mastercard

    India
    a month ago
  •  ...We're looking for an experienced Organic Growth Lead to drive user acquisition through SEO, ASO, and emerging AI search channels. You will own the complete organic...  ...content strategy to app store optimization and Answer Engine Optimization (AEO). The ideal candidate has a... 
    Suggested
    Full time

    Delta Exchange

    India
    10 days ago
  •  ...governments realize their greatest potential. Title and Summary Lead Technical Program Management (Governance & Alignment)...  ...through data-driven insights, while serving as a trusted partner to engineering, product, and leadership teams. You will act as the connective... 
    Suggested
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...Role Purpose The Credit Lead will be responsible for driving prudent credit underwriting, portfolio quality, and TAT management for LAP proposals within the SME business. The role involves evaluating borrower creditworthiness, assessing business and property risks, ensuring... 
    Suggested
    Full time

    DBS Bank Ltd

    India
    10 days ago
  •  ...GGV and several others. Team: Product Engineering (Frontend) Duration: 1 year Work Mode:...  ...showcasing UI work Exposure to relevant AI tools (e.g., GitHub Copilot, Claude,...  ...for their contributions. We offer industry-leading compensation, along with generous equity.... 
    Full time
    Internship
    Work at office
    Work from home
    Flexible hours
    3 days per week

    Merkle Science

    India
    8 days ago
  •  ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Software Engineer I Job Overview: Contribute to application development and support through programming, analysis, design, development and delivery... 
    Full time
    Work experience placement
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...and governments realize their greatest potential. Title and Summary Senior Software Engineer Job Description Summary Overview Mastercard® Global Data Repository—a leading technology repository that houses enhanced information (daily transactions from MasterCard... 
    Full time
    Worldwide
    Shift work

    Mastercard

    India
    11 days ago
  •  ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior software engineer Role Senior Software Engineer - Cardholder Services (Global Benefits) Mastercard is seeking talented individuals to join... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...realize their greatest potential. Title and Summary Software Engineer II – Integrations & API Connectivity Overview Mastercard is...  ...observability, secure development • Plus: Java / Spring Boot, AI-assisted tools (e.g., GitHub Copilot) What You Bring - Required... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Software Engineer II Overview • Strong C++ and Java programming skills • Analyze code review reports and development quality to make sure best... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...their greatest potential. Title and Summary Senior Software Engineer Overview Be part of the Operations & Technology Fraud Products...  ...and availability. • Would you like to develop industry leading solutions for fighting fraud? • Are you motivated by speeding... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...connective tissue empowering clients with seamless navigation through the ever- evolving cryptocurrency landscape. Senior Software Engineer - Risk Location: Bengaluru (Onsite) Impact You’ll architect and build the next-generation risk solutions for FalconX and its... 
    Full time
    Local area

    Falconx

    India
    10 days ago
  •  ...their greatest potential. Title and Summary Senior Software Engineer Who is Mastercard? We are the global technology company behind...  ...from their data. Our next generation platform blends industry-leading analytics, advanced software architecture, and the latest web... 
    Full time
    Work at office
    Worldwide
    Flexible hours

    Mastercard

    India
    10 days ago
  •  ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Software Engineer Overview-Mastercard Send Software Product Development Team is developing products to displace cash by creating simpler and more... 
    Full time
    Work experience placement
    Worldwide

    Mastercard

    India
    11 days ago
  •  ...realize their greatest potential. Title and Summary Software Engineer II Our Purpose We work to connect and power an inclusive,...  ...NoSql databases, Hibernate, use of software development tools, AI pair programming. Familiar with DevOps and IT Operations best practices... 
    Full time
    Work experience placement
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...greatest potential. Title and Summary Software Engineer II Overview Responsible for...  ..., deployment, and production support. • Lead troubleshooting, root cause analysis, and...  ...Application Performance Monitoring (APM) • AI-Assisted Development: AI Coding Assistants... 
    Full time
    Worldwide

    Mastercard

    India
    11 days ago
  •  ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Software Engineer About Ethoca Ethoca, a Mastercard company, is a global collaboration-based technology services provider that connects... 
    Full time
    Worldwide
    Shift work

    Mastercard

    India
    10 days ago
  •  ...potential. Title and Summary Senior Software Engineer Senior Software Engineer Overview:...  ...team to handle : Quality Engineer Lead and mentor QA teams to design, develop,...  ...Financial services or payments domain experience.AI-assisted testing and test automation... 
    Full time
    Work experience placement
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...realize their greatest potential. Title and Summary Software Engineer - 1 Job Description Summary Overview • The Decision Management...  ...business agility. • This program leverages business rules & AI engines, a streaming big data cluster, an in memory data grids,... 
    Full time
    Work at office
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...realize their greatest potential. Title and Summary Senior Software Engineer Overview Mastercard is a global technology company in the...  ...technical expertise, end-to-end ownership, and the ability to lead complex engineering initiatives across architecture, development... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...realize their greatest potential. Title and Summary Software Engineer II Overview Cross Border Services enables banks in their...  ...individual contributor with advanced knowledge within discipline, leading a segment initiative 2) Develops applications, system to... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Software Engineer Job Title: Sr. Software Development Engineer Overview: MasterCard is seeking talented individuals to join our core... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...and services that help people, businesses and governments realize their greatest potential. Title and Summary Job Title Software Engineer II Job Description Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is... 
    Full time
    Worldwide

    Mastercard

    India
    7 days ago
  •  ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Software Engineer Job Summary: ============================= Providing Innovative, Secure, and Reliable Switching Solutions is the lifeblood... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...Travelopia is a leading conglomerate in the specialist Travel industry, consisting of outstanding experiential travel brands. Our goal...  ...and deliver value through advanced analytics, visualization, and AI-driven solutions. What We Offer Competitive base salary INR... 
    Full time
    Worldwide
    Flexible hours
    India
    a month ago
  •  ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Software Engineer Job Title: Lead Software Engineer Who is Mastercard? Mastercard is a global technology company in the payments... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...their greatest potential. Title and Summary Principal Software Engineer Who is Mastercard Mastercard is a global technology...  ...teams, and Scrum Masters in Lean-Agile practices and mindsets. Leads by provided coaching and frameworks for backlog definition and... 
    Full time
    Worldwide

    Mastercard

    India
    10 days ago
  •  ...governments realize their greatest potential. Title and Summary Lead Software Engineer Overview: Mastercard’s Enterprise and Credit Risk team...  ...mentoring engineers, guiding them on modern technologies and AI-driven capabilities, and promoting a culture of innovation,... 
    Full time
    Worldwide
    3 days per week

    Mastercard

    India
    10 days ago
  •  ...governments realize their greatest potential. Title and Summary Lead Software Engineer Who is Mastercard? We work to connect and power an...  ...experience on Java, spring. • Must have hands-on experience on AI based development, GitHub copilot, Claude code. • Must have... 
    Full time
    Temporary work
    Worldwide

    Mastercard

    India
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AI Ops Engineer. Be the first to apply!