Lead AI OPS Engineer
Full-time
EPAM Systems, Inc.
Role Description
We are building a self-serve Enterprise AI Gateway that standardizes how every team uses large language models with strong governance. As a Lead AI OPS Engineer, you will design automation-first onboarding, controls, and observability for access, cost, and logging across the platform. Join a small, fast-moving team and apply now.
- Design self-service onboarding for teams and agents, from initial request through to functional access
- Automate key provisioning, rotation, and permission updates
- Tune rate limits and quotas as adoption and usage increase
- Deploy and configure models including Vertex AI endpoints, vendor fallbacks, and Model Armor
- Operate MCP servers behind the gateway under the same governance rules as models
- Develop Python extensions that integrate the gateway with other enterprise systems
- Maintain the full platform as code using Terraform, Helm, and Jenkins
- Monitor and protect production health across availability, latency, and cost with alerting
- Assist teams using the platform and convert recurring questions into automation
Qualifications
- Proven 5+ years of experience using Python for automation, extensions, and integrations
- Solid 5+ years of SRE experience with a track record of keeping production systems reliable
- Deep expertise in Kubernetes, preferably on GKE
- Hands-on experience with Google Vertex AI, especially endpoints for model serving and Model Armor
- Practical proficiency with Terraform, Helm, and CI/CD using Jenkins
- Working knowledge of GenAI/Agentic AI concepts (patterns, frameworks, protocols)
- Production exposure to an AI gateway (LiteLLM, EPAM DIAL or similar) is highly appreciated
- Very strong communication skills with the ability to explain platform behavior clearly to teams who use it daily
- English proficiency at B2 level (Upper-Intermediate) or higher
Requirements
- Nice to have familiarity with GCP beyond GKE and Vertex AI, such as BigQuery, Cloud Run, and IAM
- Experience building AI agents, for example using Google's Agent Development Kit (ADK)
- Experience with AWS Bedrock
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Lead AI OPS Engineer in Remote vacancy
$220k - $240k
GovCIO is currently hiring an AI Ops Engineer with an active Secret clearance to implement artificial intelligence and automation capabilities within IT operations to improve monitoring, incident response, predictive analytics, and system reliability. This role is based...SuggestedCurrently hiringRemote work- ...About the role Tapcart has been building a fleet of AI agents that run real work across the company. On the go-to-market side,... ...Management, and Partnerships teams operate. We're looking for an AI Ops Engineer to partner with the Founder/CEO and VP Operations to build out...SuggestedFull time
Tapcart
Remote26 days ago - Role Description The Tech Ops Engineer serves as a force multiplier for operational excellence, combining infrastructure expertise with AI-powered automation to create self-healing, highly observable, and scalable technology systems. This role harnesses machine intelligence...SuggestedFull timeTemporary workWork experience placementFlexible hours
ConsumerAffairs
Remotea month ago - ...Job Title: Senior AI/ML Ops Engineer Location: Cupertino Please share profiles for the below requirement. Need visa independent candidates... ...evaluation coverage to engineering teams and leadership. Lead the triage and resolution of highly complex, critical agent...Suggested
Tech3pillars Technologies
Cupertino, CA2 days ago - ...As AI/ML Ops Engineer , you will own the operational backbone of Blackpoint's AI/ML capability — taking models from training through production deployment and owning the full AI/ML loop across every pipeline the team runs at scale. You will be instrumental in building...SuggestedFull time
Blackpoint Cyber
Remote14 days ago $87.95k - $162.88k
...Senior AI DevOps Engineer (AI Ops / Platform Engineering)NTT DATA strives to hire exceptional, innovative and passionate individuals who want... ...mentality from design through production support.Comfortable leading technical initiatives and mentoring engineering teams on...Temporary workWork at officeRemote workFlexible hours3 days per weekNTT DATA
Atlanta, GA3 days ago$215k - $260k
Role Description AI Ops Engineering is the platform engineering team within the Value Creation Team (VCT), partnering with Vista companies... ...Comprehensive benefits package. Company Description Vista is a leading global investment firm that invests exclusively in...Vista Equity Partners Management
Remotea month ago$140k - $165k
...shape a brighter way forward. Regional OP/MAC Lead We are seeking an Regional OP/MAC Lead to... ...as well as support vendors (architects, engineers, furniture, etc.) that may be required from... ...the power of artificial intelligence (AI) to efficiently accelerate meaningful...Full timeLocal areaRelocation$112.8k - $257k
AI Gateway Security Engineer, LeadThe Opportunity:Designs, deploys, integrates, and maintains enterprise AI gateway capabilities across complex, multi-cloud and federal environments. Leads implementation of AI security controls, including guardrails, policy enforcement...Full timeContract workPart timeWork at officeLocal areaRemote work$128.7k - $292k
Enterprise Agentic AI Engineer, LeadThe Opportunity: As an experienced engineer, you know that agentic AI is transforming how organizations... ...adoption, and enabling measurable business impact.You will lead complex workstreams spanning agentic AI prototyping, business process...Full timeContract workPart timeWork at officeLocal areaRemote workShift work- United States Digital Space LLC is seeking an AI-native Customer Operations Engineer to design and own agent-based support, onboarding, and success workflows. You will deploy AI agents alongside customers, ensuring rapid feedback and continuous improvement through data...Remote job
$112.8k - $257k
AI and ML Engineer, LeadThe Opportunity:Design and implement effective AI solution architecture or strategy utilizing approaches of various... ...strategies, business goals, and key ethical considerations. Apply leading-edge principles, theories, and concepts and contribute to...Full timeContract workPart timeWork at officeLocal areaRemote work$128.7k - $292k
Frontier AI Research Engineer, LeadThe Opportunity:Frontier Research operates at the edge of what’s possible to convert breakthrough capabilities... ...directions, and transformational business opportunities.The Lead Engineer is a senior technical builder who drives the...Full timeContract workPart timeWork at officeLocal areaRemote work$190k - $225k
Role Description The Principal AIOps Engineer will build the platform that makes AI cheap, fast, safe, and observable at RxSense. As a direct report to the Director of AI Engineering, this role will own the infrastructure that every AI-powered product at RxSense depends...Full timeContract workRxSense
Remotea month ago- ...Saviynt's AI-powered identity platform manages and governs human and non-human access... ...solutions that protect and empower the world’s leading brands, Fortune 500 companies and... ...We’re looking for a Marketing AI Agent Engineer to help build, configure, and scale AI-powered...Full time
Saviynt
Remotea month ago - AFL Telecommunications, LLC is looking for a Lead AI Engineer to join its Business Operations team. This role may be hybrid or remote from anywhere within the United States. The successful candidate will establish architectural standards and own solutions throughout their...Remote job
- ...goal is to build the next generation of AI: autonomous agents that can reason, plan,... ...solve critical problems for an industry leading financial institution. We are looking for... ...into measurable outcomes, while raising engineering and scientific standards across the team....
- Oklahoma City Thunder seeks an Applied AI Engineer Intern for Basketball Operations. This remote, paid internship involves building and deploying AI models to support strategic planning, player evaluation, analytics, and performance insights. You will work with data sources...Remote jobInternship
$96.8k - $145.2k
...employees, and those they serve.You’ll have opportunities to learn and lead in a forward-thinking environment, defining your path to a... ...an impact every day at Zebra.What We're Looking For:The Cloud AI Engineer, Lead plays a critical role in driving innovation across Zebra’...Full timeSummer workWork at officeLocal areaFlexible hoursNight shift3 days per week$117.5k - $176.3k
...opportunity for a Sr Principal Systems Administrator - Global Ops Shift Lead (26-380) to join our team of skilled and diverse... ...applicable.A Bachelor’s Degree in Computer Science, Software Engineering, Systems Engineering, Aerospace Engineering, Computer Engineering...Full timeWork experience placementRemote workRelocationFlexible hoursShift workNight shift- ...for early career talent. You will build and improve parts of an AI agent runtime, extend tools, and contribute to evaluation, observability... ...across async/services, with mentorship from senior BE/DS engineers and ownership of tasks from end to end. #J-18808-Ljbffr United...Remote jobInternship
$110k - $120k
...Financial Services Job Category: Information Technology - Developer Summary: We are seeking a highly skilled and motivated Generative AI Engineer with at least two years of experience in the field of artificial intelligence. The ideal candidate should have a solid background...Full timeRelocation package- Managed Health Care Associates, Inc. is seeking an AI Solution Engineer to lead the agentic transformation within the Solution Engineering department. You will build tooling, establish secure CI/CD pipelines, and align agentic workflows with Azure-native platforms while...Remote job
- ...About the role Tapcart has been building a fleet of AI agents that run real work across the company. On the go-to-market side,... ...Management, and Partnerships teams operate. We're looking for an AI Ops Engineer to partner with the Founder/CEO and VP Operations to build out...Full time
Tapcart
Remote25 days ago $90k - $110k
...landscape and deliver exceptional results. Role Overview The Brand Lead is the strategic and operational owner of a portfolio of brands... ...~ Partner cross-functionally with internal teams (ads, live, ops, finance, leadership) to unblock issues and drive results...Full timeWork at officeRemote workFlexible hoursSuperOrdinary Talent LLC
West Hollywood, CAa month ago$59.6k - $85.1k
...Candidates must be able to work on-site five days per week during designated work hours. Position Overview The Lead Client Services Ops provides operational initiative, guidance and support across a Client Services Team of Account Managers, enabling outstanding...Work at officeLocal areaRemote workWorldwidePaylocity
Lake Mary, FL5 days ago$180k - $250k
Our client, an early-stage AI startup, are hiring a Founding Applied AI Engineer to join their team in New York. The successful candidate will design and build the intelligence layer that powers the company’s personalisation, recommendation systems and external APIs, including...Full timeAlldus International Consulting Ltd
New York, NYmore than 2 months ago- ...are our People First culture, customers, quality, shareholders, integrity, and corporate responsibility. Overview of the Visual/Ops Lead Role You will provide daily support to the management team by performing opening and closing routines, providing supervision to ensure...Full timePart timeSeasonal workHome officeMonday to FridayFlexible hoursShift workWeekend work
- Zipline, the world's leading autonomous drone logistics company, seeks a Fleet Ops Lead to manage remote flight operations from our South San Francisco facility. You will oversee live flights, make rapid decisions, and support the Flight Operations Manager while performing...Remote work
- ...partners as we bring markets online. The role focuses on coordinating handoffs, tracking PTO progress, building dashboards, and removing blockers. You will work across Deployments, Field Ops, and Partnerships to move deals from signed to PTO. #J-18808-Ljbffr Base Power
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AI OPS Engineer. Be the first to apply!
Related searches