Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Engineer - AI Platform & Operations

$168k - $230k
Full-time

Serko Ltd

Role Description

We are looking for a Principal Engineer to serve as the technical expert for our AI Platform & Operations. This isn’t just a role about maintaining infrastructure; it’s about owning the technical vision for the foundational systems that will power every AI product team across the company.

Remote Role - can be based in either Washington or California State.

By building robust, self-serve internal developer platforms, you’ll enable our engineers to deploy, monitor, and scale AI models with unprecedented efficiency and safety. Your work ensures that our "Agentic" future is reliable, cost-effective, and cutting-edge.

What You’ll Be Doing

  • Architect the Future: Define the long-term technical roadmap for our AI platform, covering everything from model serving and feature stores to experiment tracking and CI/CD for ML.
  • Set the Gold Standard: Establish engineering benchmarks for deployment, versioning, A/B testing, and automated rollbacks.
  • Optimize & Scale: Lead strategies for GPU/compute efficiency and cost optimization while managing the complexities of LLM inference (quantization, batching, and latency) at scale.
  • Enhance Observability: Design sophisticated monitoring and alerting systems specifically tailored for AI workloads in production.
  • Champion Reliability: Drive platform stability and partner with application teams to ensure our infrastructure meets evolving product needs.
  • Technical Leadership: Mentor Senior engineers, lead architecture reviews, and evaluate the next generation of cloud services and ML frameworks.

Qualifications

  • Senior Expertise: 12+ years of engineering experience, with at least 4 years at a Principal or Distinguished level.
  • ML Infrastructure Mastery: Expert-level knowledge of model serving (e.g., Triton, vLLM, Ray Serve) and deep experience with Kubernetes and cloud ecosystems (AWS/GCP/Azure).
  • The MLOps Toolkit: Proven experience with tools like MLflow, Weights & Biases, or Kubeflow.
  • Coding & Systems: High proficiency in Python and a "systems-thinking" approach to Docker, Helm, and containerization.
  • AI Specialization: Hands-on experience operating LLM inference at scale and a deep understanding of the trade-offs between throughput and latency.
  • Platform Mindset: A track record of building internal platforms that treat other engineers as the primary customer, drastically improving engineering velocity.

Benefits

  • A competitive base pay
  • Medical Benefits
  • Discretionary incentive plan based on individual and company performance
  • Focus on development: Access to a learning & development platform and opportunity for you to own your career pathways
  • Flexible work policy

The pay range is between $168,000 - $230,000 USD as a base salary offering annually.

Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Principal Engineer - AI Platform & Operations in Remote vacancy
  •  ...United StatesProducts - Engineering /Fulltime /HybridOver 5...  ....JOB DESCRIPTION Sr. Principal Engineer/ Principal Engineer - Cloud Platform Reports To: Director of...  ...visualization, monitoring, or IT operations platforms. Experience...  ...intelligence (AI) tools to support parts... 
    Operations
    Full time
    Remote work
    Flexible hours

    Extreme Networks, Inc.

    San Jose, CA
    1 day ago
  •  ...offering comprehensive engineering, supply chain, and...  ...VJob Posting Title: Sr. Principal Product Engineer - Cloud...  ...of Advanced Compute Platform NPI and manufacturing...  ...for new and sustaining AI/ML and GPGPU and hardware...  ...customer and Jabil operational teams towards the successful... 
    Operations
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Worldwide

    Jabil Circuit

    Austin, TX
    4 days ago
  • $176.8k - $221k

     ...decisions and gain control of their operations. And we don’t stop there: we’re...  ...growing Fintech CompanyAs a Principal Partner Solution Engineer for our Partner Embed Platform, you’ll play a pivotal role in...  ..., including generative AI, during live interviews or assessments... 
    Operations
    Temporary work
    Work at office
    Remote work
    Flexible hours

    Bill.Com

    Draper, UT
    4 days ago
  • $159k - $305k

     ...The Principal Engineer will lead the design and implementation of foundational...  ..., security guardrails, and platform automation capabilities....  ...engineering excellence and operational maturity. Establish engineering...  ...future expansion into AI/ML platform capabilities including... 
    Operations
    Full time
    Work experience placement
    Remote work
    Relocation package

    Wells Fargo

    Irving, TX
    1 day ago
  • $225k - $325k

     ...About the Role Core Platform is a platform team. Our...  ...Charlie Health's other engineering teams, and our job is...  ...depend on. As the Principal Platform Engineer on Core...  ...every human and every AI agent, and the real-...  ...Design, build, and operate the centralized event... 
    Operations
    Full time
    Contract work
    Work at office
    Local area
    Remote work

    Charlie Health Engineering, Product & Design

    New York, NY
    6 days ago
  • $227k - $272k

     ...transition. From MetaMask, the platform trusted by tens of millions...  ...experience and automated operations. MetaMask Mobile (iOS &...  ...where it matters. As a Principal Mobile Engineer, you’ll be the most senior...  ...release workflows. Build an AI‑enabled platform Integrate... 
    Operations
    Full time
    Local area
    Remote work
    Worldwide
    Shift work

    Consensys

    Remote
    29 days ago
  • Role Description We are seeking a Principal Engineer, Data Platforms to serve as the senior technical authority...  ...observability, security, and operational telemetry data. The Principal Engineer...  ...) coupled with knowledge of AI/ML enablement, advanced analytical workloads... 
    Operations
    Full time

    CVS Health

    Remote
    8 days ago
  • $116k - $205.2k

    Release Train Engineer - BA07CERelease Train Engineer - BA06BEWe’re...  ...Director, Release Train Engineer - Platform Delivery leads scaled Agile...  ..., application, product, operations, security and business leaders...  ...extraction, validation, HITL, AI/ML, or downstream... 
    Operations
    Full time
    Temporary work
    Work at office
    Remote work

    The Hartford Financial Services Group

    Hartford, CT
    2 days ago
  •  ...details.Director, Distinguished Engineer, Enterprise AI PlatformsPosition...  ...building the foundational AI platforms, data and knowledge capabilities...  ...enterprise. The Director, Principal AI Platform Architect /...  ...with AI Governance, Operational Risk, Model Risk, Compliance... 
    Operations
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    3 days ago
  •  ...Principal Platform Engineer AI is collapsing the cost of building software, and Ralliant intends to lead, not follow. We're building a shared platform that reinvents how our operating companies create and ship software, starting with an AI-first approach to developer... 
    Operations
    Local area
    Remote work

    GEMS INC

    United States
    8 hours ago
  • $220k - $300k

    Front is the customer operations platform built for B2B complexity, keeping every team, tool, and...  ...Front to run their customer operations. AI is reshaping what's possible in this space...  ...group of our strongest applied AI and engineering talent whose work underpins every AI-... 
    Operations
    Work at office
    Immediate start
    Remote work
    Work from home
    Monday to Friday

    FrontApp

    San Francisco, CA
    4 days ago
  • $112.7k - $193.2k

     ...advanced data analytics and AI to cybersecurity, we use innovative...  .... Growing together.Software engineering at Optum Technology applies...  ...to architect, build, and operate scalable, high-impact software...  ...voice, IVR, and conversational platform capabilities. This role... 
    Operations
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    Minneapolis, MN
    1 day ago
  • $118.4k - $219.8k

     ...DescriptionSenior Manager, Software Engineering — Search PlatformOverview of the...  ...engineering team responsible for building, operating, and evolving the shared search platform at Thomson Reuters. This platform...  ...a team culture where AI-assisted development is the default... 
    Operations
    Full time
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Eagan, MN
    3 days ago
  • General Motors seeks a Software Engineering Manager to lead delivery, modernization, and operational excellence for CCA Order Entry and Retail Inventory applications....  ...and align engineering with GM’s Cloud First and AI First direction. You’ll partner with product, architecture... 
    Operations
    Remote job

    General Motors

    Warren, MI
    4 days ago
  • $199k

    About the RoleAs an Engineering Manager on Chime’s Data Platform, leading the Data Storage team, you will own the group...  ...be responsible for building and operating reliable, scalable, and secure...  ...power analytics, experimentation, and AI-driven product experiences across Chime... 
    Operations
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    4 days ago
  •  ...national security enablement with agentic AI. Our platform tightens the loop from observation to...  ...We’re looking for a talented Senior Engineering Manager to lead our AI Platform...  ...product and mission teams use to build, operate, and improve AI-powered capabilities at... 
    Operations
    Full time
    Remote work

    Vannevar

    Remote
    17 days ago
  •  ...steps. Our partner is looking for an Engineering Manager, Fraud & Identity Platform based in the United States....  ...strategy, people leadership, and operational excellence across complex, distributed...  ...scale. You’ll also help shape how AI and risk signals are incorporated... 
    Operations
    Full time
    Remote work
    Flexible hours

    jobgether

    United States
    9 days ago
  •  ...Director of Engineering — AI Native Platforms (IT / OT / Cybersecurity) Austin, TX - Hybrid (2 days a week in office) Context & Impact Lansweeper...  ...leadership role in driving engineering execution, operational excellence, innovation, and organizational growth — while... 
    Operations
    Full time
    Work at office
    Local area
    Remote work
    2 days per week

    Lansweeper

    Austin, TX
    more than 2 months ago
  • $160k - $200k

     ...Principal Platform Engineer  Location: United States (Remote) – must be located within the United States...  ...on strategy while we handle people operations — and this search is no exception....  ...Specialty AWS Certified Generative AI Developer – Professional Experience... 
    Operations
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours

    Purple Squirrel Enterprises

    Baltimore, MD
    15 days ago
  • $154k - $180k

     ...are looking for an experienced Engineering Manager to lead the...  ...partners, and own AP's consumer platform end to end. That means the CMS...  ...challenges. ~ Bring AI-assisted development and agentic...  ...releases, and partner with AP's Operations Command Center on incident... 
    Operations
    Remote work
    Day shift

    Associated Press

    New York, NY
    9 days ago
  • $195.3k - $270.4k

     ...experimentation, and advanced AI to reshape access to credit,...  ...intelligent and deeply human. Our platform runs over one million...  ...The Delivery team enables engineers at Upstart to build, test, and...  ...minimize manual coordination and operational overhead. This includes... 
    Operations
    Full time
    Temporary work
    Summer work
    Remote work
    Work from home

    Upstart

    Remote
    a month ago
  • $122k - $170k

     ...you driven to build and scale platforms that power seamless, end-to-...  ...experiences? The Director, Software Engineering, Customer Experience...  ...architecture strategy, and technical operations across CFA Institute’s...  ...performance tracking.Evaluate AI/ML use cases for content personalization... 
    Operations
    Full time
    Remote work

    CFA Institute

    Charlottesville, VA
    2 days ago
  • $254k - $336k

     ...systems is powered by Lattice OS, an AI‑powered operating system that turns thousands of data streams...  ...Air Dominance and Strike (AD&S) Chief Engineering Team is a driving force behind the...  ...and mission systems. This will be on a platform with design and test heritage as it... 
    Operations
    Full time
    Work experience placement
    Immediate start
    Remote work
    Relocation package

    Anduril Industries

    Costa Mesa, CA
    4 days ago
  • $12 per hour

     ...Narvar Founding CTO (Unicorn, $1B+). 6 AI patents. Enterprise AI pedigree:...  ...to mission-critical infrastructure. Principal Engineer: Platform & Architecture Architect the Platform...  ...Infrastructure of Truth —the AI-native operating system that connects dirt to dollars.... 
    Operations
    Remote job
    Full time
    For contractors
    Weekend work

    Intellus Build

    Remote
    27 days ago
  • Boundless in Seattle is seeking a Head of Engineering to rebuild and lead an AI-native platform for legal services. You will own the engineering vision, mentor...  .... You will partner with product, design, legal and operations to shape a world-class development factory and... 
    Operations
    Remote job

    Trilogy Equity Partners

    Seattle, WA
    1 day ago
  • $148.7k - $201.2k

     ...government agencies, and other organizations operating in locations without reliable...  ...where it will be performed.Leo Production Engineering Platforms (LPEP) is seeking an exceptional Senior...  ...IAM for regulated access, User/Device/AI Identity, and DataHive as the org's single... 
    Operations
    Contract work
    Work at office
    Remote work
    Flexible hours

    Amazon

    Bellevue, WA
    3 days ago
  •  ...Description Job Description Title : Senior Manager, AI Engineering & Platform Location: Overland Park, Kansas (On-site Monday through...  ...are fast, specialized, and relentlessly client‑centric, operating across Hospitality, Real Estate, Private Capital, Benefits... 
    Operations
    Remote work
    Monday to Thursday

    Virtus

    Overland Park, KS
    4 days ago
  •  ...Immigration is hiring a Head of Engineering to reinvent how legal work gets done in the age of AI. We are a remote-first team...  ...engineering org rebuilding our platform and infrastructure from the ground...  ...legal, product, design and operations. #J-18808-Ljbffr Boundless... 
    Operations
    Remote job
    Work at office
    2 days per week

    Boundless Immigration

    Seattle, WA
    4 days ago
  • $20k

     ...Agent OS for the trades: a shared platform that powers role-specific AI experiences across Atlas, field, office...  .... We are looking for a Senior Engineering Manager to lead a small, hands-on AI...  ...can build fast, reason deeply, and operate responsibly in a fast-moving AI environment... 
    Operations
    Full time
    Work at office
    Remote work
    Flexible hours

    ServiceTitan

    Remote
    8 days ago
  • $220k - $275k

     ...for prescription drugs. Our platform aligns incentives so affordability...  ...**As a Director, Software Engineering, you will lead a domain...  ...responsible for customer, partner, and operational portals, with a focus on...  ....* Enthusiasm for leveraging AI-assisted development tools and... 
    Operations
    Permanent employment
    Remote work
    Flexible hours

    Jobleads-US

    Washington DC
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Engineer - AI Platform & Operations. Be the first to apply!