Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Systems Engineer - DevOps& Observability Manager

$150.7k - $251.2k

EY

Location: Anywhere in Country At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. The opportunity We are seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. These are the systems that ship, run, and make fully visible every AI workload. Within the Hybrid AI Multi-Environment Runtime (HAI), this role owns how AI services and agents are built and deployed, how models execute, how requests are routed to them, how AI assets are catalogued and governed, how consumption is measured and bounded, and how the entire platform is observed across cloud, on-prem, edge, and air-gapped environments. This is a distinct discipline from platform, data, and trust engineering. Where Platform Engineering owns the cluster substrate and its infrastructure automation, this role owns the delivery and runtime surface, including the CI/CD/CV pipelines that ship AI workloads, secure model execution, semantic routing, and model/prompt selection, together with the governance, discovery, cost, and telemetry systems that keep AI workloads shippable, economical, discoverable, and transparent. It sits at the intersection of DevOps, MLOps, FinOps, and observability. This role is ideal for an engineer who is equally comfortable building automated delivery pipelines, operating high-performance inference (GPUs, model servers, sandboxed execution), and building deep observability and cost visibility; who understands that in regulated contexts every AI workload must be delivered repeatably and every AI request must be economically bounded, attributable, and traceable end-to-end. Your key responsibilities Own DevOps and delivery for AI workloads: build and operate the CI/CD/CV pipelines that ship AI services, agents, and runtime components, including automated build, test, continuous verification, release, and rollback, so AI workloads are delivered repeatably and safely into every environment. Own governance and discovery for AI assets, including service catalog/registry (Artifactory/Nexus, Harbor), experiment tracking and model metadata (MLflow), upstream registries/mirrors (HuggingFace/NGC), CVE/SBOM scanning (Trivy), lineage contracts (OpenLineage), and license management. Own resource and cost management, including quotas and rate limits, cost attribution and utilization (Apptio/OpenCost/Kubecost), so AI execution stays economically bounded and controllable per tenant and engagement. Own the full observability stack, including metrics (Prometheus/Mimir), logs (Loki), traces (Tempo/Jaeger), dashboards (Grafana), LLM debugging and evaluation (LangSmith/Langfuse), and SLA/alert notifications. Own the OpenTelemetry collection layer, including multi-tenant receiver, exporters and queues (Kafka sink), DCGM exporter for GPU telemetry, processor batching, and dynamic filtering, so every signal is captured and routed reliably. Automate GitOps-based delivery and continuous verification; embedding quality, integrity, and cost gates into pipelines so releases are policy-compliant by default rather than by manual review. Close the loop between delivery and observability by using telemetry, evaluation, and cost signals to drive deployment decisions, progressive rollout, and automated rollback of AI workloads. Ensure cost and telemetry are identity-stamped and per-tenant, so consumption and behavior are attributable end-to-end, keeping FinOps and observability tied to the workloads that generate the load. Skills and attributes for success Strong DevOps expertise: CI/CD/CV pipeline design, GitOps, continuous verification, and progressive/automated release and rollback for production workloads. Deep expertise operating model-serving and inference systems (Ray, vLLM/Triton/NIM) on GPUs at production scale. Deep observability skills: metrics, logs, traces, and OpenTelemetry. FinOps mindset: able to attribute, bound, and optimize AI consumption cost per tenant and workload. Familiarity with model/artifact governance, registries, CVE scanning, and license/lineage tracking. Comfortable operating across cloud, on-prem, edge, and air-gapped environments with consistent runtime and telemetry semantics. Strong communicator able to explain runtime, cost, and observability tradeoffs to engineers, architects, and leadership. To qualify you must have Bachelor’s or Master’s degree in Computer Science or related technical field. 8+ years in DevOps, MLOps, platform, or observability engineering, with hands-on production ownership of AI or high-throughput services. Strong hands-on DevOps experience, including CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI, or equivalents) for automated build, test, release, and rollback. Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure. Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry. Experience with API gateways and request routing (Envoy or equivalent), including streaming responses. Experience with cost management / FinOps tooling (OpenCost, Kubecost, or equivalent) and quota/rate-limit enforcement. Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy/SBOM). Proven track record operating AI or service infrastructure under compliance, security, or regulatory constraints. Ability to define clean ownership boundaries and consumption contracts with platform, trust, and data teams. Ideally, you’ll also have Experience with LLM evaluation and debugging tooling (LangSmith, Langfuse) and prompt/response quality measurement. Experience with sandboxed/secure execution (gVisor, Firecracker, or microVM isolation) for untrusted or multi-tenant workloads. Familiarity with GPU telemetry (DCGM) and GPU utilization optimization. Experience with lineage and governance contracts (OpenLineage) and AI license management. Exposure to multi-tenant cost attribution and per-tenant SLA/alerting. Exposure to regulated delivery environments (financial services, tax, healthcare, risk). What we offer you At EY, we harness our collective strength to empower you to shape your future with confidence through professional growth, personal fulfillment and an inclusive culture. Learn more at ey.com/us/careers. We offer a comprehensive compensation and benefits package where you’ll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job is: New York City, Boston, and Washington DC Metro Areas, Washington State, and Southern California offices – $150,700 to $251,200 Bay Area California offices – $157,100 to $261,600 All other offices locations in the US, including Sacramento – $125,500 to $230,200 Individual salaries within these ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. Are you ready to shape your future with confidence? Apply today. To make the most of your application experience, please limit yourself to two applications within a six-month period. EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information. At EY, our values set the foundation for how we work and the behaviors we expect of our people. Any misrepresentation or falsification of information or lack of integrity at any point in the recruiting process may result in withdrawal of your candidacy, revocation of an offer or immediate termination of employment. EY | Building a better working world EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories. All in to shape the future with confidence. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at View email address on click.appcast.io . EY

Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the AI Systems Engineer - DevOps& Observability Manager in Olympia, WA vacancy
  • $184k - $287.5k

    AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our...  ...building and operating incident-management processes with internally built...  ...building and operating modern observability platforms to deliver scalable metrics... 
    Suggested
    Full time
    Remote work

    Nvidia

    Olympia, WA
    18 hours ago
  • $96.3k - $123.84k

     ...advantage. This function manages analytic data...  ...integrating multiple systems. Job Overview We are...  ...seeking a product-oriented AI/ML Engineer who partners with...  ...Actions, GitLab, Azure DevOps, Jenkins, Harness,...  ...deployment, monitoring, observability, and governance.... 
    Suggested
    Full time
    Temporary work
    Local area
    Immediate start
    Flexible hours

    Cardinal Health

    Olympia, WA
    1 day ago
  • $152k - $241.5k

    Sr Software Engineer - Distributed Systems Engineer, EDA InfrastructureNVIDIA is hiring...  ...platform services that manage large fleets of GPU-based...  ...infrastructure management systems, and observability platforms.Use hardware...  ...vacancy. NVIDIA uses AI tools in its recruiting... 
    Suggested
    Full time
    Remote work

    Nvidia

    Olympia, WA
    18 hours ago
  • $255.5k

     ...DescriptionThomson Reuters is looking for a Senior Legal AI Engineer to lead pre-sales engagements of Thomson...  ..., strategic relationships with managing partners, practice group leaders, and...  ..., a partner technology, a customer system integration, or custom development, and... 
    Suggested
    Full time
    Local area
    Flexible hours

    Thomson Reuters

    Olympia, WA
    4 days ago
  • $125.3k - $178.9k

     ...organization's software systems in a cross-functional...  ...processes and good engineering practices. This job family...  ...are seeking a Workday AI Solutions Engineer to...  ...for employees, managers, and HR teams. Evaluate...  ...in-the-loop controls, observability, and AI governance preferred... 
    Suggested
    Full time
    Temporary work
    Local area
    Immediate start
    Flexible hours

    Cardinal Health

    Olympia, WA
    18 hours ago
  • $128.4k - $192.5k

     ...The opportunity Our AI, Data & Engineering team helps apply...  ...generative AI, and agentic systems on Databricks that...  ...capabilities, managing roadmaps and backlogs...  ...Platform Engineers, DevOps to implement and sustain...  ..., including observability, monitoring, reporting... 
    Full time
    Work experience placement
    Immediate start
    Remote work

    EY

    Olympia, WA
    1 day ago
  • Forward Deployed AI/ML Engineer IV Anywhere Type: Permanent Category: Data Industry: Energy...  ...operational problems, then build and ship the systems that solve them. You will deliver...  ...about AI capabilities and limitations. Manage scope, timeline, and expectations against... 
    Hourly pay
    Permanent employment
    Full time
    Local area
    Remote work

    Eliassen Group

    Olympia, WA
    1 day ago
  • $81.1k - $187k

     ...Server and Linux systems in production and...  ...identity, access management, and environment...  ...Information Technology, Engineering, or a related...  ...operations, DevOps, cloud operations...  ...centralized logging, and observability practices....  ...saving care. And with AI embedded across... 
    Temporary work
    Flexible hours

    Oracle

    Olympia, WA
    2 days ago
  •  ...combines responsible AI with clinical,...  ...hiring a Full Stack Engineer whose center of...  ...architecture, design systems, accessibility,...  ...product, UX, and DevOps to ship customer-delighting...  ..., state management, routing, and shared...  ...logging, and front-end observability that tells you... 
    Full time
    Work experience placement
    Live in
    Remote work
    Visa sponsorship
    Night shift

    Lyric

    Olympia, WA
    2 days ago
  •  ...combines responsible AI with clinical, payment...  ...position. The Software Engineer Intern will join Lyric...  ...Learn how observability, structured logging, monitoring...  ...Engineering, Product, UX, DevOps, QA, and other...  ...engineering, distributed systems, or large-scale software... 
    Full time
    Internship
    Remote work
    Visa sponsorship

    Lyric

    Olympia, WA
    1 day ago
  •  ...difference at Fiserv.Job TitleSenior AI Data ScientistAbout your role...  ..., partnering with product, engineering, architecture, and business...  ..., with appropriate testing, observability, governance, and performance...  ...outputs, and multi-agent systems.Experience you’ll need to have... 
    Full time
    Temporary work
    H1b
    Work at office
    Monday to Friday

    Fiserv

    Olympia, WA
    1 day ago
  • $142.6k - $261.5k

     ...organizations. Using our product-driven, AI-centric approach, we empower...  ..., designers, and software engineers enable our clients to solve...  ...key responsibilities As a Manager in Application Design and Development...  ...process Work on distributed systems problems ranging from... 
    Summer holiday
    Flexible hours

    EY

    Olympia, WA
    1 day ago
  • $180k - $220k

     ...medical records to powering the AI revolution in healthcare,...  ...healthcare. Senior Software Engineer  The Role As a Senior Software...  ..., coach peers, and ensure system-wide quality and consistency....  ...performance optimization, observability, and reliability improvements... 

    Datavant

    Olympia, WA
    2 days ago
  •  ...Partnering with Autonomy, Simulation, Systems, and Safety teams, we act as system-level...  ...-level results into clear feedback for engineering and leadership, and help accelerate...  ...system design, code reviews, testing, observability, and adherence to software-engineering... 
    Full time
    Local area
    Remote work
    Work from home

    General Motors

    Olympia, WA
    4 days ago
  • $112.8k - $173.6k

     ...experienced Senior Software Engineer to join our Network...  ..., configuration, and management of Zayo's large-scale...  ...distributed systems, and is interested in...  ...and network devices. DevOps & Infrastructure Develop...  .... Familiarity with observability practices, including structured... 
    Full time
    Work experience placement
    Local area

    Zayo

    Olympia, WA
    3 days ago
  • $127k - $235k

    Job DescriptionFDE Engineering teams build AI solutions for customers...  ...improves the whole system.Key Responsibilities...  ...review and release management.· Provide reusable pipeline...  ...experience in SRE, DevOps or cloud...  ...teams to resolve them.· Observability tools such as Datadog... 
    Full time
    Work experience placement
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Olympia, WA
    1 day ago
  • $171.7k - $303.9k

     ...world! The Data Labeling Engineering team designs, builds,...  ...engineering , and AI/ML , defining the strategies...  ...Operations , Product Management , Data Science , and...  ...across teams and systems that unblock the next...  ...practices (TDD, code quality, observability, CI/CD). Bonus Points... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Olympia, WA
    1 day ago
  • $50 - $55 per hour

     ...USD Hourly Description: Our client is currently seeking a Systems Engineer - IV [ Additional Description ] Job title: Systems Engineer...  ...metrics and actionable reporting Working with data managers, project managers, and system admins to understand specific BI... 
    Hourly pay
    Contract work
    Work experience placement
    Remote work

    Judge Group, Inc.

    Lacey, WA
    3 days ago
  •  ...Required 1. Systems Infrastructure Management 2. Technical Troubleshooting & Incident Resolution 3. System Integration & Configuration 4....  ...& Training Delivery Position Summary: The Systems Engineer, IT Shared Services, under the supervision of the Director... 
    Work at office
    Local area
    Remote work

    Orion Business Innovations Careers

    Olympia, WA
    2 days ago
  • $136k - $253k

     ...DescriptionAre you a hands-on AI engineer who wants to build the next...  ...a robust, production-ready system that lawyers actually rely on...  ..., including document management systems and enterprise platforms...  ...AI solutions in production.Observability, Quality & TrustImplement monitoring... 
    Full time
    Contract work
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Olympia, WA
    3 days ago
  • $150.5k - $214.5k

     ...you. Software Development Engineer - Enterprise Finance...  ...or Microsoft Dynamics 365), system integrations, finance data management, quality engineering, and AI-enabled automation. This individual...  ...governance, security controls, observability, and human-in-the-loop... 
    Local area

    UKG

    Olympia, WA
    1 day ago
  •  ...Software Development Engineer About Trellix Trellix...  ...resilience for the AI era. Combining AI-...  ...: Design, deploy, and manage secure AWS cloud environments...  ...guidelines. Observability & Telemetry: Design telemetry...  ...-scale enterprise systems. Operating Systems:... 
    Full time
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Trellix

    Olympia, WA
    18 hours ago
  • $150k - $170k

     ...one of the principal engineers leading that work hands...  ...You design the target systems and move content and users...  ...orchestration, AI, backend services, and...  ...tooling, reliability, observability, performance, and evaluation...  ...Work with engineering managers, product managers,... 
    Full time
    Contract work

    Pearson

    Olympia, WA
    12 hours ago
  • $87k - $187k

     ...experienced Senior Platform Software Engineer, AI Engineering to join the AI...  ...with engineers, product managers, technical leads, and...  ...integrate AI models with enterprise systems, and build reusable AI...  ...implement testing, evaluation, and observability to ensure reliable, secure,... 
    Temporary work
    Flexible hours

    Oracle

    Olympia, WA
    4 days ago
  •  ...when formal applications become available. About Software Engineering Roles at Danaher Are you passionate about building real-world...  ...Supporting the development of console and embedded software systems Troubleshooting issues and implementing code fixes for real... 
    Remote job
    Internship

    Danaher

    Olympia, WA
    2 days ago
  •  ...combines responsible AI with clinical, payment...  ...position. Full-Stack Engineers serve as a frontline...  ...durable code fixes, better observability, automation, and...  ...deployment, and change management. 5. Collaboration and...  ...Familiarity with Azure DevOps, Git-based workflows,... 
    Full time
    Remote work
    Visa sponsorship

    Lyric

    Olympia, WA
    1 day ago
  • $102.3k - $209.5k

     ...or drivers; adds observability and guardrails....  ...Responsibilities Systems Software Development...  ...software modules for managing, monitoring, and...  ..., working in DevOps and incident response...  ...closely with platform engineering, operations,...  ...saving care. And with AI embedded across... 
    Temporary work
    Immediate start
    Flexible hours
    Shift work

    Oracle

    Olympia, WA
    12 hours ago
  • $120k

     ...The System Test Engineer provides subject matter proficiency for our USAF mission. This role is responsible for providing analytical skills to support process improvement, specialized studies, and definition of requirements. Typical duties include analysis, planning,... 
    Remote work

    MAXIMUS

    Olympia, WA
    18 hours ago
  • $183.1k - $340k

     ...legal departments adopt AI. CoCounsel is trusted...  ...the Forward Deployed Engineering (FDE) team, you will define...  ...such as agentic systems, MCP and A2A interoperability...  ..., including document management systems, enterprise...  ...remedies. Quality, Observability, and TrustSet the strategy... 
    Full time
    Work at office
    Local area
    Flexible hours
    Shift work

    Thomson Reuters

    Olympia, WA
    3 days ago
  • $157.5k - $299k

     ...into the unlimited potential of AI to define the next era of...  ...Operator, Nsight Cloud, Nsight Systems, and more. Our work is based...  ...Tools team as a senior software engineer to work on profiling tools...  ...ClickHouse, and Grafana for observability, analytics, and dashboarding.... 
    Full time
    Remote work

    Nvidia

    Olympia, WA
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Systems Engineer - DevOps& Observability Manager. Be the first to apply!