AI Systems Engineer - DevOps& Observability Manager
$150.7k - $251.2kEY
Location: Anywhere in Country At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. The opportunity We are seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. These are the systems that ship, run, and make fully visible every AI workload. Within the Hybrid AI Multi-Environment Runtime (HAI), this role owns how AI services and agents are built and deployed, how models execute, how requests are routed to them, how AI assets are catalogued and governed, how consumption is measured and bounded, and how the entire platform is observed across cloud, on-prem, edge, and air-gapped environments. This is a distinct discipline from platform, data, and trust engineering. Where Platform Engineering owns the cluster substrate and its infrastructure automation, this role owns the delivery and runtime surface, including the CI/CD/CV pipelines that ship AI workloads, secure model execution, semantic routing, and model/prompt selection, together with the governance, discovery, cost, and telemetry systems that keep AI workloads shippable, economical, discoverable, and transparent. It sits at the intersection of DevOps, MLOps, FinOps, and observability. This role is ideal for an engineer who is equally comfortable building automated delivery pipelines, operating high-performance inference (GPUs, model servers, sandboxed execution), and building deep observability and cost visibility; who understands that in regulated contexts every AI workload must be delivered repeatably and every AI request must be economically bounded, attributable, and traceable end-to-end. Your key responsibilities Own DevOps and delivery for AI workloads: build and operate the CI/CD/CV pipelines that ship AI services, agents, and runtime components, including automated build, test, continuous verification, release, and rollback, so AI workloads are delivered repeatably and safely into every environment. Own governance and discovery for AI assets, including service catalog/registry (Artifactory/Nexus, Harbor), experiment tracking and model metadata (MLflow), upstream registries/mirrors (HuggingFace/NGC), CVE/SBOM scanning (Trivy), lineage contracts (OpenLineage), and license management. Own resource and cost management, including quotas and rate limits, cost attribution and utilization (Apptio/OpenCost/Kubecost), so AI execution stays economically bounded and controllable per tenant and engagement. Own the full observability stack, including metrics (Prometheus/Mimir), logs (Loki), traces (Tempo/Jaeger), dashboards (Grafana), LLM debugging and evaluation (LangSmith/Langfuse), and SLA/alert notifications. Own the OpenTelemetry collection layer, including multi-tenant receiver, exporters and queues (Kafka sink), DCGM exporter for GPU telemetry, processor batching, and dynamic filtering, so every signal is captured and routed reliably. Automate GitOps-based delivery and continuous verification; embedding quality, integrity, and cost gates into pipelines so releases are policy-compliant by default rather than by manual review. Close the loop between delivery and observability by using telemetry, evaluation, and cost signals to drive deployment decisions, progressive rollout, and automated rollback of AI workloads. Ensure cost and telemetry are identity-stamped and per-tenant, so consumption and behavior are attributable end-to-end, keeping FinOps and observability tied to the workloads that generate the load. Skills and attributes for success Strong DevOps expertise: CI/CD/CV pipeline design, GitOps, continuous verification, and progressive/automated release and rollback for production workloads. Deep expertise operating model-serving and inference systems (Ray, vLLM/Triton/NIM) on GPUs at production scale. Deep observability skills: metrics, logs, traces, and OpenTelemetry. FinOps mindset: able to attribute, bound, and optimize AI consumption cost per tenant and workload. Familiarity with model/artifact governance, registries, CVE scanning, and license/lineage tracking. Comfortable operating across cloud, on-prem, edge, and air-gapped environments with consistent runtime and telemetry semantics. Strong communicator able to explain runtime, cost, and observability tradeoffs to engineers, architects, and leadership. To qualify you must have Bachelor’s or Master’s degree in Computer Science or related technical field. 8+ years in DevOps, MLOps, platform, or observability engineering, with hands-on production ownership of AI or high-throughput services. Strong hands-on DevOps experience, including CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI, or equivalents) for automated build, test, release, and rollback. Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure. Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry. Experience with API gateways and request routing (Envoy or equivalent), including streaming responses. Experience with cost management / FinOps tooling (OpenCost, Kubecost, or equivalent) and quota/rate-limit enforcement. Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy/SBOM). Proven track record operating AI or service infrastructure under compliance, security, or regulatory constraints. Ability to define clean ownership boundaries and consumption contracts with platform, trust, and data teams. Ideally, you’ll also have Experience with LLM evaluation and debugging tooling (LangSmith, Langfuse) and prompt/response quality measurement. Experience with sandboxed/secure execution (gVisor, Firecracker, or microVM isolation) for untrusted or multi-tenant workloads. Familiarity with GPU telemetry (DCGM) and GPU utilization optimization. Experience with lineage and governance contracts (OpenLineage) and AI license management. Exposure to multi-tenant cost attribution and per-tenant SLA/alerting. Exposure to regulated delivery environments (financial services, tax, healthcare, risk). What we offer you At EY, we harness our collective strength to empower you to shape your future with confidence through professional growth, personal fulfillment and an inclusive culture. Learn more at ey.com/us/careers. We offer a comprehensive compensation and benefits package where you’ll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job is: New York City, Boston, and Washington DC Metro Areas, Washington State, and Southern California offices – $150,700 to $251,200 Bay Area California offices – $157,100 to $261,600 All other offices locations in the US, including Sacramento – $125,500 to $230,200 Individual salaries within these ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. Are you ready to shape your future with confidence? Apply today. To make the most of your application experience, please limit yourself to two applications within a six-month period. EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information. At EY, our values set the foundation for how we work and the behaviors we expect of our people. Any misrepresentation or falsification of information or lack of integrity at any point in the recruiting process may result in withdrawal of your candidacy, revocation of an offer or immediate termination of employment. EY | Building a better working world EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories. All in to shape the future with confidence. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at View email address on click.appcast.io . EY
$184k - $287.5k
AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our... ...building and operating incident-management processes with internally built... ...building and operating modern observability platforms to deliver scalable metrics...SuggestedFull timeRemote work$96.3k - $123.84k
...advantage. This function manages analytic data... ...integrating multiple systems. Job Overview We are... ...seeking a product-oriented AI/ML Engineer who partners with... ...Actions, GitLab, Azure DevOps, Jenkins, Harness,... ...deployment, monitoring, observability, and governance....SuggestedFull timeTemporary workLocal areaImmediate startFlexible hours$152k - $241.5k
Sr Software Engineer - Distributed Systems Engineer, EDA InfrastructureNVIDIA is hiring... ...platform services that manage large fleets of GPU-based... ...infrastructure management systems, and observability platforms.Use hardware... ...vacancy. NVIDIA uses AI tools in its recruiting...SuggestedFull timeRemote work$255.5k
...DescriptionThomson Reuters is looking for a Senior Legal AI Engineer to lead pre-sales engagements of Thomson... ..., strategic relationships with managing partners, practice group leaders, and... ..., a partner technology, a customer system integration, or custom development, and...SuggestedFull timeLocal areaFlexible hours$125.3k - $178.9k
...organization's software systems in a cross-functional... ...processes and good engineering practices. This job family... ...are seeking a Workday AI Solutions Engineer to... ...for employees, managers, and HR teams. Evaluate... ...in-the-loop controls, observability, and AI governance preferred...SuggestedFull timeTemporary workLocal areaImmediate startFlexible hours$128.4k - $192.5k
...The opportunity Our AI, Data & Engineering team helps apply... ...generative AI, and agentic systems on Databricks that... ...capabilities, managing roadmaps and backlogs... ...Platform Engineers, DevOps to implement and sustain... ..., including observability, monitoring, reporting...Full timeWork experience placementImmediate startRemote work- Forward Deployed AI/ML Engineer IV Anywhere Type: Permanent Category: Data Industry: Energy... ...operational problems, then build and ship the systems that solve them. You will deliver... ...about AI capabilities and limitations. Manage scope, timeline, and expectations against...Hourly payPermanent employmentFull timeLocal areaRemote work
$81.1k - $187k
...Server and Linux systems in production and... ...identity, access management, and environment... ...Information Technology, Engineering, or a related... ...operations, DevOps, cloud operations... ...centralized logging, and observability practices.... ...saving care. And with AI embedded across...Temporary workFlexible hours- ...combines responsible AI with clinical,... ...hiring a Full Stack Engineer whose center of... ...architecture, design systems, accessibility,... ...product, UX, and DevOps to ship customer-delighting... ..., state management, routing, and shared... ...logging, and front-end observability that tells you...Full timeWork experience placementLive inRemote workVisa sponsorshipNight shift
- ...combines responsible AI with clinical, payment... ...position. The Software Engineer Intern will join Lyric... ...Learn how observability, structured logging, monitoring... ...Engineering, Product, UX, DevOps, QA, and other... ...engineering, distributed systems, or large-scale software...Full timeInternshipRemote workVisa sponsorship
- ...difference at Fiserv.Job TitleSenior AI Data ScientistAbout your role... ..., partnering with product, engineering, architecture, and business... ..., with appropriate testing, observability, governance, and performance... ...outputs, and multi-agent systems.Experience you’ll need to have...Full timeTemporary workH1bWork at officeMonday to Friday
$142.6k - $261.5k
...organizations. Using our product-driven, AI-centric approach, we empower... ..., designers, and software engineers enable our clients to solve... ...key responsibilities As a Manager in Application Design and Development... ...process Work on distributed systems problems ranging from...Summer holidayFlexible hours$180k - $220k
...medical records to powering the AI revolution in healthcare,... ...healthcare. Senior Software Engineer The Role As a Senior Software... ..., coach peers, and ensure system-wide quality and consistency.... ...performance optimization, observability, and reliability improvements...- ...Partnering with Autonomy, Simulation, Systems, and Safety teams, we act as system-level... ...-level results into clear feedback for engineering and leadership, and help accelerate... ...system design, code reviews, testing, observability, and adherence to software-engineering...Full timeLocal areaRemote workWork from home
$112.8k - $173.6k
...experienced Senior Software Engineer to join our Network... ..., configuration, and management of Zayo's large-scale... ...distributed systems, and is interested in... ...and network devices. DevOps & Infrastructure Develop... .... Familiarity with observability practices, including structured...Full timeWork experience placementLocal area$127k - $235k
Job DescriptionFDE Engineering teams build AI solutions for customers... ...improves the whole system.Key Responsibilities... ...review and release management.· Provide reusable pipeline... ...experience in SRE, DevOps or cloud... ...teams to resolve them.· Observability tools such as Datadog...Full timeWork experience placementWork at officeLocal areaFlexible hours$171.7k - $303.9k
...world! The Data Labeling Engineering team designs, builds,... ...engineering , and AI/ML , defining the strategies... ...Operations , Product Management , Data Science , and... ...across teams and systems that unblock the next... ...practices (TDD, code quality, observability, CI/CD). Bonus Points...Full timeLocal areaRemote workWork from homeRelocation packageFlexible hours$50 - $55 per hour
...USD Hourly Description: Our client is currently seeking a Systems Engineer - IV [ Additional Description ] Job title: Systems Engineer... ...metrics and actionable reporting Working with data managers, project managers, and system admins to understand specific BI...Hourly payContract workWork experience placementRemote work- ...Required 1. Systems Infrastructure Management 2. Technical Troubleshooting & Incident Resolution 3. System Integration & Configuration 4.... ...& Training Delivery Position Summary: The Systems Engineer, IT Shared Services, under the supervision of the Director...Work at officeLocal areaRemote work
$136k - $253k
...DescriptionAre you a hands-on AI engineer who wants to build the next... ...a robust, production-ready system that lawyers actually rely on... ..., including document management systems and enterprise platforms... ...AI solutions in production.Observability, Quality & TrustImplement monitoring...Full timeContract workWork at officeLocal areaFlexible hours$150.5k - $214.5k
...you. Software Development Engineer - Enterprise Finance... ...or Microsoft Dynamics 365), system integrations, finance data management, quality engineering, and AI-enabled automation. This individual... ...governance, security controls, observability, and human-in-the-loop...Local area- ...Software Development Engineer About Trellix Trellix... ...resilience for the AI era. Combining AI-... ...: Design, deploy, and manage secure AWS cloud environments... ...guidelines. Observability & Telemetry: Design telemetry... ...-scale enterprise systems. Operating Systems:...Full timeWork at officeRemote workFlexible hours3 days per week
$150k - $170k
...one of the principal engineers leading that work hands... ...You design the target systems and move content and users... ...orchestration, AI, backend services, and... ...tooling, reliability, observability, performance, and evaluation... ...Work with engineering managers, product managers,...Full timeContract work$87k - $187k
...experienced Senior Platform Software Engineer, AI Engineering to join the AI... ...with engineers, product managers, technical leads, and... ...integrate AI models with enterprise systems, and build reusable AI... ...implement testing, evaluation, and observability to ensure reliable, secure,...Temporary workFlexible hours- ...when formal applications become available. About Software Engineering Roles at Danaher Are you passionate about building real-world... ...Supporting the development of console and embedded software systems Troubleshooting issues and implementing code fixes for real...Remote jobInternship
- ...combines responsible AI with clinical, payment... ...position. Full-Stack Engineers serve as a frontline... ...durable code fixes, better observability, automation, and... ...deployment, and change management. 5. Collaboration and... ...Familiarity with Azure DevOps, Git-based workflows,...Full timeRemote workVisa sponsorship
$102.3k - $209.5k
...or drivers; adds observability and guardrails.... ...Responsibilities Systems Software Development... ...software modules for managing, monitoring, and... ..., working in DevOps and incident response... ...closely with platform engineering, operations,... ...saving care. And with AI embedded across...Temporary workImmediate startFlexible hoursShift work$120k
...The System Test Engineer provides subject matter proficiency for our USAF mission. This role is responsible for providing analytical skills to support process improvement, specialized studies, and definition of requirements. Typical duties include analysis, planning,...Remote work$183.1k - $340k
...legal departments adopt AI. CoCounsel is trusted... ...the Forward Deployed Engineering (FDE) team, you will define... ...such as agentic systems, MCP and A2A interoperability... ..., including document management systems, enterprise... ...remedies. Quality, Observability, and TrustSet the strategy...Full timeWork at officeLocal areaFlexible hoursShift work$157.5k - $299k
...into the unlimited potential of AI to define the next era of... ...Operator, Nsight Cloud, Nsight Systems, and more. Our work is based... ...Tools team as a senior software engineer to work on profiling tools... ...ClickHouse, and Grafana for observability, analytics, and dashboarding....Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Engineer - DevOps& Observability Manager. Be the first to apply!



