AI Systems Engineer - DevOps& Observability - Senior
$128.4k - $192.5kEY
Location: Anywhere in Country At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. The opportunity We are seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY's AI-native platform. These are the systems that ship, run, and make fully visible every AI workload. Within the Hybrid AI Multi-Environment Runtime (HAI), this role advised how AI services and agents are built and deployed, how models execute, how requests are routed to them, how AI assets are catalogued and governed, how consumption is measured and bounded, and how the entire platform is observed across cloud, on-prem, edge, and air-gapped environments. Works with senior engineers to test and develop capabilities. This is a distinct discipline from platform, data, and trust engineering. Where Platform Engineering owns the cluster substrate and its infrastructure automation, this role owns the delivery and runtime surface, including the CI/CD/CV pipelines that ship AI workloads, secure model execution, semantic routing, and model/prompt selection, together with the governance, discovery, cost, and telemetry systems that keep AI workloads shippable, economical, discoverable, and transparent. It sits at the intersection of DevOps, MLOps, FinOps, and observability. This role is ideal for an engineer who is equally comfortable building automated delivery pipelines, operating high-performance inference (GPUs, model servers, sandboxed execution), and building deep observability and cost visibility; who understands that in regulated contexts every AI workload must be delivered repeatably and every AI request must be economically bounded, attributable, and traceable end-to-end. Your key responsibilities Supports DevOps and delivery for AI workloads: build and operate the CI/CD/CV pipelines that ship AI services, agents, and runtime components, including automated build, test, continuous verification, release, and rollback, so AI workloads are delivered repeatably and safely into every environment. Own governance and discovery for AI assets, including service catalog/registry (Artifactory/Nexus, Harbor), experiment tracking and model metadata (MLflow), upstream registries/mirrors (HuggingFace/NGC), CVE/SBOM scanning (Trivy), lineage contracts (OpenLineage), and license management. Own resource and cost management, including quotas and rate limits, cost attribution and utilization (Apptio/OpenCost/Kubecost), so AI execution stays economically bounded and controllable per tenant and engagement. Own the full observability stack, including metrics (Prometheus/Mimir), logs (Loki), traces (Tempo/Jaeger), dashboards (Grafana), LLM debugging and evaluation (LangSmith/Langfuse), and SLA/alert notifications. Own the OpenTelemetry collection layer, including multi-tenant receiver, exporters and queues (Kafka sink), DCGM exporter for GPU telemetry, processor batching, and dynamic filtering, so every signal is captured and routed reliably. Automate GitOps-based delivery and continuous verification; embedding quality, integrity, and cost gates into pipelines so releases are policy-compliant by default rather than by manual review. Close the loop between delivery and observability by using telemetry, evaluation, and cost signals to drive deployment decisions, progressive rollout, and automated rollback of AI workloads. Ensure cost and telemetry are identity-stamped and per-tenant, so consumption and behavior are attributable end-to-end, keeping FinOps and observability tied to the workloads that generate the load. Skills and attributes for success Strong DevOps expertise: CI/CD/CV pipeline design, GitOps, continuous verification, and progressive/automated release and rollback for production workloads. Deep expertise operating model-serving and inference systems (Ray, vLLM/Triton/NIM) on GPUs at production scale. Deep observability skills: metrics, logs, traces, and OpenTelemetry. FinOps mindset: able to attribute, bound, and optimize AI consumption cost per tenant and workload. Familiarity with model/artifact governance, registries, CVE scanning, and license/lineage tracking. Comfortable operating across cloud, on-prem, edge, and air-gapped environments with consistent runtime and telemetry semantics. Strong communicator able to explain runtime, cost, and observability tradeoffs to engineers, architects, and leadership. To qualify you must have 8+ years in DevOps, MLOps, platform, or observability engineering, with hands-on production ownership of AI or high-throughput services. Strong hands-on DevOps experience, including CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI, or equivalents) for automated build, test, release, and rollback. Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure. Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry. Experience with API gateways and request routing (Envoy or equivalent), including streaming responses. Experience with cost management / FinOps tooling (OpenCost, Kubecost, or equivalent) and quota/rate-limit enforcement. Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy/SBOM). Proven track record operating AI or service infrastructure under compliance, security, or regulatory constraints. Ability to define clean ownership boundaries and consumption contracts with platform, trust, and data teams. Ideally, you'll also have Bachelor's or Master's degree in Computer Science or related technical field. Experience with LLM evaluation and debugging tooling (LangSmith, Langfuse) and prompt/response quality measurement. Experience with sandboxed/secure execution (gVisor, Firecracker, or microVM isolation) for untrusted or multi-tenant workloads. Familiarity with GPU telemetry (DCGM) and GPU utilization optimization. Experience with lineage and governance contracts (OpenLineage) and AI license management. Exposure to multi-tenant cost attribution and per-tenant SLA/alerting. Exposure to regulated delivery environments (financial services, tax, healthcare, risk). What we offer you At EY, we harness our collective strength to empower you to shape your future with confidence through professional growth, personal fulfillment and an inclusive culture. Learn more at ey.com/us/careers . The salary range for this job is: New York City, Boston, and Washington DC Metro Areas, Washington State, and Southern California offices - $128,400 to $192,500 Bay Area California offices - $133,600 to $200,600 All other offices locations in the US, including Sacramento - $106,900 to $176,500 Individual salaries within these ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. Are you ready to shape your future with confidence? Apply today. To make the most of your application experience, please limit yourself to two applications within a six-month period. EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information. At EY, our values set the foundation for how we work and the behaviors we expect of our people. Any misrepresentation or falsification of information or lack of integrity at any point in the recruiting process may result in withdrawal of your candidacy, revocation of an offer or immediate termination of employment. EY | Building a better working world EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories. All in to shape the future with confidence. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY's Talent Shared Services Team (TSS) or email the TSS at View email address on click.appcast.io . EY
$146.4k - $263.6k
...and building cutting-edge AI systems? Are you ready to drive innovation... ...with the best As a Senior II Software Engineer Lead, you will be... ...performance systems with modern DevOps practices, CI/CD pipelines... ...acceleration Have knowledge of observability, monitoring, and debugging...SeniorDevopsWork experience placementWork at office$120k - $130k
Senior Software Engineer - ExamDeveloper About ExamDeveloper ExamDeveloper... ...Engineering, and DevOps to deliver secure,... ..., deployment, observability, and security. Partner... ...complex, distributed systems. Experience providing... ...relational databases AI-assisted development...SeniorDevopsFull timeImmediate startRemote work$125.3k - $178.9k
...Application Security Engineering and Innovation team builds... ...chain security, and AI-enabled security... ...Agentic Security is a senior individual contributor... ...generative AI, agentic systems, secure AI engineering... ...testing, red teaming, observability, or governance controls...SeniorFull timeTemporary workLocal areaImmediate startRemote workFlexible hours$125.24k - $187.86k
...Lyric combines responsible AI with clinical, payment,... ...for scale.on FullStack Engineer to build intuitive,... ...closely with product, UX, DevOps, and QA to ship... ...that's still in the old system" conversations. APIs get... ...changes, structured logging, observability that tells you what's...SeniorDevopsFull timeLive inRemote workVisa sponsorshipNight shift$112.8k - $173.6k
...is seeking an experienced Senior Software Engineer to join our Network Automation... ..., understands distributed systems, and is interested in... ...systems, and network devices. DevOps & Infrastructure Develop,... ...handling. Familiarity with observability practices, including structured...SeniorDevopsFull timeWork experience placementLocal area$132.23k - $176.31k
...trusted network for the AI‑powered world,... ...today. The Role The Senior Lead Marketing Data Platform... ...partnership with engineering, analytics, Adobe, Salesforce... ..., orchestration, observability, testing, security,... ...Experience with DataOps, DevOps, infrastructure-as-...SeniorDevopsFull timeTemporary work$67k - $136.8k
...The opportunity As an FSO DevOps Engineer Senior Analyst, you'll be based in... ...infrastructure reliability, observability, and secure deployment... ...will deliver high qualify systems with focus on reliability and... ...markets. Enabled by data, AI and advanced technology, EY...SeniorDevopsSummer holidayFlexible hours- ...firm specializing in data strategy, data engineering, and data analytics. Our clients span... ...decision-making, or modernizing legacy systems, you'll find meaningful work and purpose... ...control, and CI/CD processes using Azure DevOps and GitHub. Requirements: ~5+ years...SeniorDevopsPermanent employment
$95.1k - $146.3k
...'re looking for a talented Senior Software Engineer, Application Development to... ...services that power network observability across Zayo. This is a... ..., Network Operations, SRE, DevOps, Infrastructure, Security,... ...compatibility, and distributed-system reliability. Make and document...SeniorDevopsFull timeWork experience placementLocal areaNight shift$92.5k - $209.5k
...deployment safety, scalability, observability, and developer experience. · Build systems integrating build,... ...clear, maintainable engineering solutions. ·... ...capabilities. · Apply AI-assisted and agentic coding... ...Experience with CI/CD, DevOps, release automation, IaC...SeniorDevopsTemporary workFlexible hours$87.8k - $209.5k
Job Description Senior Developer - Clinical Applications Engineering Transform Healthcare... ..., distributed systems, and scalable platform... ...efforts. Improve observability, reliability,... ...Engineering Productivity & AI Enablement... ...containerization, and modern DevOps practices....SeniorDevopsTemporary workWorldwideFlexible hours- ...electronics, high-performance computing and AI, climate friendly cooling, and high-... ...chemistry. Chemours is seeking a Senior AI Applications Engineer to join our growing AI & Data Science... ...solutions and multi-agent GenAI systems in production. We need to see evidence...SeniorFull timeWork at officeRemote work
- ...Senior Azure Data Engineer | Remote We are seeking a Senior Azure Data Engineer to help design, build, and operate a next-generation enterprise... ...late-arriving data patterns Implement CI/CD using Azure DevOps, YAML, ARM/Bicep and/or Terraform Support monitoring and...SeniorDevopsRemote work
- ...Integration team is looking for a Senior Software Development Engineer to lead the design and delivery of systems software for our next-... ...production environments (CTS).Leverage AI-assisted development tools (... ...hardware- Experience in DevOps, CI/CD, pipeline, jenkins or other...SeniorDevopsNight shiftDay shift
- ...champions the adoption of cutting-edge cloud and AI solutions to enable data-driven decision-... .... 4. Oversee The Implementation Of Devops Practices For Data Pipelines, Utilizing... ...Advanced Proficiency In Python For Data Engineering And Automation On Gcp 3. Solid Expertise...SeniorDevops
$125.3k - $178.9k
...the organization's software systems in a cross-functional team environment... ...control processes and good engineering practices. This job family... ...We are seeking a Workday AI Solutions Engineer to help HR... ...human-in-the-loop controls, observability, and AI governance preferred....SeniorFull timeTemporary workLocal areaImmediate startFlexible hours- ...stable insurance organization as a Senior Software Developer in Bedford... ...Java, React, Git, CI/CD, and AI-assisted development tools.... ...someone who enjoys solving complex engineering challenges, influencing... ...software development tools • DevOps and automation experience • Application...SeniorDevopsFull timeTemporary workFlexible hours
$130k - $216k
...security, and table permissions Configure AI Builder, Copilot Studio, or Azure AI... ...cadence Collaborate with the Business Systems Analyst to translate business requirements... ...(ALM) and environment management Azure DevOps and Git source control API and third-party...SeniorDevopsTemporary workLocal areaFlexible hours- ...Job Summary E-Logic, Inc. is seeking an experienced Senior Systems Engineer (Key Personnel) to support the U.S. Navy Joint Region Marianas (JRM) J6 office in Guam. The Senior Systems Engineer will provide senior-level engineering, systems architecture, modernization...SeniorFull timeContract workWork at officeRelocationMonday to Friday
- ...lenders. We are hiring Senior Software Engineers to build and evolve... ...because we are expanding AI-assisted development... ...operating production systems. Domain and... ...CI/CD pipelines Observability OpenTelemetry (OTEL... ...pipeline design in Azure DevOps or a comparable...SeniorDevops
$170k - $215k
...Senior Data Scientist Company: Norstella Location... ...industry experts, and engineering. Our deep expertise in... ...opportunities to apply AI / ML to our content and... ...collaboration with engineering and DevOps teams Contribute... ...to successful deployed systems, past successes have...SeniorDevopsFull timeTemporary workLocal areaRemote workFlexible hours$135.2k - $306.4k
...services at global scale. The OCI DevOps team delivers customer-facing CI/CD... ...solutions. We're looking for engineers who are passionate about distributed systems, cloud infrastructure, and solving... ...innovations to life-saving care. And with AI embedded across our products and...SeniorDevopsTemporary workFlexible hours$128.4k - $192.5k
...and help to build a better working world. The opportunity AI systems are moving from generating content to taking action across data... ...creating the safer path. You will work alongside product and engineering teams, prove controls under adversarial conditions, and...SeniorSummer holidayWork at officeImmediate startFlexible hours$121.4k - $218.6k
...customers? Join our Cloud Engineering team! The Security... ...Engineers, Data science and DevOps to manage projects,... ...As a Software Engineer Senior, you will be... ...understanding of distributed systems and concurrent programming... ...Have experience using AI-assisted development tools...SeniorDevopsWork experience placementWork at office$80.3k - $149.1k
...application delivery and system integration... ...Computer Science, Engineering, Accounting, Finance... ...as Jenkins, Azure DevOps, GitHub Actions,... ...vacation plus ten observed holidays and three... ...excellent team of senior colleagues, dedicated... ...Enabled by data, AI and advanced...SeniorDevopsWork experience placementSummer holidayImmediate startFlexible hours$149.3k - $298.7k
...The Opportunity A hands-on software engineering leadership role accountable for building production-grade agentic systems on Abbott's enterprise AI Platform. This role turns business and... ..., quality, cost, and latency are observable and auditable.• Engineer for production...Shift work- ...The Senior Platform Architect will serve as a key technical... ...across systems. Key Responsibilities... ...using tools like Azure DevOps, Jenkins, and GitHub Actions... ...documentation, process re‑engineering, and optimization using... ...Salesforce). Exposure to AI/ML, data analytics, or...SeniorDevops
$130k
We are seeking a Senior Full Stack Software Engineer to design, develop, test, and support enterprise web applications... ...and implementing modules to the system specifications, conducting unit... ...CD. Preferred Skills: SSRS, Azure DevOps, Microservices, Docker, Kubernetes,...SeniorDevopsRemote work- ...requirements into maintainable system designs, including... ...and service layers, processing engines, databases, orchestration, scheduling... ...engineering practices using Azure DevOps or equivalent – epics and user... ...deployment – and apply AI and automation with appropriate...SeniorDevopsRemote job
$55.3 per hour
...and contribute to technical architecture, system design, and strategic development... ...delivery. Collaborate across functions (QA, DevOps, Product, Security) to define and execute... ...requirements. Consult with managerial, engineering, and technical personnel to clarify...SeniorDevopsPermanent employmentContract workPart timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Engineer - DevOps& Observability - Senior. Be the first to apply!
- senior devops Springfield, IL
- junior devops remote Springfield, IL
- aws devops Springfield, IL
- devops Springfield, IL
- azure devops Springfield, IL
- senior living Springfield, IL
- senior accountant manufacturing Springfield, IL
- senior manager customer operations Springfield, IL
- senior full stack web developer Springfield, IL
- senior magento developer Springfield, IL




