AI Systems Engineer - DevOps& Observability - Senior
$128.4k - $192.5kEY
Location: Anywhere in Country At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. The opportunity We are seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY's AI-native platform. These are the systems that ship, run, and make fully visible every AI workload. Within the Hybrid AI Multi-Environment Runtime (HAI), this role advised how AI services and agents are built and deployed, how models execute, how requests are routed to them, how AI assets are catalogued and governed, how consumption is measured and bounded, and how the entire platform is observed across cloud, on-prem, edge, and air-gapped environments. Works with senior engineers to test and develop capabilities. This is a distinct discipline from platform, data, and trust engineering. Where Platform Engineering owns the cluster substrate and its infrastructure automation, this role owns the delivery and runtime surface, including the CI/CD/CV pipelines that ship AI workloads, secure model execution, semantic routing, and model/prompt selection, together with the governance, discovery, cost, and telemetry systems that keep AI workloads shippable, economical, discoverable, and transparent. It sits at the intersection of DevOps, MLOps, FinOps, and observability. This role is ideal for an engineer who is equally comfortable building automated delivery pipelines, operating high-performance inference (GPUs, model servers, sandboxed execution), and building deep observability and cost visibility; who understands that in regulated contexts every AI workload must be delivered repeatably and every AI request must be economically bounded, attributable, and traceable end-to-end. Your key responsibilities Supports DevOps and delivery for AI workloads: build and operate the CI/CD/CV pipelines that ship AI services, agents, and runtime components, including automated build, test, continuous verification, release, and rollback, so AI workloads are delivered repeatably and safely into every environment. Own governance and discovery for AI assets, including service catalog/registry (Artifactory/Nexus, Harbor), experiment tracking and model metadata (MLflow), upstream registries/mirrors (HuggingFace/NGC), CVE/SBOM scanning (Trivy), lineage contracts (OpenLineage), and license management. Own resource and cost management, including quotas and rate limits, cost attribution and utilization (Apptio/OpenCost/Kubecost), so AI execution stays economically bounded and controllable per tenant and engagement. Own the full observability stack, including metrics (Prometheus/Mimir), logs (Loki), traces (Tempo/Jaeger), dashboards (Grafana), LLM debugging and evaluation (LangSmith/Langfuse), and SLA/alert notifications. Own the OpenTelemetry collection layer, including multi-tenant receiver, exporters and queues (Kafka sink), DCGM exporter for GPU telemetry, processor batching, and dynamic filtering, so every signal is captured and routed reliably. Automate GitOps-based delivery and continuous verification; embedding quality, integrity, and cost gates into pipelines so releases are policy-compliant by default rather than by manual review. Close the loop between delivery and observability by using telemetry, evaluation, and cost signals to drive deployment decisions, progressive rollout, and automated rollback of AI workloads. Ensure cost and telemetry are identity-stamped and per-tenant, so consumption and behavior are attributable end-to-end, keeping FinOps and observability tied to the workloads that generate the load. Skills and attributes for success Strong DevOps expertise: CI/CD/CV pipeline design, GitOps, continuous verification, and progressive/automated release and rollback for production workloads. Deep expertise operating model-serving and inference systems (Ray, vLLM/Triton/NIM) on GPUs at production scale. Deep observability skills: metrics, logs, traces, and OpenTelemetry. FinOps mindset: able to attribute, bound, and optimize AI consumption cost per tenant and workload. Familiarity with model/artifact governance, registries, CVE scanning, and license/lineage tracking. Comfortable operating across cloud, on-prem, edge, and air-gapped environments with consistent runtime and telemetry semantics. Strong communicator able to explain runtime, cost, and observability tradeoffs to engineers, architects, and leadership. To qualify you must have 8+ years in DevOps, MLOps, platform, or observability engineering, with hands-on production ownership of AI or high-throughput services. Strong hands-on DevOps experience, including CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI, or equivalents) for automated build, test, release, and rollback. Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure. Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry. Experience with API gateways and request routing (Envoy or equivalent), including streaming responses. Experience with cost management / FinOps tooling (OpenCost, Kubecost, or equivalent) and quota/rate-limit enforcement. Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy/SBOM). Proven track record operating AI or service infrastructure under compliance, security, or regulatory constraints. Ability to define clean ownership boundaries and consumption contracts with platform, trust, and data teams. Ideally, you'll also have Bachelor's or Master's degree in Computer Science or related technical field. Experience with LLM evaluation and debugging tooling (LangSmith, Langfuse) and prompt/response quality measurement. Experience with sandboxed/secure execution (gVisor, Firecracker, or microVM isolation) for untrusted or multi-tenant workloads. Familiarity with GPU telemetry (DCGM) and GPU utilization optimization. Experience with lineage and governance contracts (OpenLineage) and AI license management. Exposure to multi-tenant cost attribution and per-tenant SLA/alerting. Exposure to regulated delivery environments (financial services, tax, healthcare, risk). What we offer you At EY, we harness our collective strength to empower you to shape your future with confidence through professional growth, personal fulfillment and an inclusive culture. Learn more at ey.com/us/careers . The salary range for this job is: New York City, Boston, and Washington DC Metro Areas, Washington State, and Southern California offices - $128,400 to $192,500 Bay Area California offices - $133,600 to $200,600 All other offices locations in the US, including Sacramento - $106,900 to $176,500 Individual salaries within these ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. Are you ready to shape your future with confidence? Apply today. To make the most of your application experience, please limit yourself to two applications within a six-month period. EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information. At EY, our values set the foundation for how we work and the behaviors we expect of our people. Any misrepresentation or falsification of information or lack of integrity at any point in the recruiting process may result in withdrawal of your candidacy, revocation of an offer or immediate termination of employment. EY | Building a better working world EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories. All in to shape the future with confidence. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY's Talent Shared Services Team (TSS) or email the TSS at View email address on click.appcast.io . EY
$128.4k - $192.5k
...The opportunity Our AI, Data & Engineering team helps apply cutting... ...platforms. As a Senior AI Engineer, you will... ...generative AI, and agentic systems on Databricks that... ...Platform Engineers, DevOps to implement and... ...Databricks, including observability, monitoring, reporting...SeniorDevopsFull timeWork experience placementImmediate startRemote work$112.8k - $173.6k
...is seeking an experienced Senior Software Engineer to join our Network Automation... ..., understands distributed systems, and is interested in... ...systems, and network devices. DevOps & Infrastructure Develop... .... Familiarity with observability practices, including structured...SeniorDevopsFull timeWork experience placementLocal area$132.23k - $176.31k
...trusted network for the AI‑powered world,... ...today. The Role The Senior Lead Marketing Data Platform... ...partnership with engineering, analytics, Adobe, Salesforce... ..., orchestration, observability, testing, security,... ...Experience with DataOps, DevOps, infrastructure-as-...SeniorDevopsFull timeTemporary work$67k - $136.8k
...The opportunity As an FSO DevOps Engineer Senior Analyst, you'll be based in... ...infrastructure reliability, observability, and secure deployment... ...will deliver high qualify systems with focus on reliability and... ...markets. Enabled by data, AI and advanced technology, EY...SeniorDevopsSummer holidayFlexible hours$92.5k - $209.5k
...deployment safety, scalability, observability, and developer experience. · Build systems integrating build,... ...clear, maintainable engineering solutions. ·... ...capabilities. · Apply AI-assisted and agentic coding... ...Experience with CI/CD, DevOps, release automation, IaC...SeniorDevopsTemporary workFlexible hours$87.8k - $209.5k
...skilled Principal Software Engineer to join our Clinical... ..., distributed systems, and scalable platform... ...analysis efforts. Improve observability, reliability, operational... ...Productivity & AI Enablement Leverage modern... ..., and modern DevOps practices. Experience...SeniorDevopsTemporary workWorldwideFlexible hours- Senior Data Engineer Anywhere Type: Permanent Category: Data... ...foundation for reporting and AI/ML. Migrate existing... ...quality testing, observability, and lineage with dbt... ...Actions, Azure DevOps Pipelines, or GitLab... ...Science, Information Systems, Data Engineering, or...SeniorDevopsHourly payPermanent employmentFull timeLocal areaRemote work
- ...electronics, high-performance computing and AI, climate friendly cooling, and high-... ...chemistry. Chemours is seeking a Senior AI Applications Engineer to join our growing AI & Data Science... ...solutions and multi-agent GenAI systems in production. We need to see evidence...SeniorFull timeWork at officeRemote work
- ...Job Summary E-Logic, Inc. is seeking an experienced Senior Systems Engineer (Key Personnel) to support the U.S. Navy Joint Region Marianas (JRM) J6 office in Guam. The Senior Systems Engineer will provide senior-level engineering, systems architecture, modernization...SeniorFull timeContract workWork at officeRelocationMonday to Friday
- ...lenders. We are hiring Senior Software Engineers to build and evolve... ...because we are expanding AI-assisted development... ...operating production systems. Domain and... ...CI/CD pipelines Observability OpenTelemetry (OTEL... ...pipeline design in Azure DevOps or a comparable...SeniorDevops
$170k - $215k
...Senior Data Scientist Company: Norstella Location... ...industry experts, and engineering. Our deep expertise in... ...opportunities to apply AI / ML to our content and... ...collaboration with engineering and DevOps teams Contribute... ...to successful deployed systems, past successes have...SeniorDevopsFull timeTemporary workLocal areaRemote workFlexible hours- Senior Data Engineer Fully Remote-United States Job Type Full-time Description Overview... ..., and maintain data pipelines and systems that support HUD AI/ML proofs of concept and pilots. This... ...with Data Scientists, DevOps, and UX teams Problem-solving for...SeniorDevopsFull timeContract workLocal areaRemote work
$55.3 per hour
...and contribute to technical architecture, system design, and strategic development... ...delivery. Collaborate across functions (QA, DevOps, Product, Security) to define and execute... ...requirements. Consult with managerial, engineering, and technical personnel to clarify...SeniorDevopsPermanent employmentContract workPart timeRemote work- ...delivers real business value with AI. What You’ll Do In this... ...intelligent, autonomous AI systems that enable Teradata to push... ...part of Teradata’s global engineering organization, responsible for... ...management, context handling, observability, and identity. Strong background...Flexible hours
- Sr Platform Engineer I Anywhere Type: Permanent Category... ...Engineering and DevOps organization. The role... ...solutions and support observability. Implement and support... ...patterns across systems. Utilize and contribute... ...work across IaaS, PaaS, AI, and containers. Experience...SeniorDevopsHourly payPermanent employmentFull timeLocal areaRemote workWork from home
$126.2k - $264.1k
...Description What You'll Do As a Senior Principal Network Reliability Engineer, you will: Provide... ...initiatives supporting AI infrastructure, new OCI... ...solutions. Drive systemic improvements that eliminate... ...operational readiness, observability, capacity planning, and...SeniorTemporary workFlexible hours- Senior Systems Administrator / Infrastructure Engineer Anywhere Type: Contract Category: Administrative Industry: Education Workplace Type: Remote Standard... ...that Eliassen Group utilizes artificial intelligence (AI) tools as part of its initial application screening...SeniorHourly payContract workLocal areaRemote work
$122.9k - $204.9k
...key responsibilities As a Senior Application Designer and Developer... ...their needs and advise on SAP system capabilities. You will... ...with Agile methodologies and DevOps practices. Knowledge of database... ...markets. Enabled by data, AI and advanced technology, EY teams...SeniorDevopsSummer holidayImmediate startFlexible hours$84.63k - $141.05k
Lumen is the trusted network for the AI‑powered world, connecting people, data, and... ..., join us today. The Role The Senior Linux Systems Administrator will design, build, secure... ...operational lifecycle. The role also includes DevOps and application-support...SeniorDevopsTemporary workRemote work$186.07k - $218.9k
...Infrastructure group builds the systems every Coinbase engineer relies on to write,... ...trustworthy feedback. We’re hiring Senior Software Engineers across... ..., including architecture, observability, SLOs, and on-call... .... ~ Utilizes generative AI responsibly, maintaining human...SeniorLocal area$125.5k - $230.2k
...implement scalable artificial intelligence systems that learn and make predictions... ...key responsibilities As a Manager in AI Native Engineering, you will play a pivotal role in delivering... ...learning Extensive experience in DevOps tools (GIT, Azure DevOps), Agile methodologies...DevopsFull timeWork experience placementSummer holidayFlexible hours- ..., Lyric combines responsible AI with clinical, payment, regulatory... ...this position. Full-Stack Engineers serve as a frontline... ...into durable code fixes, better observability, automation, and platform improvements... .... Familiarity with Azure DevOps, Git-based workflows, pull...DevopsFull timeRemote workVisa sponsorship
- ...The Director, Software Engineering is responsible for... ...The role partners with DevOps and Infrastructure teams... ..., automation, and AI-assisted development.... ...Lead the enterprise and senior solution architects who... ...CI/CD practices, and observability, while ensuring solutions...DevopsTemporary workLocal areaRemote workFlexible hours
$191.25k - $225k
...working at Coinbase. As a Senior Machine Learning Platform Engineer on the ML Platform team... ...analysis. You'll own critical systems spanning stream... ...volumes efficiently. Develop observability tooling to monitor data quality... .... Utilizes generative AI responsibly, maintaining...SeniorLocal area$128k - $176k
...highly skilled and experienced Senior Data & AI Solutions Architect to lead... ...the architecture and engineering of scalable, high-performance... ...Stream Analytics. Utilize Azure DevOps for data engineering CI/CD... ...optimization techniques for Azure data systems. Synergistic Collaboration:...SeniorDevopsFull timeRemote workWorldwideFlexible hours$129.3k - $177.8k
...seasoned Lead Software Engineer to architect and... ...will architect systems, set technical standards... ...and agentic-AI models trained on... ...production-ready, observable, resilient, and capable... ...leaders and senior executives. • Experience... ...with Azure DevOps pipelines, CI/CD automation...DevopsFull timeTemporary workFor contractorsApprenticeshipLive inWork at officeRemote workWork from homeHome officeMonday to Friday$135.2k - $306.4k
...were a strong programmer and a distributed systems generalist, able to dive deep into any... ...to learn. We're looking for hands-on senior engineers with expertise and passion in solving... ...innovations to life-saving care. And with AI embedded across our products and services...SeniorTemporary workFlexible hours$92.5k - $209.5k
...Nashville, TN only. Join a new engineering team building the platform... ...Agentic Service Engineering: a system that helps OCI teams... ...operate production software with AI. The platform will bring together... ...logging, monitoring, and observability for effective debugging, ensuring...SeniorTemporary workImmediate startFlexible hoursShift work$21.81 - $32.21 per hour
...will work as a member of the Enterprise AI Center of Enablement to develop AI products... ...(UEAA). Partner with MLOps engineers to package, deploy, and monitor agentic and... ....S., Intermountain Health is a nonprofit system of 34 hospitals, 400+ clinics, a medical...Hourly payFull timeInternshipRemote workMonday to FridayFlexible hours$114.6k - $234.6k
...opportunities for smart, hands-on engineers with the expertise and passion... ...and building innovative new systems to power our customers'... ...experience 6+ years of Dev/DevOps experience with large scale, highly... ...to life-saving care. And with AI embedded across our products and...DevopsTemporary workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Engineer - DevOps& Observability - Senior. Be the first to apply!
- junior devops remote Frankfort, KY
- devops Frankfort, KY
- senior living Frankfort, KY
- senior magento developer Frankfort, KY
- senior manager accenture Frankfort, KY
- senior accountant remote Frankfort, KY
- senior devops engineer remote Frankfort, KY
- international tax senior Frankfort, KY
- senior activities Frankfort, KY
- srs Frankfort, KY


