AI Observability Engineer - GenAI & Agentic AI

GL Global

AI Observability Engineer - GenAI & Agentic AI

We’re looking for an experienced AI Observability Engineer to support the development and production of next-generation GenAI and Agentic AI systems.

This is a great opportunity for someone with a background in Observability, SRE, MLOps, Platform Engineering, AI/ML or Test Automation who wants to work on cutting-edge AI technology.

Key Responsibilities:

Build telemetry, monitoring, dashboards, alerts, tracing and SLOs for AI/LLM applications and agents
Develop LLM and AI evaluation frameworks covering response quality, prompts, RAG, latency, reliability and safety
Analyse production behaviour and identify improvements to AI quality, performance and reliability
Automate production readiness, reporting and governance processes
Create runbooks and operational documentation for AI releases
Work closely with Engineering and Product teams to define monitoring and evaluation requirements

Experience:

4+ years' engineering experience across observability, monitoring, platform engineering, SRE, AI/ML or test automation
Strong hands-on Python experience
Experience with metrics, logs, traces, dashboards, alerting and SLOs
Understanding of LLMs, AI agents, RAG or AI evaluation
Experience supporting production systems

If you're an AI Observability Engineer, GenAI Engineer, SRE, MLOps Engineer, Platform Engineer or AI/ML Engineer looking to work on production Agentic AI systems, we'd love to hear from you.

Apply

Vacancy posted 21 hours ago

Similar jobs that could be interesting for youBased on the AI Observability Engineer - GenAI & Agentic AI in Charlotte, NC vacancy

AI Observability Engineer - GenAI & Agentic AI (Charlotte)
...AI Observability Engineer - GenAI & Agentic AI We’re looking for an experienced AI Observability Engineer to support the development and production of next-generation GenAI and Agentic AI systems. This is a great opportunity for someone with a background in Observability...
Suggested
GL Global
Charlotte, NC
21 hours ago
AI Engineer - GenAI / Agentic Systems - Financial Services - Infosys Consulting
...Consultant - Banking and Capital Markets - GenAI / Agentic Systems, Infosys ConsultingThe Role -... ...-on Financial Services Consultant with AI experience to design, build, and scale... ...-driven applicationsImplement prompt engineering, evaluation frameworks, and guardrailsPerform...
Suggested
Full time
Temporary work
Work experience placement
Infosys Technologies
Charlotte, NC
2 days ago
Google Agentic AI Delivery Senior Engineer
...elite technical and product engine of the Accenture Google Business... ...in technology: the move to Agentic AI and Product-Led Operating Models... ...Professional Data Engineer, GenAI Leader). Project experience... ...for a disability or religious observance, please call us toll free at...
Suggested
Work experience placement
Live in
Work at office
Local area
Shift work
Accenture
Charlotte, NC
3 days ago
Sr. Agentic AI Engineer
...Job Role: Senior Agentic AI Engineer Location: Charlotte, NC (Hybrid - 3 Days a week) Job Description: Agentic AI engineer with prior great... ...experience. ~ Recent hands-on experience designing GenAI/Agentic AI solutions . ~ Experience modernizing large legacy...
Suggested
Full time
3 days per week
NLB Services
Charlotte, NC
1 day ago
Agentic AI Engineer - Anthropic/Claude
$91.1k - $179.5k
Position Summary Agentic AI is moving from experimentation to production, and organizations... ...and at scale. We're growing a team of engineers who want to work at the center of that... ..., MCP integrations, agent evaluation, observability, safety controls, or production...
Suggested
Work at office
Local area
Visa sponsorship
Shift work
Deloitte
Charlotte, NC
2 days ago
Agentic AI Engineer
...Senior Agentic AI Engineer Embedded Engineering Engagement We are hiring Senior Agentic AI Engineers to join a high-impact engineering... .... ~ Strong engineering judgment around reliability, observability, testing, and maintainability. ~ Excellent written and...
Remote work
Jobrapido
Charlotte, NC
2 days ago
Lead Gen AI/Agentic AI Engineer
...Job Summary We are looking for a highly experienced and driven Senior GenAI/Agentic AI Engineer to lead the design, development, and deployment of next-generation intelligent applications and autonomous agents. This role is pivotal in revolutionizing business operations...
TechDigital Group
Charlotte, NC
4 days ago
AI Solutions Engineer GenAI & LLM Systems
...IBM Consulting is seeking a Forward Deployed Engineer – AI to work with clients on production AI solutions. You’ll apply GenAI, agentic AI, and data science to design, prototype, and deploy value-driving systems across enterprise data and APIs. You’ll collaborate with...
IBM
Charlotte, NC
3 days ago
AI Principal Consultant- GenAI / Agentic Systems - FS
...Financial Services Consultant with AI experience to design, build, and scale GenAI-powered solutions for banking and... ...Implement prompt engineering, evaluation frameworks, and guardrails... ...Skills Exposure to Google ADK / agentic frameworks Experience with knowledge...
Full time
Work experience placement
Infosys Consulting
Charlotte, NC
21 hours ago
Gen AI Engineer
OverviewInfosys Topaz is an AI-first suite of... ...building of enterprise GenAI applications with Lang... ...RAG, vector databases, agentic workflows (tool calling... ...-agent), and prompt engineering.• Working with Azure OpenAI... ....• LLMOps practices — observability, tracing, evaluation (...
Full time
Temporary work
Relocation
Infosys Technologies
Charlotte, NC
3 days ago
AI Led Forward Deployed Engineer | Design & Digital Products
You are:As an AI led FDE , you embed with design &... ...end: RAG architecture, agentic orchestration, prompt & context engineering, evals & guardrails, tool... ...hands-on work shipping GenAI features (RAG, agentic workflows... ...disability or religious observance, please call us toll...
Live in
Work at office
Local area
Accenture
Charlotte, NC
3 days ago
Software Architect - AI Accelerated Engineering Lead (East)
...the next generation of AI-empowered software... ...in adopting AI-first engineering practices—bringing clarity... ...reliable, and safe.· Manage GenAI-driven teams:... ...using modern DevOps and observability practices.· Enable and... ...development: Daily use of agentic IDEs and advanced...
Temporary work
Local area
Slalom
Charlotte, NC
3 days ago
Senior Agentic AI Engineer Hybrid (Charlotte)
...Strategic Staffing Solutions, Inc. is seeking a Senior Agentic AI Engineer in Charlotte, NC. You will design and implement advanced AI agents, integrate MCP tools, and deploy on AWS/Azure with agent runtimes. You will drive SDD practices, review AI-generated code, and...
Strategic Staffing Solutions
Charlotte, NC
3 days ago
Principal Engineer - Agentic AI Engineering
...Description: This job is responsible for defining and leading the engineering approach for solutions at the program or portfolio level, to... ...software at scale. We are seeking a highly capable Agentic AI Engineering Principal Engineer to design, build, integrate,...
Work at office
Flexible hours
Shift work
Day shift
Bank of America
Charlotte, NC
4 days ago
Sr AI Engineer - Platform Engineering
$127.6k - $191.4k
Senior Staff Software Engineer - IE07HEWe’re determined... ...requisition hires Senior AI Engineers who will:... ...deliver production‑grade Agentic AI systems using Google... ...lifecycle automation.Implement observability, monitoring, and... ...including 2+ years in GenAI, multi-agent, or LLM systems...
Full time
Temporary work
Work at office
3 days per week
The Hartford Financial Services Group
Charlotte, NC
2 days ago
AI Systems Engineer: DevOps, Observability & FinOps
...EY is seeking an AI Systems Engineer to own the delivery, model‑serving, routing, and observability layer of EY’s AI‑native platform. You’ll build automated delivery pipelines, govern AI assets, and ensure cost visibility across cloud, on‑prem, edge, and air‑gapped environments...
EY
Charlotte, NC
1 day ago
VP, AI Platform Engineer
$150k - $165k
...services industry, is seeking a VP, AI Platform Engineer to join their team. As a VP,... ...model lifecycle management, observability, and security. Create... ...Augmented Generation (RAG) and Agentic orchestration layers to enable complex GenAI workflows.What's Needed?Bachelor...
Temporary work
Flexible hours
Experis
Charlotte, NC
1 day ago
Director - Data & AI Engineering
$180k - $250k
...is a full-service digital engineering solutions company. We make... ...seeking a Director – Data & AI Engineering to lead the strategy... ...using data, analytics, ML, GenAI, and Agentic AI to deliver measurable... ..., privacy, security, and observability. ~ Practical knowledge of...
Temporary work
Ascendion
Charlotte, NC
21 hours ago
Senior Agentic AI Engineer Enterprise SDLC Automation
...Bank of America is seeking a Senior Engineer to lead the design and implementation of Agentic AI across the SDLC, defining strategy, architecture, and operating models. You will drive adoption of Copilot, Azure AI Foundry, and knowledge graphs to automate developer workflows...
Bank of America
Charlotte, NC
2 days ago
Senior AI Engineer
...Senior AI Platform Engineer Remote (Must be based in EST or CST) + quarterly travel to HQ... ...adoption across business functions. Agentic Workspace and Enterprise Automation... ...Replace manual handoffs with optimized, observable, and idempotent pipelines that can run...
Remote work
GTN Solutions
Charlotte, NC
4 days ago
AI Native Software Engineer
$94.4k - $316.3k
...and unleashing the power of AI to create value at speed for... ...Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced... ..., DevSecOps, security, observability, and AI, and you are comfortable... ...it, and designing the AI and agentic capabilities that operate inside...
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
3 days ago
AI Engineer III
$122k - $240.5k
...impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products... ..., and more implemented with strong governance, observability, and cost/performance discipline. Recruiting for...
Local area
Visa sponsorship
Deloitte
Charlotte, NC
4 days ago
Rovo & AI Prompt Engineer
...we design and implement the agentic software and processes that run... ...the operating model an engineering organization runs on, the ways... ...target. What we design from it is AI-native by construction. We... ...for a disability or religious observance, please call us toll free at...
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
3 days ago
AI-Native Software Engineering Americas Market
...and unleashing the power of AI to create value at speed for... ...Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced... ...cloud, security, data, and agentic engineering alongside senior... ...keeping your services healthy, observable, and recoverable in production...
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
3 days ago
AI Engineer
$108.48k - $184.41k
...storage, analytics, governance, and AI/ML capabilities that enable... ...AI solutions at scale. The AI Engineer develops and operationalizes... ...orchestration patterns, agentic workflows, and MLOps pipelines... ...and governed. Apply NLP, LLM/GenAI patterns, prompt orchestration...
Full time
Contract work
Work experience placement
Live in
Work at office
Immediate start
Remote work
ICF
Charlotte, NC
1 day ago
AI Engineer II
$91.1k - $179.5k
...impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products... ..., and other models, with strong governance, observability, and cost/performance discipline. Recruiting for...
Local area
Deloitte
Charlotte, NC
4 days ago
AI Engineer / Forward Deployed Engineer (AI Engineering)
...Job Title: AI Engineer / Forward Deployed Engineer (AI Engineering) Location: Charlotte,... ...hands-on experience with Generative AI (GenAI) and Large Language Models (LLMs) . The... ...and implement AI agents using modern agentic frameworks. Integrate AI solutions with...
Delan Associates, Inc
Charlotte, NC
21 hours ago
Senior Agentic Software Engineer
...Charlotte, NC Our client seeks a Senior Agentic Software Engineer who will design and deliver intelligent systems that combine AI agents, cloud-native architectures,... ...CD independently. ~ Familiarity with observability, telemetry, and operational monitoring....
Hourly pay
Contract work
Local area
Shift work
Eliassen Group
Charlotte, NC
2 days ago
Secure AI Engineer Manager
...reality.We are Secure, Responsible AI & Data Protection... ...enterprises can adopt AI and agentic capabilities confidently while... ...AreManagers are the hands-on delivery engine of the Secure AI practice. They... ...for a disability or religious observance, please call us toll free at 1...
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
3 days ago
Responsible AI Engineering Senior Manager
...and we believe that scaling AI responsibly is what makes it... ...industry knowledge, applied AI engineering, and trusted AI governance. We... ...run production-grade AI and agentic systems that are safe, fair,... ...for a disability or religious observance, please call us toll free at...
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Observability Engineer - GenAI & Agentic AI. Be the first to apply!