AI Observability Engineer - GenAI & Agentic AI

GL Global

AI Observability Engineer - GenAI & Agentic AI

Not sure what skills you will need for this opportunity Simply read the full description below to get a complete picture of candidate requirements.

We're looking for an experienced AI Observability Engineer to support the development and production of next-generation GenAI and Agentic AI systems.

This is a great opportunity for someone with a background in Observability, SRE, MLOps, Platform Engineering, AI/ML or Test Automation who wants to work on cutting-edge AI technology.

Key Responsibilities:

Build telemetry, monitoring, dashboards, alerts, tracing and SLOs for AI/LLM applications and agents
Develop LLM and AI evaluation frameworks covering response quality, prompts, RAG, latency, reliability and safety
Analyse production behaviour and identify improvements to AI quality, performance and reliability
Automate production readiness, reporting and governance processes
Create runbooks and operational documentation for AI releases
Work closely with Engineering and Product teams to define monitoring and evaluation requirements

Experience:

4+ years' engineering experience across observability, monitoring, platform engineering, SRE, AI/ML or test automation
Strong hands-on Python xhyhwjd experience
Experience with metrics, logs, traces, dashboards, alerting and SLOs
Understanding of LLMs, AI agents, RAG or AI evaluation
Experience supporting production systems

If you're an AI Observability Engineer, GenAI Engineer, SRE, MLOps Engineer, Platform Engineer or AI/ML Engineer looking to work on production Agentic AI systems, we'd love to hear from you.

Apply

Vacancy posted 11 days ago

Similar jobs that could be interesting for youBased on the AI Observability Engineer - GenAI & Agentic AI in Charlotte, NC vacancy

AI Engineer - GenAI / Agentic Systems - Financial Services - Infosys Consulting
...Consultant - Banking and Capital Markets - GenAI / Agentic Systems, Infosys ConsultingThe Role -... ...-on Financial Services Consultant with AI experience to design, build, and scale... ...-driven applicationsImplement prompt engineering, evaluation frameworks, and guardrailsPerform...
Suggested
Full time
Temporary work
Work experience placement
Infosys Technologies
Charlotte, NC
1 day ago
Google Agentic AI Delivery Senior Engineer
...elite technical and product engine of the Accenture Google Business... ...in technology: the move to Agentic AI and Product-Led Operating Models... ...Professional Data Engineer, GenAI Leader). Project experience... ...for a disability or religious observance, please call us toll free at...
Suggested
Full time
Work experience placement
Live in
Work at office
Local area
Shift work
Accenture
Charlotte, NC
4 days ago
Agentic AI Engineer - Anthropic/Claude
$91.1k - $179.5k
Position Summary Agentic AI is moving from experimentation to production, and organizations... ...and at scale. We're growing a team of engineers who want to work at the center of that... ..., MCP integrations, agent evaluation, observability, safety controls, or production...
Suggested
Work at office
Local area
Visa sponsorship
Shift work
Deloitte
Charlotte, NC
1 day ago
Senior AI Agentic Engineer
...America)Please review the following job description:The Senior AI Agentic Engineer is a hands-on software engineer responsible for designing,... ...to delivering enterprise-ready solutions that are observable, testable, maintainable, and governed.ESSENTIAL DUTIES AND...
Suggested
Full time
Part time
Shift work
Day shift
Truist
Charlotte, NC
3 days ago
Senior Agentic AI Engineer
...Senior Agentic AI Engineer Location: Charlotte, NC (Hybrid) Duration: 12 Month Contract We are looking for experienced, highly disciplined... .../CD for new products without guidance. Familiarity with observability, telemetry, and operational monitoring. Product...
Suggested
Contract work
Shift work
Leading Utilities Organization
Charlotte, NC
4 days ago
Gen AI Engineer
OverviewInfosys Topaz is an AI-first suite of... ...building of enterprise GenAI applications with Lang... ...RAG, vector databases, agentic workflows (tool calling... ...-agent), and prompt engineering.• Working with Azure OpenAI... ....• LLMOps practices — observability, tracing, evaluation (...
Full time
Temporary work
Relocation
Infosys Technologies
Charlotte, NC
1 day ago
AI Cloud Engineer (Agentic AI Platforms & Infrastructure Automation)
...Job Description Title: AI Cloud Engineer (Agentic AI Platforms & Infrastructure Automation) \n Location: Onsite - Charlotte, NC \n... ...Agent Builder \n LangGraph, LangChain \n MCP, Agent Observability, Agent Evaluations, Agent Gateways, Policies, KBs, etc. \...
New York Technology Partners
Charlotte, NC
5 days ago
AI Principal Consultant- GenAI / Agentic Systems - FS
...Financial Services Consultant with AI experience to design, build, and scale GenAI-powered solutions for banking and... ...Implement prompt engineering, evaluation frameworks, and guardrails... ...Skills Exposure to Google ADK / agentic frameworks Experience with knowledge...
Work experience placement
Infosys Consulting
Charlotte, NC
12 days ago
Software Architect - AI Accelerated Engineering Lead (East)
...the next generation of AI-empowered software... ...in adopting AI-first engineering practices—bringing clarity... ...reliable, and safe.· Manage GenAI-driven teams:... ...using modern DevOps and observability practices.· Enable and... ...development: Daily use of agentic IDEs and advanced...
Temporary work
Local area
Slalom
Charlotte, NC
2 days ago
Engineering Lead - Agentic AI Platform Engineering & Performance
...of employees. We are seeking a highly accomplished Agentic AI Platform Engineering & Performance Distinguished level to define and drive the... ...that improve responsiveness, throughput, resiliency, observability, and operational efficiency for agentic systems in production...
Work at office
Flexible hours
Shift work
Day shift
Bank of America Corporation
Charlotte, NC
more than 2 months ago
Sr AI Engineer - Platform Engineering
$127.6k - $191.4k
Senior Staff Software Engineer - IE07HEWe’re determined... ...requisition hires Senior AI Engineers who will:... ...deliver production‑grade Agentic AI systems using Google... ...lifecycle automation.Implement observability, monitoring, and... ...including 2+ years in GenAI, multi-agent, or LLM systems...
Full time
Temporary work
Work at office
3 days per week
The Hartford Financial Services Group
Charlotte, NC
1 day ago
VP, AI Platform Engineer
$150k - $165k
...services industry, is seeking a VP, AI Platform Engineer to join their team. As a VP,... ...model lifecycle management, observability, and security. Create... ...Augmented Generation (RAG) and Agentic orchestration layers to enable complex GenAI workflows.What's Needed?Bachelor...
Temporary work
Flexible hours
Experis
Charlotte, NC
20 hours ago
Lead AI Platform Engineer
$139.23k - $163.8k
...DescriptionJob SummaryThe Lead Engineer (Generative AI) is a senior technical role... ...-scale Generative AI (GenAI) solutions. This position combines... ...Generation (RAG), and agentic AI architectures with... ...release managementMonitoring, observability, and continuous optimizationImplement...
Work experience placement
Local area
3 days per week
US Bank
Charlotte, NC
3 days ago
Rovo & AI Prompt Engineer
...we design and implement the agentic software and processes that run... ...the operating model an engineering organization runs on, the ways... ...target. What we design from it is AI-native by construction. We... ...for a disability or religious observance, please call us toll free at...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
1 day ago
AI-Native Software Engineering Americas Market
...and unleashing the power of AI to create value at speed for... ...Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced... ...cloud, security, data, and agentic engineering alongside senior... ...keeping your services healthy, observable, and recoverable in production...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
20 hours ago
AI Engineer III
$122k - $240.5k
...impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products... ..., and more implemented with strong governance, observability, and cost/performance discipline. Recruiting for...
Local area
Visa sponsorship
Deloitte
Charlotte, NC
3 days ago
AI Engineer
$108.48k - $184.41k
...storage, analytics, governance, and AI/ML capabilities that enable... ...AI solutions at scale. The AI Engineer develops and operationalizes... ...orchestration patterns, agentic workflows, and MLOps pipelines... ...and governed. Apply NLP, LLM/GenAI patterns, prompt orchestration...
Full time
Contract work
Work experience placement
Live in
Work at office
Immediate start
Remote work
ICF
Charlotte, NC
4 days ago
AI Engineer
This role builds and supports the AI Powered Experiences team’s... ...and shared AI infrastructure. The engineer will help deliver production-ready GenAI solutions for Workplace Technology... ...based patternsModel governance and observability, including Arize and evaluation frameworksKnowledge...
Full time
Work experience placement
Vanguard
Charlotte, NC
3 days ago
AI Engineer II
$91.1k - $179.5k
...impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products... ..., and other models, with strong governance, observability, and cost/performance discipline. Recruiting for...
Local area
Deloitte
Charlotte, NC
3 days ago
Lead Specialty Software Engineer - Agentic AI
...Fargo is seeking a Lead Specialty Software Engineer to support the design and delivery of... ...of enterprise applications and Agentic AI solutions using modern full stack, cloud... ...platformsExperience with AI governance, observability, evaluation frameworks, and responsible...
Full time
Work experience placement
Wells Fargo
Charlotte, NC
4 days ago
AI - Cybersecurity Forward Deployed Engineer - FDE Senior Manager
...Cybersecurity Forward Deployed Engineer is a production engineer who... ...engineering teams—to make AI systems secure, governed, and... ...security posture improvement.Agentic coding is not a supporting skill... ...a disability or religious observance, please call us toll free at...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
2 days ago
Lead AI Engineer
$96k - $181k
...yearsAbout the RoleKeyBank is seeking a Lead AI Engineer to design, build, and modernize AI-... ...and production support.Apply agentic AI patterns utilizing Gemini, LangGraph... ...development, testing, deployment, and observability.Apply SRE principles to ensure resiliency...
Full time
Work at office
Remote work
Flexible hours
KeyBank
Charlotte, NC
20 hours ago
Responsible AI Engineering Senior Manager
...and we believe that scaling AI responsibly is what makes it... ...industry knowledge, applied AI engineering, and trusted AI governance. We... ...run production-grade AI and agentic systems that are safe, fair,... ...for a disability or religious observance, please call us toll free at...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
3 days ago
Secure AI Engineer Manager
...reality.We are Secure, Responsible AI & Data Protection... ...enterprises can adopt AI and agentic capabilities confidently while... ...AreManagers are the hands-on delivery engine of the Secure AI practice. They... ...for a disability or religious observance, please call us toll free at 1...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
4 days ago
Applied AI Engineer, Founding Team
...Accenture's Oracle Business Group AI Center of Excellence is one... ...just adopted them. You ship agentic systems, you know the... ...conversation.You might come from engineering, consulting, product, or pre-... ...for a disability or religious observance, please call us toll free at...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
20 hours ago
AI Security Engineer
...review the following job description:The AI Security Engineer is responsible for implementing,... ...artificial intelligence, generative AI, and agentic solutions across the enterprise. This... ...monitoring, logging, alerting, and observability concepts.Familiarity with no-code,...
Full time
Part time
Shift work
Day shift
Truist
Charlotte, NC
4 days ago
VP- AI Ops Engineer
$155k - $165k
...financial services industry, is seeking a VP- AI Ops Engineer to join their team. As a VP- AI Ops... ...department supporting AI and GenAI platform operations. The ideal candidate... ...ensuring compliance and traceability. Create observability frameworks for data quality, model drift...
Temporary work
Flexible hours
Experis
Charlotte, NC
20 hours ago
AI & HPC Infrastructure Engineer
We Are:The Global AI Infrastructure team is at the center of... ...models, simulations, and emerging agentic AI solutions at scale. Our... ...workflow orchestration with observability, identity, and policy controls... ...along with LLM inference engines (TensorRT-LLM), production serving...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
4 days ago
Senior Engineer- AI Security, Systems Engineering & Developer Productivity
...technical, hands-on Senior Engineer with deep Systems... ...Engineering expertise to lead AI security, platform... ...Copilot, Copilot Studio, GenAI development frameworks,... ...engineering, and agentic AI architectures. Experience... ...with enterprise observability, operational excellence...
Work at office
Flexible hours
Shift work
Day shift
Bank of America Corporation
Charlotte, NC
28 days ago
AI Engineer
...Agentic AI Engineer Wells Fargo is seeking a Senior Engineer to design, build, and scale agentic AI solutions using Microsoft Copilot... ...strategies, and CI/CD processes Implement monitoring and observability for agent workflows, including execution tracing, performance...
Tekfortune Inc
Charlotte, NC
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Observability Engineer - GenAI & Agentic AI. Be the first to apply!