AI Observability Engineer - GenAI & Agentic AI

GL Global

AI Observability Engineer - GenAI & Agentic AI

We’re looking for an experienced AI Observability Engineer to support the development and production of next-generation GenAI and Agentic AI systems.

This is a great opportunity for someone with a background in Observability, SRE, MLOps, Platform Engineering, AI/ML or Test Automation who wants to work on cutting-edge AI technology.

Key Responsibilities:

Build telemetry, monitoring, dashboards, alerts, tracing and SLOs for AI/LLM applications and agents
Develop LLM and AI evaluation frameworks covering response quality, prompts, RAG, latency, reliability and safety
Analyse production behaviour and identify improvements to AI quality, performance and reliability
Automate production readiness, reporting and governance processes
Create runbooks and operational documentation for AI releases
Work closely with Engineering and Product teams to define monitoring and evaluation requirements

Experience:

4+ years' engineering experience across observability, monitoring, platform engineering, SRE, AI/ML or test automation
Strong hands-on Python experience
Experience with metrics, logs, traces, dashboards, alerting and SLOs
Understanding of LLMs, AI agents, RAG or AI evaluation
Experience supporting production systems

If you're an AI Observability Engineer, GenAI Engineer, SRE, MLOps Engineer, Platform Engineer or AI/ML Engineer looking to work on production Agentic AI systems, we'd love to hear from you.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the AI Observability Engineer - GenAI & Agentic AI in Charlotte, NC vacancy

AI Engineer - GenAI / Agentic Systems - Financial Services - Infosys Consulting
...Consultant - Banking and Capital Markets - GenAI / Agentic Systems, Infosys ConsultingThe Role -... ...-on Financial Services Consultant with AI experience to design, build, and scale... ...-driven applicationsImplement prompt engineering, evaluation frameworks, and guardrailsPerform...
Suggested
Full time
Temporary work
Work experience placement
Infosys Technologies
Charlotte, NC
3 days ago
Google Agentic AI Delivery Senior Engineer
...elite technical and product engine of the Accenture Google Business... ...in technology: the move to Agentic AI and Product-Led Operating Models... ...Professional Data Engineer, GenAI Leader). Project experience... ...for a disability or religious observance, please call us toll free at...
Suggested
Full time
Work experience placement
Live in
Work at office
Local area
Shift work
Accenture
Charlotte, NC
1 day ago
Senior AI Agentic Engineer
...America)Please review the following job description:The Senior AI Agentic Engineer is a hands-on software engineer responsible for designing,... ...to delivering enterprise-ready solutions that are observable, testable, maintainable, and governed.ESSENTIAL DUTIES AND...
Suggested
Full time
Part time
Shift work
Day shift
Truist
Charlotte, NC
4 days ago
Agentic AI Engineer - Anthropic/Claude
$91.1k - $179.5k
Position Summary Agentic AI is moving from experimentation to production, and organizations... ...and at scale. We're growing a team of engineers who want to work at the center of that... ..., MCP integrations, agent evaluation, observability, safety controls, or production...
Suggested
Work at office
Local area
Visa sponsorship
Shift work
Deloitte
Charlotte, NC
3 days ago
Full Stack+Gen/Agentic AI, Engineer/Developer - Charlotte NC (onsite)
...Role: Full Stack+Gen/Agentic AI, Engineer/Developer Location: Charlotte NC (onsite) Interview Locations: San Jose, CA | Bridgewater,... ...Vertex AI Python Agent development / ADK LangChain & RAG Evals & AI Observability MCP Servers, A2A, PyTest...
Suggested
Full time
Arkhya Tech Inc.
Charlotte, NC
3 days ago
Senior AI Agentic Engineer - Build Production AI Agents
...Truist Wealth is seeking a Senior AI Agentic Engineer to design, build, deploy, and support production-grade AI agents and intelligent automation... ..., agent frameworks, and enterprise integrations to deliver observable, secure, and scalable AI solutions, collaborating across...
Jobleads-US
Charlotte, NC
3 days ago
Full Stack+Gen/Agentic AI, Engineer/Developer - Charlotte NC (onsite)
...Job Description Role: Full Stack+Gen/Agentic AI, Engineer/Developer \n Location: Charlotte NC (onsite) \n Interview Locations:... ...Python \n Agent development / ADK \n LangChain & RAG \n Evals & AI Observability \n MCP Servers, A2A, PyTest \n \n...
Arkhya Tech Inc.
Charlotte, NC
4 days ago
AI Principal Consultant- GenAI / Agentic Systems - FS
...Financial Services Consultant with AI experience to design, build, and scale GenAI-powered solutions for banking and... ...Implement prompt engineering, evaluation frameworks, and guardrails... ...Skills Exposure to Google ADK / agentic frameworks Experience with knowledge...
Full time
Work experience placement
Infosys Consulting
Charlotte, NC
1 day ago
Software Architect - AI Accelerated Engineering Lead (East)
...the next generation of AI-empowered software... ...in adopting AI-first engineering practices—bringing clarity... ...reliable, and safe.· Manage GenAI-driven teams:... ...using modern DevOps and observability practices.· Enable and... ...development: Daily use of agentic IDEs and advanced...
Temporary work
Local area
Slalom
Charlotte, NC
4 days ago
Engineering Lead - Agentic AI Platform Engineering & Performance
...of employees. We are seeking a highly accomplished Agentic AI Platform Engineering & Performance Distinguished level to define and drive the... ...that improve responsiveness, throughput, resiliency, observability, and operational efficiency for agentic systems in production...
Work at office
Flexible hours
Shift work
Day shift
Bank of America Corporation
Charlotte, NC
a month ago
AI Engineer
...Position: Intermediate-to-senior AI / Agent Engineer - Team Focus: Accelerate the design... ...and system health - Focus on observability using tools like Honeycomb, Splunk,... ...-on experience with LangGraph, GenAI LLMs, and agentic AI architectures - Familiarity with...
Shift work
Expert Technology Services
Charlotte, NC
2 days ago
Sr AI Engineer - Platform Engineering
$127.6k - $191.4k
Senior Staff Software Engineer - IE07HEWe’re determined... ...requisition hires Senior AI Engineers who will:... ...deliver production‑grade Agentic AI systems using Google... ...lifecycle automation.Implement observability, monitoring, and... ...including 2+ years in GenAI, multi-agent, or LLM systems...
Full time
Temporary work
Work at office
3 days per week
The Hartford Financial Services Group
Charlotte, NC
3 days ago
Agentic AI Developer
Build and ship production agentic AI features — agents, tools, prompts, evals, and integrations... ...in software development or data engineering Hands‑on experience in Generative AI or... ...regression suites, LLM‑as‑judge) and trace/observe agent runs. Implement guardrails:...
TechDigital Group
Charlotte, NC
4 days ago
Senior AI Engineer
...enterprise-grade Generative AI capabilities that are... ...business workflows. The AI Engineer plays a critical role in... ...Generation (RAG) pipelines, agentic AI orchestration, and shared GenAI services that power high-... ...Strong understanding of observability, monitoring, and...
Work experience placement
Wells Fargo
Charlotte, NC
6 days ago
Onsite_AWS GenAI Lead Engineer_Malvern PA/Charlotte NC
...seeking a highly skilled AWS GenAI Lead Engineer to analyze business... ...scalable, enterprise-grade agentic applications. The role combines... ...technical leadership across the AWS AI ecosystem. The ideal... ...integration, prompt engineering, observability, testing, and production deployment...
Contract work
Jobleads-US
Charlotte, NC
4 days ago
Lead Agentic AI Engineer
Our client, Consumer Intelligent Automation & AI is seeking a Software Engineer 4 - Contingent to join their team. As a Software Engineer 4 - Contingent, you will be part of the Agentic Engineering group supporting enterprise-grade AI products. The ideal candidate will...
Work experience placement
Experis/Manpower Group
Charlotte, NC
5 days ago
AWS GenAI Lead Engineer
...: AWS GenAI Lead Engineer Location :... ...scalable, enterprise-grade agentic applications. The role combines... ...technical leadership across the AWS AI ecosystem. The ideal candidate... ..., prompt engineering, observability, testing, and production deployment...
Contract work
TALENT Software Services
Charlotte, NC
12 days ago
Senior AI Platform Engineer
$124.36k - $146.3k
...Job Summary The Senior Engineer (Generative AI) is responsible for designing... ...scalable Generative AI (GenAI) solutions within an enterprise... ...engineering techniques Agentic AI concepts and workflows... ...implementing monitoring, logging, and observability practices for production...
Temporary work
Work experience placement
Local area
3 days per week
U.S. Bank
Charlotte, NC
4 days ago
Agentic AI for Quality Engineering (Hybrid Onsite)
...Job Title Agentic AI for Quality Engineering (Hybrid Onsite) Location Charlotte, NC Duration 6 Months Interview Type Virtual / In-Person Note Open to non-local candidates willing to relocate 3...
Local area
Relocation
GSK Solutions
Charlotte, NC
2 days ago
Senior AI/ML Engineer — Agentic Systems & RAG Pipelines
...Vanguard is seeking an experienced AI/ML engineer to design and implement agentic systems for IT automation and resilience, leveraging LLMs and agent frameworks. You will develop multi-agent workflows, optimize retrieval-augmented generation pipelines, and contribute...
Jobleads-US
Charlotte, NC
3 days ago
Snowflake Advanced AI Engineer,
...a business—until generative AI. Today, AI is the number one... ...can imagine.Join our Global Agentic Center of Excellence and help... ...Are:As a Snowflake Advanced AI Engineer, you will design, build, and... ...for a disability or religious observance, please call us toll free at...
Full time
Work experience placement
Live in
Work at office
Local area
Shift work
Accenture
Charlotte, NC
2 days ago
AI Native Software Engineer
$94.4k - $316.3k
...and unleashing the power of AI to create value at speed for... ...Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced... ..., DevSecOps, security, observability, and AI, and you are comfortable... ...it, and designing the AI and agentic capabilities that operate inside...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
2 days ago
Gen AI Engineer
...specialize in leveraging advanced AI and analytics to create... ...LLMs)Hands-on experience with agentic frameworks (multi-agent systems... ...understanding of:RAG architecturesPrompt engineering & prompt... ...assistantsFamiliarity with cloud-based GenAI platformsAdditional Required Qualifications...
Full time
Temporary work
Relocation
Infosys Technologies
Charlotte, NC
3 days ago
Agentic AI Senior Lead Data Scientist
$185k - $300k
About this role:Wells Fargo is seeking Agentic AI Senior Lead Data Scientist role as part of... ...of cutting-edge Generative AI (GenAI) and Natural Language Processing (NLP) solutions... ...discipline such as mathematics, statistics, engineering, physics, economics, or computer...
Full time
Work experience placement
Wells Fargo
Charlotte, NC
3 days ago
Rovo & AI Prompt Engineer
...we design and implement the agentic software and processes that run... ...the operating model an engineering organization runs on, the ways... ...target. What we design from it is AI-native by construction. We... ...for a disability or religious observance, please call us toll free at...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
3 days ago
Applied AI Engineer, Founding Team
...Accenture's Oracle Business Group AI Center of Excellence is one... ...just adopted them. You ship agentic systems, you know the... ...conversation.You might come from engineering, consulting, product, or pre-... ...for a disability or religious observance, please call us toll free at...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
2 days ago
AI & HPC Infrastructure Engineer
We Are:The Global AI Infrastructure team is at the center of... ...models, simulations, and emerging agentic AI solutions at scale. Our... ...workflow orchestration with observability, identity, and policy controls... ...along with LLM inference engines (TensorRT-LLM), production serving...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
1 day ago
Secure AI Engineer Manager
...reality.We are Secure, Responsible AI & Data Protection... ...enterprises can adopt AI and agentic capabilities confidently while... ...AreManagers are the hands-on delivery engine of the Secure AI practice. They... ...for a disability or religious observance, please call us toll free at 1...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Charlotte, NC
1 day ago
AI Security Engineer
...review the following job description:The AI Security Engineer is responsible for implementing,... ...artificial intelligence, generative AI, and agentic solutions across the enterprise. This... ...monitoring, logging, alerting, and observability concepts.Familiarity with no-code,...
Full time
Part time
Shift work
Day shift
Truist
Charlotte, NC
1 day ago
AI Infrastructure Engineer
...review the following job description:The AI Infrastructure Engineer is a hands-on platform and... ...foundations that enable enterprise AI and agentic solutions across the Truist Agentic... ...automation, deployment, reliability, observability, and operational excellence for AI-...
Full time
Part time
Shift work
Day shift
Truist
Charlotte, NC
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Observability Engineer - GenAI & Agentic AI. Be the first to apply!