Cloud GenAI Governance Engineer
United Software Group
Job Title: Senior Cloud GenAI Governance Engineer
Location: Charlotte, NC (Hybrid - 3 Days Onsite Required)
We are seeking a Senior Cloud GenAI Governance Engineer to support enterprise-scale Generative AI platform engineering and AI runtime governance initiatives. The ideal candidate will have deep expertise in GenAI/LLM infrastructure, AI security guardrails, observability, cloud-native infrastructure, and distributed inference operations.
Key Responsibilities:
• Design and implement enterprise AI governance and runtime security frameworks for Generative AI and LLM platforms
• Develop and manage AI guardrails, compliance controls, prompt filtering, and runtime security solutions
• Implement and support Model Armor / AI Armor solutions for secure inference and request/response inspection
• Utilize Arize AI for AI observability, telemetry, inference tracing, and model behavior analysis
• Support API lifecycle tracing, API gateway operations, and distributed inference debugging
• Troubleshoot runtime bottlenecks, rate limiting, token throughput issues, and gateway failures
• Manage Kubernetes-based AI infrastructure and Terraform/IaC deployments across cloud environments
• Maintain and optimize Azure and GCP cloud landing zones supporting enterprise AI workloads
• Collaborate with platform engineering, security, and infrastructure teams to support responsible AI initiatives
Required Skills:
• Strong experience with Generative AI, GenAI platforms, LLM infrastructure, and AI runtime governance
• Expertise in AI security, AI guardrails, compliance, and observability frameworks
• Hands-on experience with Model Armor / ArmorCode or related AI security tooling
• Experience with Arize AI or enterprise AI observability platforms
• Strong Kubernetes (K8s) administration and troubleshooting skills
• Experience with Terraform and Infrastructure as Code (IaC)
• Strong cloud infrastructure experience with Azure and/or GCP
• Experience with APIs, API Gateways, inference runtime management, and distributed AI serving architectures
• Strong understanding of enterprise AI platform operations and cloud networking
Preferred Qualifications:
• Experience with distributed inference systems and LLM serving platforms
• Exposure to responsible AI and enterprise AI governance frameworks
• Experience supporting large-scale AI infrastructure environments
• Strong troubleshooting and incident management skills in cloud-native ecosystems
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Cloud GenAI Governance Engineer in Charlotte, NC vacancy
- ...Overview We are looking for a skilled AI Engineer with proven experience developing and... ...orchestration tools like Kubernetes and cloud functions. Implement robust CI/CD pipelines... ...autonomous agent system design. Data Governance & Compliance Knowledge of data governance...Cloud
- ...organization in the financial services industry, is seeking a Software Engineer 4 - Contingent to join their team. As a Software Engineer 4 -... ...with Autosys, OpenShift (OCP), and GCP or equivalent cloud environments. ~3+ years of experience with CI/CD tools and Identity...CloudContract work
Experis/Manpower Group
Charlotte, NC1 day ago - .... API Platform Architect for the APIC4E Engineering team. In the Sr. API Platform Architect... ...build and drive the consumption of API governance and standards, thereby providing Zero touch... ...~ Uses deep experience with AWS (Cloud Computing: EC2, S3, RDS, VPC, Security Groups...Cloud
Professional Recruiters
Charlotte, NC13 hours ago - ...Cloud GenAI Platform Engineer Location: Charlotte, NC (Hybrid) Duration: Long Term Contract Job Description We... ...resolution Nice to Have Exposure to GenAI governance/guardrails API gateway and rate limiting experience...CloudLong term contract
United Software Group
Charlotte, NC13 hours ago - ...native from the ground up. One identity, one governance envelope, one operational layer across... ..." of data integrations into a unified engine - less like assembling car parts, more like... ...Required ~10-16 years in enterprise data/cloud architecture as an SA, principal engineer...Cloud
NexusOne
Charlotte, NC3 days ago $77k - $202k
...Requirements: Up to 80% At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to... ...you leverage your proficiency in programming languages and cloud platforms to design and implement data architecture strategies...CloudFull timeH1bPwC
Charlotte, NC3 days ago- ...GenAI Developer Location: Charlotte, NC (Hybrid – 3 Days Onsite) Rate: DOE Experience... ...including design, development, and reverse engineering of enterprise-scale applications. The... ...principles Domain-Driven Design (DDD) Cloud-native architectures ~ Experience...Cloud
Staffing the Universe
Charlotte, NC2 days ago - ...ML projects. The ideal candidate has over 8 years in software engineering with a strong background in Python, LLMs, and cloud deployment. Responsibilities include developing applications using advanced GenAI techniques, mentoring teams, and driving innovation in AI strategies...CloudFor contractors
- ...Staffing Solutions is seeking a Senior Software Engineer in Charlotte, NC, with extensive experience in Python full-stack development and GenAI technologies. The role involves designing... ...scalable applications, focusing on cloud-native solutions. The ideal candidate must...Cloud
$137.61k - $168.19k
...future - including your own. As Sr Data Governance, Quality Analyst within Enterprise DG... ...architecture (data lakes and warehouses) with cloud platforms (AWS/GCP/Azure), enabling... ...AI-ready datasets. Applied software engineering best practices include version control (...CloudWork at officeFlexible hoursPacific Life
Charlotte, NC2 days ago- ...Senior Cloud GenAI Governance Engineer Role Overview: We are seeking a Senior Cloud GenAI Governance Engineer to manage enterprise-scale GenAI platform engineering. This role focuses on the critical gateway and security layers, managing the architecture flow from User...Cloud
NTT DATA
Charlotte, NC3 days ago $106.9k - $176.5k
...Management (DPM), Data Architecture and Engineering (DAE), and Data Analytics and Insights (... ...navigate the complex world of Information Data Governance and Data Quality, leveraging AI and... ..., Purview). Working knowledge of cloud providers like Azure, AWS, GCP, and experience...CloudWork experience placementSummer holidayFlexible hoursEY
Charlotte, NC13 hours ago- ...simplify infrastructure delivery while ensuring strong security, compliance, and cost governance. The Senior Azure Architect will design and standardize cloud architectures that enable engineering teams to deploy secure, scalable, and production-ready applications across...Cloud
SMX Services and Consulting, Inc.
Charlotte, NC2 days ago $124k - $280k
...At PwC, our people in data and analytics engineering focus on leveraging advanced... ...safeguarding data architecture compliance with governance and security policies. Responsibilities... ...What Sets You Apart - Certification in Cloud Platforms [e.g., AWS Certified Solutions...CloudFull timeH1b$144k - $329.1k
...Data & Analytics – Data Architecture and Engineering EY is the only professional... ...Architecture and Engineering (DAE), Data Governance and Controls (DGC), and Data Analytics and... ...strategic Data Architecture and Engineering, Cloud Data Modernization, Data migration and...CloudSummer holidayFlexible hoursEY
Charlotte, NC2 days ago- Data Modeler with Data Quality & Data Governance experience Technology|ETL & Data Quality|ETL & Data Quality - ALL Area... ...Required Skill and Experience Strong experience in data engineering/architecture across cloud or hybrid environments, with measurable impact on...CloudTemporary workRelocation
- ...leveraging advanced technologies such as AI, cloud, and data-led innovation to help our... ...• Strong experience in data engineering/architecture across cloud or hybrid environments... ...of metadata, lineage, data quality, and governance tooling (Collibra DQ, SALT, Informatica...CloudFull timeTemporary workRelocation
Infosys
Charlotte, NC1 day ago $47 per hour
...Solutions is immediately hiring for a Data Governance Consultant / Architect Position type:... ...data platform strategy and roadmap (cloud-native, Lakehouse, streaming/event-driven... ...and analytics (e.g., distributed query engines, graph databases, NoSQL, Oracle 23AI, Lakehouse...CloudHourly payFull timeContract workTemporary workWork experience placementImmediate startRemote workWorldwideFlexible hoursInnova Solutions
Charlotte, NC1 day ago- A financial services provider is searching for a Data Engineer to enhance their data initiatives. The role involves designing and building data pipelines, collaborating with teams, and ensuring best practices. Ideal candidates will have over 7 years of experience in data...Cloud
- ...Responsibilities Kforce has a client in Charlotte, NC that is seeking a Senior Cloud Governance Engineer.Key Responsibilities: ~ Own the end-to-end compliance lifecycle for cloud infrastructure; Ensure environments are continuously aligned with organizational...CloudHourly payContract work
Kforce
Charlotte, NC13 hours ago - ...global technology company is seeking a Technical Program Engineer to lead architectural governance and standardization efforts across platform engineering... ...and platform engineering, with a background in SaaS or cloud-native solutions. Strong communication skills and the...CloudFull time
- Barings LLC seeks a Director, AI Platform Manager to lead the lifecycle and governance of their enterprise AI platform. This role involves coordinating across various teams such as cloud, data, and security to ensure effective adoption and compliance. The ideal candidate...Cloud
- ...time, strategic role in leading the design, formalization, and governance of an enterprise-wide cybersecurity program. The successful candidate... ...regulated environments. Familiarity with IT/OT convergence, cloud environments, and regulatory frameworks such as CJIS and PCI-...CloudPart time
Confidential
Charlotte, NC4 days ago $120k - $130k
...data management, and proficiency in data governance frameworks. Candidates should have... ...reporting standards and experience working with cloud-native data platforms. The salary range... ..., with a focus on collaboration with engineering teams. #J-18808-Ljbffr Tata Consultancy...Cloud- ...qualified individual to manage core CMDB reference data and support governance initiatives in Charlotte, NC. The role requires a minimum of... ...and demands familiarity with platforms like ServiceNow and cloud technologies such as AWS or Azure. #J-18808-Ljbffr VanguardCloud
$110.5k - $202.7k
...applicant will have 5+ years of experience, a relevant degree, and strong project management skills. Responsibilities include overseeing cloud risk frameworks and client relationships. Competitive salary range of $110,500 to $202,700 based on experience and location, plus an...CloudFlexible hours- ...architectural patterns for knowledge base governance Guide teams on technical implementation... ...distributed systems Experience with major cloud AI services and platforms Deep understanding... ...abilities Large Language Models and GenAI technologies RAG architectures and implementation...Cloud
$155k - $410k
...shape the future of data strategy and governance within our organization. Responsibilities... ...Analytics / Solutions Architect - Azure Data Engineer / Azure Solutions Architect - Google... ...projects - Understanding modern cloud data architectures - Implementing cloud...CloudFull timeTemporary workH1b$120 - $140 per hour
Creative Solutions Services, LLC is hiring a Sr. Engineer for Machine Identity & Agentic AI Governance in Charlotte, NC. The role involves leading the deployment... ...are secured within systems while managing complex cloud environments. A strong background in infrastructure...CloudRemote job- Pacific Asset Management, LLC is looking for a Sr Data Governance, Quality Analyst to join their team in Charlotte, NC. This role involves... ...domain. Additional skills in SQL, stakeholder management, and cloud technologies are preferred. #J-18808-Ljbffr Pacific Asset Management...Cloud
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Cloud GenAI Governance Engineer. Be the first to apply!
Related searches
- aws cloud infrastructure engineer Charlotte, NC
- remote cloud architect Charlotte, NC
- senior cloud engineer Charlotte, NC
- cloud architect Charlotte, NC
- cloud engineering manager Charlotte, NC
- cloud engineer remote Charlotte, NC
- principal cloud engineer Charlotte, NC
- senior principal cloud computing engineer Charlotte, NC
- cloud operations engineer Charlotte, NC
- cloud solutions architect Charlotte, NC