On-Prem LLM Inference Engineer: GPU & AI Infra
Compunnel, Inc.
Compunnel, Inc. in Charlotte, North Carolina is seeking an On-Premise LLM Inference & GPU Systems Engineer. This role involves building, optimizing, and supporting a large-scale enterprise Generative AI infrastructure utilizing NVIDIA H200 GPU clusters and OpenShift AI. Candidates should have significant experience in GPU runtime optimization, Kubernetes orchestration, and managing open-source LLMs. Key qualifications include 5+ years of experience in relevant roles and hands-on expertise with NVIDIA GPU environments. This position offers a contract opportunity with significant responsibilities across enterprise AI workloads. #J-18808-Ljbffr Compunnel, Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the On-Prem LLM Inference Engineer: GPU & AI Infra in Charlotte, NC vacancy
- ...We are currently seeking a On-Premise LLM Inference & GPU Systems Engineer to join our team in Charlotte, North Carolina... ...). Job Description We are seeking an AI Infrastructure Runtime Engineer to build and maintain large-scale on-prem LLM infrastructure. This is an...Suggested
- ...in leveraging advanced AI and analytics to create... ...vLLM, Triton, TensorRT-LLM, or SGLang. Proficiency... ...tuning. Experience with GPU orchestration and scheduling... ...Deploy and run LLMs on-prem using OpenShift (OCP), OpenShift... .... GPU-first platform engineering: GPU orchestration,...SuggestedTemporary workRelocation
- ...026 Contract Active Job Description: Job Summary We are seeking an On-Premise LLM Inference & GPU Systems Engineer to build, optimize, and support a large-scale enterprise Generative AI infrastructure environment. This role is focused exclusively on Large Language Model...SuggestedContract work
- On-prem Platform Engineer Brevard, Charlotte Tech Stack Arize AI Claude Cowork GCP Terraform vLLM TensorRT LLM Triton Inference Server SGLang Inference Optimization Continuous Batching Speculative... ...OpenShift AI Helm / Operators GPU Orchestration Run:AI...Suggested
- ...decision-making. You will leverage advanced technologies, including AI, to refine algorithms, optimize models, and ensure data readiness... ...skills in data science tools such as Kubernetes and TensorRT-LLM. This role supports a collaborative environment focused on ongoing...Suggested
- Gina’s Tech Jobs - IT Recruiting Agency seeks an Artificial Intelligence (AI) Engineer for onsite work in Charlotte, NC. You will develop GPU-accelerated video inference pipelines and optimize YOLO-based models for real-time safety monitoring across large fleets and industrial...
- Velocitor Solutions is hiring a Full Time AI Engineer in Charlotte, NC to build GPU accelerated video analytics systems. The position involves developing and optimizing video inference pipelines, working with real-time data for safety monitoring. The ideal candidate has...Full time
- Ginas Tech Jobs is seeking an AI Engineer to build GPU‑accelerated video analytics for real‑time safety monitoring across large fleets and industrial... ...Hub and Blob Storage, delivering scalable ML pipelines on‑prem or cloud‑connected systems. The role requires 3+ years of CV...
- ...Charlotte, North Carolina, is seeking applicants for a dynamic role involving data and analytics. The position requires strong skills in AI and analytics applications while collaborating effectively with business and technology teams. Responsibilities include data...
- ...Developer / Backend Integration Engineer / Hybrid / Charlotte, NC or... ...modernizing its data science and AI platforms. Based out of... ...Exposure to model serving or inference gateways Microservices architecture... ...Docker or Kubernetes GenAI, LLM, or agent-based frameworks Familiarity...Full timeContract workTemporary workFlexible hours
$265k
...JunieAI, our purpose-built AI platform, we’re... ...Senior Staff Software Engineer Location: Americas (... ...production AI workloads, from inference pipelines to agent fleets... ...building infrastructure for AI/LLM workloads: inference serving, agent runtimes, GPU scheduling, or...Full timeWork at officeLocal areaRemote workWork from homeFlexible hoursGrabJobs
Charlotte, NC2 days ago- Accenture is seeking an AI Agent Data/ML Engineer in Charlotte, NC, to design and operationalize AI agents, and develop machine learning solutions... ...proficiency in Python and SQL, and a solid understanding of LLM integration. The role requires onsite work with clients three...3 days per week
- ...enterprise, reviewing and guiding all AI/ML use cases. Push the... .... Lead prompt and context engineering strategies to maximize model... ...and AI/ML platforms. Optimize LLM inference, implementing advanced... ...strategy, including rigorous GPU management, utilization, and...Local area
- ...AI Quality Engineer This is a HYBRID position requiring 2 in-office days at local Deloitte office per week. Travel costs are not reimbursable... ...engineering practices for AI-powered applications, including LLM-based assistants, retrieval solutions, and intelligent...Work at officeLocal area
Apolis
Charlotte, NC1 day ago - AEG is seeking a Software Engineer for its Carbonhouse Team in Charlotte, NC. This role focuses on integrating applied AI into production software, enhancing the development of scalable backend systems and APIs. The ideal candidate will collaborate with cross-functional...
- AEG WORLDWIDE is seeking a Software Engineer to join the carbonhouse team in Charlotte, NC. This role involves designing scalable backend systems and integrating AI capabilities into production software. The ideal candidate has strong programming experience, familiarity...Worldwide
- ...maintaining applications primarily in Java, along with integrating Python-based services and AI features. The ideal candidate should have strong backend development skills and experience with LLM-powered features. Responsibilities include building APIs, optimizing application...
- Title Sr. Java Developer with Python & LLM Location Charlotte, NC Position type W2 contract... ...contributing to Python‑based services and AI/LLM‑powered features. This role requires... ...teams including product managers, data engineers, and AI/ML teams. Ensure code quality...Contract work
- We Are: The Global AI Infrastructure team is at the center of enabling infrastructure... ...that powers AI platforms, GPU-accelerated workloads, large-scale models... ...NGC, NCCL, NVLink, and CUDA along with LLM inference engines (TensorRT‑LLM), production serving frameworks...Work experience placementLive inWork at officeLocal area
$100k - $110k
...Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy... ...global markets. We are building an agentic AI platform to transform commercial banking... ...Developer will design, build, and operate LLM-powered agents that interpret inbound servicing...Temporary workFlexible hours- ...Technologies Inc is seeking a Sr. Java Developer with Python and LLM exposure to join our backend team in Charlotte, NC. The role focuses... ...applications while contributing to Python-based services and AI features. The ideal candidate has strong Java skills, experience...Work at office
$92k - $115k
...entertainment. AXS is seeking a Software Engineer to join our carbonhouse team... ...a strong interest in applied AI to help build intelligent,... ...and large language model (LLM) workflows. You’ll work on backend... ...latency and cost of AI inference in production Developing tools...Full timeLocal areaFlexible hoursAXS
Charlotte, NC1 day ago- Senior Agentic AI Engineer Join a dynamic and fast‑evolving team that is building next‑generation AI‑based tools and agent systems for the... ...production software engineering, with at least 2 years building LLM‑powered systems in a production setting. Demonstrated...
- ...Role : AI Automation Engineer Location : Charlotte NC (100% Onsite) Job Description This role requires deep expertise in scripting... ...multiple AI agents via API endpoints Familiarity with LLM-based services, AI orchestration patterns, or AI-assisted decision...
United IT Solutions
Charlotte, NC2 days ago - TechDigital Group is seeking a seasoned software/data engineer to build production‑grade AI agents, tools, prompts, evals, and integrations on an established reference architecture. You will implement multi‑agent systems, RAG pipelines, and scalable APIs using Python and...
- ...Brooksource is searching for an AI/GenAI Security Architect to... ...for AI systems, while enabling engineering and data science teams to scale... ...(training, fine‑tuning, inference) Provide architecture guidance... ...implement security controls for LLM misuse, adversarial attacks, data...Full timeContract workCasual workLocal areaRemote workMonday to Friday
Brooksource
Charlotte, NC1 day ago $200k - $225k
...looking for a Senior Software Engineer to build and scale the backend systems that power our AI agent. This role sits at the intersection... ...pipelines supporting training, inference, and evaluation Partner... ...backend systems ML and LLM capabilities are seamlessly integrated...Remote workFlexible hoursGrabJobs
Charlotte, NC2 days ago- SolomonEdwards is looking for an AI Data Engineer to build data infrastructure, pipelines and support enterprise AI applications in Charlotte, NC. The role focuses on pipeline development, AI/ML integration, and ensures data quality and governance for machine learning...
- DPR Construction is looking for a Senior Agentic AI Engineer in Charlotte, North Carolina. Join a fast-evolving team focused on building next... ...6 years of software engineering experience, particularly with LLM-powered systems, and a strong foundation in Python. Excellent...
- A leading technology firm is seeking a skilled Software Engineer to develop production-grade AI systems. Responsibilities include building scalable applications... ...FastAPI. The ideal candidate will have experience with LLM concepts, retrieval-augmented generation, and continuous...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to On-Prem LLM Inference Engineer: GPU & AI Infra. Be the first to apply!
