Senior GPU AI Platforms Engineer - Edge LLM Inference
NVIDIA
NVIDIA’s Local AI team is building the software stack for running large language models and generative AI applications efficiently on NVIDIA edge AI hardware. This role focuses on performance analysis, model validation, and developing inference recipes across multi-node configurations. The candidate will work with CUDA/C++, Triton, and Python, evaluating new architectures, implementing optimizations, and collaborating with communities and partners to ensure robust model bring-up on NVIDIA GPUs. #J-18808-Ljbffr NVIDIA
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior GPU AI Platforms Engineer - Edge LLM Inference in Durham, NC vacancy
$224k - $356.5k
...unlimited potential of AI to define the next... ...era in which our GPU acts as the brains... ...on NVIDIA edge AI hardware. The AI... ...experience. We own the platform — performance, CI/... ...open-source LLM inference frameworks — identify... ...Science, Computer Engineering, Electrical Engineering...SeniorFull timeLocal area- NVIDIA in Durham, NC is seeking outstanding AI systems engineers to develop groundbreaking inference software. You will build libraries, code generators, and GPU kernel technologies for NVIDIA's hardware, designing new abstractions and high-performance runtimes for large...Senior
$152k - $241.5k
.... As part of Nvidia's applied AI team for chip design, you will... ...the intersection of research, engineering, and product development, transforming... ...latest research and cutting-edge technologies shaping... ...demonstrated experience shipping AI/LLM-powered applications, agents,...SeniorFull time$100k - $150k
...company delivering cloud, AI, data, and enterprise solutions... .... Job Title: AI Platform Engineer Location: 100% Remote (Continental... ..., and operate scalable AI inference platforms for production ML... ...in distributed systems, LLM serving, GPU optimization, autoscaling,...SuggestedFull timeH1bLocal areaImmediate startRemote workVisa sponsorshipBright Vision Technologies
Chapel Hill, NC26 days ago$152k - $241.5k
...performance computing platforms are powering the AI revolution across... ...deep learning models’ inference and training passes to identify key GPU kernel and fusion opportunities... ...Science, Computer Engineering, or related field (or... ..., SGLang, vLLM, TRT-LLM, or others.Experience...SeniorFull time- ...located in Durham, NC, is seeking talented developers to join the CUTLASS team. Candidates will work on high-performance computing platforms and develop components for Tensor Core features in CUDA C++. Ideal applicants have a Masters or PhD in Computer Science, strong...Senior
$184k - $287.5k
We're looking for outstanding AI systems engineers to develop groundbreaking technologies in the inference systems software stack! We build... ..., code generators, and GPU kernel technologies for NVIDIA... ...attention kernel implementations, new LLM inference runtimes components,...Senior$272k - $431.25k
...NVIDIA is the engine of modern AI, and robotics is where AI meets the physical... ...world. The Isaac robotics platform — spanning Isaac Sim,... ..., training, and on-robot inference on Jetson and edge platforms.Deliver. Drive planning... ...Working understanding of GPU-accelerated computing and...SeniorFull time$184k - $287.5k
We are now looking for a Senior GPU Memory Architect.NVIDIA is seeking... ..., and power on leading-edge silicon processes. This GPU memory... ...solutions for autonomous vehicles, AI, gaming, mobile systems.What... ...experience in Electrical Engineering, Computer Science, Computer...SeniorFull timeWork experience placement$184k - $287.5k
We are now looking for a Senior GPU & Deep Learning Architect!The... ..., both training and inference, and maintain our leadership... ...Computer Science, Electrical Engineering or Computer Engineering or... ...real-time, cost-effective AI computing platform driving our success in...SeniorFull time$136k - $218.5k
...are now looking for a Senior ASIC Engineer! NVIDIA is searching for... ...at the leading edge of artificial intelligence... ...the future computing platform.As a member of the MMU... ...performance MMU for a GPU using advanced verification... ...vacancy. NVIDIA uses AI tools in its...SeniorFull timeWorldwide- ...Victra is building its AI engineering capability in-house, and... ...architecture set by senior engineers. This is a deliberately... ...an automation or Power Platform builder ready to move... ...ships Troubleshoot edge cases and production... ...agent frameworks or LLM observability tooling (...
Victra - Verizon Wireless Premium Retailer
Durham, NC4 days ago $130k - $180k
...delivering cloud, AI, data, and enterprise... ...Title NLP AI Engineer Location: 100%... ...learning frameworks and GPU clusters.... ...scale GPU training, inference performance, experiment... ...best practices for LLM development, and mentor... ...with cloud platforms such as AWS, Microsoft...Full timeH1bLocal areaImmediate startRemote workVisa sponsorshipBright Vision Technologies
Chapel Hill, NC26 days ago$152k - $241.5k
NVIDIA's high-performance computing platforms are powering the AI revolution across many applications and... ...for Tensor Core and related GPU hardware features in MLIR, Python, and... ...degree in Computer Science, Computer Engineering, or related field (or equivalent experience...SeniorFull time- ...Develop, deploy, and optimize AI/ML solutions using AWS AI services... ..., supporting model training, inference, and integration into... ...agentic AI systems, including LLM-based agents, multi-agent workflows... ...using Jenkins and container-based platforms such as ECS, EKS, or...
RIT Solutions, Inc.
Durham, NC3 days ago $152k - $241.5k
...unlimited potential of AI to define the next... ...era in which our GPU acts as the brains... ...now looking for a Senior Full-stack web applications... ...and visualization platform to power NVIDIA's... ...for hardware engineers and management across... ...LangChain), building LLM-powered autonomous...SeniorFull time$130k - $180k
...delivering cloud, AI, data, and enterprise... ...Applied AI Engineer Location: 100%... ...scalable training, inference, and MLOps pipelines... ...distributed training, GPU optimization, model... ...Experience with cloud platforms such as AWS, Microsoft... ...Experience with LLM fine-tuning ,...Full timeH1bLocal areaImmediate startRemote workVisa sponsorshipBright Vision Technologies
Chapel Hill, NC26 days ago$165k - $248k
...A leading software company is seeking a Director of Engineering to design and build cloud-native services focusing on resilience and collaboration with cross-functional teams. Candidates should have a Bachelor's or Master's degree, at least 5 years of experience in cloud...SeniorTalkdesk
Durham, NC21 hours ago- ...Responsibilities • 10–14 years experience in cloud infrastructure engineering • Strong expertise in AWS, Kubernetes, and CI/CD automation • Hands-on coding skills in Python, Go, and Ruby for platform development • Experience building and maintaining large-scale...Senior
Omni Inclusive
Durham, NC3 days ago $90k - $135k
...Senior Software Engineer Drive the future of Agentic AI at Pearson as part of the AgentOps Engineering... ...and help build the core platform capabilities that power... ...ll Bring You build LLM-powered systems, agents,... ...culture. Access to cutting-edge tools, platforms, and...SeniorFull timePearson Education Services
Durham, NC21 hours ago$110k - $140k
A renewable energy tech company in North Carolina is seeking a Machine Learning Engineer to build data pipelines and deliver innovative solutions for solar panel optimization. The ideal candidate has a strong programming background, experience with data services, and familiarity...SeniorFull timeSunergi Inc
Durham, NC21 hours ago$180k - $220k
...Details*** Microsoft Foundry (Azure AI Foundry) hands-on experience... ...services / Azure OpenAI and LLM/RAG architectures. * MCP, RAG... ...generation, and prompt engineering. * Microsoft Fabric & One Lake... ...strong Python. *Description* The Senior AI/ML Engineer helps move AI from...SeniorPermanent employmentTEKsystems
Durham, NC21 hours ago- Pearson is hiring a Senior Software Engineer for its AgentOps Engineering team. You will build production-grade agentic systems, focusing on write... ..., orchestration, and reliable routing across enterprise AI agents. The role emphasizes Python backend engineering, cloud...SeniorFull timeRemote work
- ...DESCRIPTION OVERVIEW CREO’s AI Enablement team helps life... ...upskilling, and development. As a Senior Analyst, you will play a... ...client business objectives using platforms such as Microsoft Copilot... ...documentation. AI Process Engineering Analyzing current workflows...SeniorFull timeWork experience placementWork at office
CREO
Durham, NCa month ago - Direct Supply, Inc. is looking for a Senior Staff Software Engineer in Durham, NC to lead the design of AI-driven systems impacting senior living technology. This role requires collaboration with engineering leaders and a strong skill set in strategic thinking, technology...Senior
- ...technology solutions provider in North Carolina is seeking a Senior Software Engineer focused on platform performance and resilience. The role involves ensuring... ...and performance across multi-tier systems using AI-enabled automation. Candidates should have strong skills...Senior
$136k - $218.5k
...re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots,... ...world.We're looking for a talented, motivated Senior Design Verification Engineer to join our GPU memory subsystem team in...SeniorFull time$136k - $218.5k
...tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers,... ...on the world.NVIDIA is seeking a Senior ASIC Compose Verification Infrastructure and Tools Engineer to advance the systems that...SeniorFull time$184k - $287.5k
...currently seeking a Senior Developer Technology Engineer, Artificial Intelligence... ...to accelerate AI workloads on advanced... ...develop techniques to GPU accelerate workloads... ...solutions are at the cutting edge of technology,... ...-effective computing platform driving our success in...SeniorFull timeWork experience placement$152k - $241.5k
NVIDIA's high-performance computing platforms are powering the AI revolution across many applications and... ...teams across NVIDIA including the GPU architecture, NVVM/PTX compiler, CUDA... ...degree in Computer Science, Computer Engineering, or related field (or equivalent experience...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GPU AI Platforms Engineer - Edge LLM Inference. Be the first to apply!
Related searches
- ai developer Durham, NC
- ai engineer Durham, NC
- senior platform engineer Durham, NC
- platform developer Durham, NC
- platform engineer Durham, NC
- srs distribution Durham, NC
- senior associate architect Durham, NC
- senior dynamics crm developer Durham, NC
- senior application security Durham, NC
- senior supervisor Durham, NC