Senior Solutions Architect, AI Inference
$184k - $287.5kNVIDIA
We are looking for an architect that wants to change how the AI inference industry works. With agent adoption taking off and GPUs in shortage, NVIDIA has a key part to play in solving the technical challenges that scale token generation on finite resources. Our ISP (inference service provider) team supports some of our most strategic partners who rely on SA support to push the boundaries of performance, squeezing value and reliability out of vast NCP (NVIDIA Cloud Partner) infrastructure. You'll master full-stack inference with every SOTA bell and whistle, from smarter routing to rack-scale disaggregation down to kernel optimization. You'll write reference architectures adopted by 10k+ gpu clusters. You'll teach C-level executives, distinguished engineers and datacenter developers how to scale their businesses, systems and infrastructure. This role covers a wide range of technical skills and the ability to lead high-stakes conversations with partners. Nobody can cover everything! For that reason, we're looking for someone with fast-learning technical agility and comfort with partners or customers. We'll build a leading tech stack internally, then bake all our best tricks into a reference architecture and guide the industry to follow in our footsteps. What you'll be doing: Work with inference partners who build cutting-edge inference services, teach them the value of our stack and bring back product insights that benefit the whole industry. Build and operate inference recipes with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency. Accelerate inference pipelines using TensorRT-LLM, vLLM, SGLang, and other backends to ensure seamless integration with disaggregated inference. Evangelize devops best-practices for such as managing kubernetes clusters, configuring compute fabrics, and observability. Provide mentorship and technical leadership to customers and internal teams, guiding them through the deployment of disaggregated inference systems and resolving complex issues. What we need to see: 12+ Years in Solutions Architecture (or Solution Engineering, Forward-Deployed Engineering, or similar) driving customer engagements to deploy distributed systems, including 2+ years with AI workloads on Kubernetes. Experience with one of NVIDIA Dynamo, Triton Inference Server, or TensorRT-LLM for model optimization and serving. Deep knowledge of modern inference best practices including disaggregated serving, multi-tier KV cache management, speculative decoding, quantization and custom inference kernels. Hands-on full-stack agent design with modern sandboxing, memory and retrieval systems with evaluation, skill design and governance. BS in CS/Engineering or equivalent experience. Ways to stand out from the crowd: Prior experience deploying NVIDIA inference technologies such as Dynamo, NIXL and Grove. Experience with model customization techniques such as SFT, DPO, GRPO, RLVR and corresponding data curation techniques. Contributions to open-source projects relevant to the above. Widely considered to be one of the technology world's most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 184,000 USD - 287,500 USD for Level 4; and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until November 17, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. NVIDIA
$163.8k - $200.2k
...next era of technology - hyperscalers, AI labs, the AI hardware supply chain,... ...us.THE ROLEEverpure is looking for a Senior Services Solution Architect to lead the development of Advanced Services... ...of how model selection, inference, embeddings, retrieval and evaluation...SeniorFlexible hours- ...customers.We are looking for a Solutions Architect with expertise in cloud... ...What You Will Be Doing: As a Senior Solutions Architect II, you... ...evolving cloud landscape, and AI/ML platforms.Advocate for customers... ...applications like chatbots, inference services or recommendation...SeniorLocal areaRemote workWorldwideFlexible hours
$152k - $241.5k
...NVIDIA's three computer workloads for Physical AI. These include robotics simulation, synthetic... ...data generation, multi-step model training, and inference, all on a large scale! We are seeking a hands-on Solutions Architect with deep expertise in backend infrastructure,...Senior$184k - $287.5k
NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI technology... ...work on exciting projects and proof-of-concepts focused on inference for Generative AI and Large Language Models (LLMs). You...Senior$184k - $287.5k
...tapping into the unlimited potential of AI to define the next era of computing. NVIDIA is searching for an AI/ML Solutions Architect focusing on Hyperscale customers and Cloud... ...customer technical engagement for AI training, inference and infrastructure being deployed at vast...Senior$184k - $287.5k
...tapping into the unlimited potential of AI to define the next era of computing-an... ...world.NVIDIA is seeking an experienced Solutions Architect to be a trusted technical advisor, bridging... ...Dynamo, NeMo Retriever, NVIDIA Triton Inference Server, TensorRT, TensorRT-LLM, NVIDIA...SeniorFull timeRemote work$184k - $287.5k
NVIDIA is looking for an AI Solutions Architect with deep, hands-on experience in large-scale GPU systems. This role involves working with some... ..., and observability. Profiling distributed training and inference workloads to identify bottlenecks across GPUs, CPUs, memory...SeniorLocal areaRemote work- ...time payment processing to large-scale AI inference. As more companies move production workloads... ...scaling, cost, and security. They need architects who go deep. In this role you will help... ...and scale needed to build innovative solutions for their most complex challenges....SeniorWorldwide
- ...The Role This is a senior, customer-facing role that sits at the... ...intersection of technical leadership, solution architecture, and strategic... ...supporting other Solutions Architects through knowledge sharing, coaching... .... Championing the use of AI and automation to improve...SeniorContract workWork at office
$165.8k - $248.6k
.... As a Fortune 500 company and a leading AI platform for managing people, money, and... ...and drive. Whether you're building smarter solutions, supporting customers, or creating a... ...audiences across the globe. At Workday, Solution Architects think creatively and strategically with...SeniorFull timeWork at officeRemote workHome officeFlexible hours$150k - $180k
Forward Deployed AI Engineer Provectus is a Premier... ...you'll be the most senior technical person in... ...tuning, distillation, or inference/serving optimization.... ...teams alongside Principal Architects and Forward Deployed... ...-edge AI and cloud solutions Unlimited Vacation policy...SeniorWork at officeRemote workWorldwide$184k - $287.5k
...groundbreaking and innovative accelerated computing platforms for AI and HPC. Because of our work, scientists, researchers, and... ...’s fastest supercomputers.We are seeking a highly motivated Senior Solutions Architect to join the NVIDIA Cloud Partners team with a focus on GPU,...SeniorFull timeRemote work$140k - $183.75k
...reliable applications faster.The need is growing fastest in AI, where agents run for hours or days and depend on services... ...Cadence at Uber before starting Temporal.SummaryWe’re hiring two Senior Solutions Architects for our Commercial team: one focused on new logo...SeniorRemote work- ...York; USAWork type: RemoteSeniority: Senior ManagementPrimary skill: Solution ArchitecturePosted: 2026-09-29... ...are past the point of asking whether AI belongs in their systems. The question... ...can build against them - is the AI Architect's job.You will design the target architecture...SeniorTemporary work
$180.2k - $247.7k
...professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we... ...— and we’re just getting started. Role Overview The Senior Solutions Architect at is a critical role that bridges the gap between our product...SeniorFull time$150k - $200k
Compensation Range:$150,000.00 - $200,000.00 Annual SalaryJob Description Summary:We are seeking a Senior Solution Architect to design, build, and evolve Swinerton’s enterprise data and AI platform, ensuring it is technically strong, AI‑ready, and tightly aligned to business...SeniorFull timeTemporary workFlexible hours- ...Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to... ...the development and positioning of joint security solutions with Accenture. As an experienced Solution Architect, you will be responsible for working directly with...SeniorFull timeRemote workVisa sponsorshipWork visa
- About usAppnovation is the AI Product Company. Headquartered in... ...delivers enterprise AI and digital solutions, and co-invests with clients... ...seeking a Principal Solutions Architect to define the architecture for... .... This position requires a senior, hands-on technical leader who...SeniorContract work
$190k - $260k
Senior Cybersecurity Solutions Architect (NYC) Location New York Business Area Legal, Compliance, and Risk Ref # 10054538 Description... ...process landscape (e.g., Network Security, EDR, Cloud, AI, Telemetry), managing and integrating the vendor...SeniorTemporary workFor contractorsWork experience placement$169k - $228.6k
Join the AWS Solutions Architecture team that partners with one of the world's most-watched... ...across ad-supported streaming; and generative AI experiences that change how content is... ..., and diverse perspectives. Apply now to architect the future of how the world watches.Key...SeniorTemporary workFlexible hours- ...growth, and enhance services through technology, data, and AI.The Oracle Business Group (OBG) brings industry... ...SCM, CX, Analytics, Integration, OCI, AI, and industry solutions.Our Oracle Solution Architect Team partners with clients, account teams, and delivery...SeniorWork experience placementLive inWork at officeLocal area
$169k - $228.6k
...possible in the cloud? Amazon Web Services (AWS) is looking for a Senior Solutions Architect to partner with one of the fastest-growing accounts in the... ..., from modernizing legacy platforms to exploring agentic AI implementations that unlock new value across customer lines...SeniorFlexible hoursDay shift$169k - $228.6k
...seeking a Healthcare & Life Sciences (HCLS) Solutions Architect to join our HCLS organization within AWS... ..., Machine Learning, Generative AI, Serverless and Container-based architectures... ...The role builds deep relationships with senior technical individuals within customer organizations...SeniorFlexible hoursDay shift$153.6k - $207.8k
...transform their businesses with cloud and AI technologies? Amazon Web Services (AWS) Global Sales is seeking a Solutions Architect III to join our Digital Native team, working... ...or architecting real-time ML inference pipelines for recommendation engines.About...SeniorFlexible hours$153.6k - $207.8k
...challenges, then craft innovative solutions that accelerate their success.... ...Web Services (AWS) Solutions Architect team partners with customers... ..., analytics, and Generative AI. The ability to connect technology... ...Build deep relationships with senior technical individuals within...SeniorWorldwideFlexible hours$150k - $262k
...could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI... ...AI to work for people. Job Description The role This senior principal solution architect is a functional and technical expert who consults with customers...SeniorWork at officeImmediate startRemote workFlexible hours$168k - $231k
...26-09-11Perficient is seeking a senior, commercially minded Databricks Senior GTM Architect to shape and productize Perficient... ...complex, high-value technical solutions at the Director level, within our... ...practitioner-level knowledge of AI tools and how to apply them to...SeniorFull timeWork at officeLocal areaFlexible hours$169k - $228.6k
...interpersonal skills. As a Solutions Architect, you will partner some of the... ...migration pipelines and growing AI/ML engagement, requiring an... ...including model deployment, inference optimization, and generative... ...deep relationships with senior technical individuals within...SeniorFlexible hoursDay shift- ...Job Description Job Description Senior Solution Architect Financial Systems Position Summary The client is seeking an experienced Senior Solution... ...across multiple platforms and areas of IT. Define the AI strategy for financial systems, identifying opportunities...SeniorRemote work
$275k - $325k
...insurance product and its pricing. We are looking for a Senior Solution Architect to help insurance clients in North America and Latin America... ...confidentially. We may use artificial intelligence (AI) tools to assist with certain stages of the recruitment process...SeniorFull timeCasual work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Solutions Architect, AI Inference. Be the first to apply!
- entry level aws solution architect New York, NY
- senior solution manager New York, NY
- presales solution architect New York, NY
- principal solution architect New York, NY
- business solutions manager New York, NY
- solution architect contract New York, NY
- mobile solution architect New York, NY
- solution designer New York, NY
- solutions architect New York, NY
- solution engineering manager New York, NY



