Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Solutions Architect, AI Inference

$184k - $287.5k

NVIDIA

We are looking for an architect that wants to change how the AI inference industry works. With agent adoption taking off and GPUs in shortage, NVIDIA has a key part to play in solving the technical challenges that scale token generation on finite resources. Our ISP (inference service provider) team supports some of our most strategic partners who rely on SA support to push the boundaries of performance, squeezing value and reliability out of vast NCP (NVIDIA Cloud Partner) infrastructure. You'll master full-stack inference with every SOTA bell and whistle, from smarter routing to rack-scale disaggregation down to kernel optimization. You'll write reference architectures adopted by 10k+ gpu clusters. You'll teach C-level executives, distinguished engineers and datacenter developers how to scale their businesses, systems and infrastructure. This role covers a wide range of technical skills and the ability to lead high-stakes conversations with partners. Nobody can cover everything! For that reason, we're looking for someone with fast-learning technical agility and comfort with partners or customers. We'll build a leading tech stack internally, then bake all our best tricks into a reference architecture and guide the industry to follow in our footsteps. What you'll be doing: Work with inference partners who build cutting-edge inference services, teach them the value of our stack and bring back product insights that benefit the whole industry. Build and operate inference recipes with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency. Accelerate inference pipelines using TensorRT-LLM, vLLM, SGLang, and other backends to ensure seamless integration with disaggregated inference. Evangelize devops best-practices for such as managing kubernetes clusters, configuring compute fabrics, and observability. Provide mentorship and technical leadership to customers and internal teams, guiding them through the deployment of disaggregated inference systems and resolving complex issues. What we need to see: 12+ Years in Solutions Architecture (or Solution Engineering, Forward-Deployed Engineering, or similar) driving customer engagements to deploy distributed systems, including 2+ years with AI workloads on Kubernetes. Experience with one of NVIDIA Dynamo, Triton Inference Server, or TensorRT-LLM for model optimization and serving. Deep knowledge of modern inference best practices including disaggregated serving, multi-tier KV cache management, speculative decoding, quantization and custom inference kernels. Hands-on full-stack agent design with modern sandboxing, memory and retrieval systems with evaluation, skill design and governance. BS in CS/Engineering or equivalent experience. Ways to stand out from the crowd: Prior experience deploying NVIDIA inference technologies such as Dynamo, NIXL and Grove. Experience with model customization techniques such as SFT, DPO, GRPO, RLVR and corresponding data curation techniques. Contributions to open-source projects relevant to the above. Widely considered to be one of the technology world's most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 184,000 USD - 287,500 USD for Level 4; and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until November 17, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. NVIDIA

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Solutions Architect, AI Inference in New York, NY vacancy
  • $163.8k - $200.2k

     ...next era of technology - hyperscalers, AI labs, the AI hardware supply chain,...  ...us.THE ROLEEverpure is looking for a Senior Services Solution Architect to lead the development of Advanced Services...  ...of how model selection, inference, embeddings, retrieval and evaluation... 
    Senior
    Flexible hours

    Pure Storage

    New York, NY
    1 day ago
  •  ...customers.We are looking for a Solutions Architect with expertise in cloud...  ...What You Will Be Doing: As a Senior Solutions Architect II, you...  ...evolving cloud landscape, and AI/ML platforms.Advocate for customers...  ...applications like chatbots, inference services or recommendation... 
    Senior
    Local area
    Remote work
    Worldwide
    Flexible hours

    DigitalOcean

    New York, NY
    4 days ago
  • $152k - $241.5k

     ...NVIDIA's three computer workloads for Physical AI. These include robotics simulation, synthetic...  ...data generation, multi-step model training, and inference, all on a large scale! We are seeking a hands-on Solutions Architect with deep expertise in backend infrastructure,... 
    Senior

    NVIDIA

    New York, NY
    1 day ago
  • $184k - $287.5k

    NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI technology...  ...work on exciting projects and proof-of-concepts focused on inference for Generative AI and Large Language Models (LLMs). You... 
    Senior

    NVIDIA

    New York, NY
    1 day ago
  • $184k - $287.5k

     ...tapping into the unlimited potential of AI to define the next era of computing. NVIDIA is searching for an AI/ML Solutions Architect focusing on Hyperscale customers and Cloud...  ...customer technical engagement for AI training, inference and infrastructure being deployed at vast... 
    Senior

    NVIDIA

    New York, NY
    1 day ago
  • $184k - $287.5k

     ...tapping into the unlimited potential of AI to define the next era of computing-an...  ...world.NVIDIA is seeking an experienced Solutions Architect to be a trusted technical advisor, bridging...  ...Dynamo, NeMo Retriever, NVIDIA Triton Inference Server, TensorRT, TensorRT-LLM, NVIDIA... 
    Senior
    Full time
    Remote work

    Nvidia

    New York, NY
    3 days ago
  • $184k - $287.5k

    NVIDIA is looking for an AI Solutions Architect with deep, hands-on experience in large-scale GPU systems. This role involves working with some...  ..., and observability. Profiling distributed training and inference workloads to identify bottlenecks across GPUs, CPUs, memory... 
    Senior
    Local area
    Remote work

    NVIDIA

    New York, NY
    1 day ago
  •  ...time payment processing to large-scale AI inference. As more companies move production workloads...  ...scaling, cost, and security. They need architects who go deep. In this role you will help...  ...and scale needed to build innovative solutions for their most complex challenges.... 
    Senior
    Worldwide

    A W S

    New York, NY
    1 day ago
  •  ...The Role This is a senior, customer-facing role that sits at the...  ...intersection of technical leadership, solution architecture, and strategic...  ...supporting other Solutions Architects through knowledge sharing, coaching...  .... Championing the use of AI and automation to improve... 
    Senior
    Contract work
    Work at office

    SecurityHQ

    New York, NY
    12 days ago
  • $165.8k - $248.6k

     .... As a Fortune 500 company and a leading AI platform for managing people, money, and...  ...and drive. Whether you're building smarter solutions, supporting customers, or creating a...  ...audiences across the globe. At Workday, Solution Architects think creatively and strategically with... 
    Senior
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Workday

    New York, NY
    1 day ago
  • $150k - $180k

    Forward Deployed AI Engineer Provectus is a Premier...  ...you'll be the most senior technical person in...  ...tuning, distillation, or inference/serving optimization....  ...teams alongside Principal Architects and Forward Deployed...  ...-edge AI and cloud solutions Unlimited Vacation policy... 
    Senior
    Work at office
    Remote work
    Worldwide

    Provectus

    New York, NY
    1 day ago
  • $184k - $287.5k

     ...groundbreaking and innovative accelerated computing platforms for AI and HPC. Because of our work, scientists, researchers, and...  ...’s fastest supercomputers.We are seeking a highly motivated Senior Solutions Architect to join the NVIDIA Cloud Partners team with a focus on GPU,... 
    Senior
    Full time
    Remote work

    Nvidia

    New York, NY
    2 days ago
  • $140k - $183.75k

     ...reliable applications faster.The need is growing fastest in AI, where agents run for hours or days and depend on services...  ...Cadence at Uber before starting Temporal.SummaryWe’re hiring two Senior Solutions Architects for our Commercial team: one focused on new logo... 
    Senior
    Remote work

    Temporal Technologies

    New York, NY
    1 day ago
  •  ...York; USAWork type: RemoteSeniority: Senior ManagementPrimary skill: Solution ArchitecturePosted: 2026-09-29...  ...are past the point of asking whether AI belongs in their systems. The question...  ...can build against them - is the AI Architect's job.You will design the target architecture... 
    Senior
    Temporary work

    EPAM Systems

    New York, NY
    1 day ago
  • $180.2k - $247.7k

     ...professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we...  ...— and we’re just getting started. Role Overview The Senior Solutions Architect at is a critical role that bridges the gap between our product... 
    Senior
    Full time

    harvey

    New York, NY
    7 days ago
  • $150k - $200k

    Compensation Range:$150,000.00 - $200,000.00 Annual SalaryJob Description Summary:We are seeking a Senior Solution Architect to design, build, and evolve Swinerton’s enterprise data and AI platform, ensuring it is technically strong, AI‑ready, and tightly aligned to business... 
    Senior
    Full time
    Temporary work
    Flexible hours

    Swinerton

    New York, NY
    15 hours ago
  •  ...Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to...  ...the development and positioning of joint security solutions with Accenture. As an experienced Solution Architect, you will be responsible for working directly with... 
    Senior
    Full time
    Remote work
    Visa sponsorship
    Work visa

    Palo Alto Networks

    New York, NY
    15 hours ago
  • About usAppnovation is the AI Product Company. Headquartered in...  ...delivers enterprise AI and digital solutions, and co-invests with clients...  ...seeking a Principal Solutions Architect to define the architecture for...  .... This position requires a senior, hands-on technical leader who... 
    Senior
    Contract work

    Appnovation

    New York, NY
    2 days ago
  • $190k - $260k

    Senior Cybersecurity Solutions Architect (NYC) Location New York Business Area Legal, Compliance, and Risk Ref # 10054538 Description...  ...process landscape (e.g., Network Security, EDR, Cloud, AI, Telemetry), managing and integrating the vendor... 
    Senior
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    15 hours ago
  • $169k - $228.6k

    Join the AWS Solutions Architecture team that partners with one of the world's most-watched...  ...across ad-supported streaming; and generative AI experiences that change how content is...  ..., and diverse perspectives. Apply now to architect the future of how the world watches.Key... 
    Senior
    Temporary work
    Flexible hours

    AmazonWebServices

    New York, NY
    1 day ago
  •  ...growth, and enhance services through technology, data, and AI.The Oracle Business Group (OBG) brings industry...  ...SCM, CX, Analytics, Integration, OCI, AI, and industry solutions.Our Oracle Solution Architect Team partners with clients, account teams, and delivery... 
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    1 day ago
  • $169k - $228.6k

     ...possible in the cloud? Amazon Web Services (AWS) is looking for a Senior Solutions Architect to partner with one of the fastest-growing accounts in the...  ..., from modernizing legacy platforms to exploring agentic AI implementations that unlock new value across customer lines... 
    Senior
    Flexible hours
    Day shift

    AmazonWebServices

    New York, NY
    3 days ago
  • $169k - $228.6k

     ...seeking a Healthcare & Life Sciences (HCLS) Solutions Architect to join our HCLS organization within AWS...  ..., Machine Learning, Generative AI, Serverless and Container-based architectures...  ...The role builds deep relationships with senior technical individuals within customer organizations... 
    Senior
    Flexible hours
    Day shift

    AmazonWebServices

    New York, NY
    15 hours ago
  • $153.6k - $207.8k

     ...transform their businesses with cloud and AI technologies? Amazon Web Services (AWS) Global Sales is seeking a Solutions Architect III to join our Digital Native team, working...  ...or architecting real-time ML inference pipelines for recommendation engines.About... 
    Senior
    Flexible hours

    AmazonWebServices

    New York, NY
    7 hours ago
  • $153.6k - $207.8k

     ...challenges, then craft innovative solutions that accelerate their success....  ...Web Services (AWS) Solutions Architect team partners with customers...  ..., analytics, and Generative AI. The ability to connect technology...  ...Build deep relationships with senior technical individuals within... 
    Senior
    Worldwide
    Flexible hours

    AmazonWebServices

    New York, NY
    2 days ago
  • $150k - $262k

     ...could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI...  ...AI to work for people. Job Description The role This senior principal solution architect is a functional and technical expert who consults with customers... 
    Senior
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    New York, NY
    1 day ago
  • $168k - $231k

     ...26-09-11Perficient is seeking a senior, commercially minded Databricks Senior GTM Architect to shape and productize Perficient...  ...complex, high-value technical solutions at the Director level, within our...  ...practitioner-level knowledge of AI tools and how to apply them to... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Perficient

    New York, NY
    1 day ago
  • $169k - $228.6k

     ...interpersonal skills. As a Solutions Architect, you will partner some of the...  ...migration pipelines and growing AI/ML engagement, requiring an...  ...including model deployment, inference optimization, and generative...  ...deep relationships with senior technical individuals within... 
    Senior
    Flexible hours
    Day shift

    AmazonWebServices

    New York, NY
    1 day ago
  •  ...Job Description Job Description Senior Solution Architect Financial Systems Position Summary The client is seeking an experienced Senior Solution...  ...across multiple platforms and areas of IT. Define the AI strategy for financial systems, identifying opportunities... 
    Senior
    Remote work

    The Custom Group of Companies

    New York, NY
    3 days ago
  • $275k - $325k

     ...insurance product and its pricing. We are looking for a Senior Solution Architect to help insurance clients in North America and Latin America...  ...confidentially. We may use artificial intelligence (AI) tools to assist with certain stages of the recruitment process... 
    Senior
    Full time
    Casual work

    akur8

    New York, NY
    7 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Solutions Architect, AI Inference. Be the first to apply!