Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Edge AI Inference Engineer

Intel

Intel in Santa Clara, CA, seeks an experienced software engineer to optimize local inference for edge devices. You will work on llama.cpp, vLLM, and quantization, improving latency, memory usage, and startup times across hardware tiers. You will profile performance, collaborate with the Post-Training team, and push upstream fixes to open-source engines while advancing hardware-aware optimizations for efficient AI on local devices. #J-18808-Ljbffr Intel

Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Senior Edge AI Inference Engineer in Santa Clara, CA vacancy
  • NVIDIA Corporation is seeking a Senior Software Engineer for the TensorRT Edge-LLM team in the US. You will develop a high-performance inference framework in modern C++ that extends TensorRT for autoregressive model serving, including speculative decoding and KV cache... 
    Senior

    NVIDIA

    Santa Clara, CA
    3 days ago
  • NVIDIA in Santa Clara, CA seeks a senior software engineer focusing on GPU computing and ML inference to optimize LLM workloads on edge AI hardware. You will track open-source inference frameworks, map architectures to NVIDIA GPUs, and report performance metrics. With... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • NVIDIA seeks a Senior Systems Software Engineer to tackle client-side AI challenges on Windows and Linux PCs with limited resources. You will collaborate with...  ..., while optimizing AI models, data pipelines, and inference runtimes for performance on next-generation GPUs.... 
    Senior
    Local area

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $227k - $300k

     ...re driving the transformation to AI-enabled software-defined vehicles...  ...offerings for production-grade AI on the Edge. We are looking for a great Senior Staff AI Engineer to join our seasoned AI team and...  ...of modern C++ (C++14/17 for inference).Deep proficiency with PyTorch or... 
    Senior
    Work at office
    Worldwide
    Flexible hours
    Shift work
    3 days per week

    Sonatus

    Sunnyvale, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA is seeking an experienced AI systems engineer to innovate and develop cutting-edge technologies in AI inference systems. You will design and optimize kernel technologies to accelerate workloads for NVIDIA's hardware architecture. The ideal candidate holds a Master... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $169.78k - $338.69k

     ...Role We are seeking an experienced and mission-driven Senior/Staff AI Infrastructure Engineer, Inference & Optimization to lead the performance tuning, deployment, and resource scheduling of cutting-edge AI models across on-vehicle and cloud infrastructure. In this... 
    Senior
    Full time

    DiDi Labs

    San Jose, CA
    2 days ago
  • NVIDIA seeks a Senior Software Engineer for Local AI on Windows and Linux PCs. You will partner with software, research, architecture and product...  ...DGX PCs, and work on end-to-end optimization of inference runtimes and edge deployment. The role requires a strong background... 
    Senior
    Local area

    Nvidia Corporation in

    Santa Clara, CA
    1 day ago
  • NVIDIA in Santa Clara, CA is seeking outstanding AI systems engineers to advance the inference software stack. You will design and optimize kernels, build...  ...across teams, work on CUDA C/C++, Triton, and cutting-edge MLIR-based tooling, and participate in open source projects... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • Cerebras Systems, Inc. is looking for a Senior Performance Engineer to enhance the performance...  ...competitive pricing models for their AI chip. The ideal candidate will have extensive experience with open-source inference frameworks and an understanding of ML... 
    Senior

    Cerebras Systems, Inc.

    Sunnyvale, CA
    12 hours ago
  • NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware-accelerated stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • $151.8k - $332.2k

    What you can expect We are looking for an AI Inference Engineer with a solid background in speech recognition and model inference. In this role...  ...to various Zoom products. You will work on the most cutting edge speech modeling and inference technologies with world-class... 
    Full time
    Work at office
    Remote work

    Zoom

    San Jose, CA
    1 day ago
  •  ...d-Matrix, headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to productize the AI compute engine's SW stack, developing deployment software and collaborating with ML, compiler, and hardware... 
    Senior

    Jobleads-US

    Santa Clara, CA
    3 days ago
  • $200k - $400k

     ...intelligent machines at scale. At Scout AI, we’re developing Fury, the first...  .... The Role We're looking for a Senior or Staff AI Engineer to join the Fury Orchestration Team with...  ..., multi-agent coordination, and edge inference optimization. Expect to rapidly prototype... 
    Senior
    Full time
    Relocation package

    Scout Ai

    Sunnyvale, CA
    21 hours ago
  • $195.2k - $275.58k

     ...Description: The Software and AI (SAI) organization is seeking...  ...skilled Software Development Engineer to contribute to the development...  ...performance engineering, and cutting‑edge Intel hardware, enabling state...  ...best‑in‑class deep‑learning inference and training throughput on... 
    Senior
    Full time
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Intel

    Santa Clara, CA
    2 days ago
  • $117.7k - $221.4k

     ...and cost efficient for embodied AI systems. We believe the next...  ...quickly to new questions, new edge cases, and new model capabilities...  ...model reflects how Cola engineers think: build durable intermediate...  ...processing, featurization, and inference foundations that power... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $152k - $241.5k

     ...limits of real-time large language model inference? Join NVIDIA’s TensorRT Edge-LLM team and help shape the next generation of edge AI for automotive and robotics. We build the...  ...in Computer Science, Electrical/Computer Engineering, or a closely related field.4+ years of relevant... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $160k - $198k

     ...of our team members.What You’ll DoAs a Senior AI Systems Engineer, you will architect, deploy, and...  ...for large-scale AI model training and inference. You will ensure our machine learning...  ...Software Engineers to productionize cutting-edge models, establish monitoring systems,... 
    Senior
    Local area

    Archer Aviation

    San Jose, CA
    3 days ago
  • $184k - $287.5k

    We are now seeking a Senior Infrastructure Software Engineer for NVIDIA TensorRT Edge-LLM!NVIDIA's TensorRT Infrastructure group...  ...enable the next generation of edge AI. This is an outstanding chance...  ...Jetson AGX for robotics and edge inference applications. You will work with... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $200k - $322k

    NVIDIA is seeking a dedicated Senior AI Product Engineer to join our ambitious AI for Media team in Santa...  ..., identify and resolve rough edges before customer impact, and use telemetry...  ...fine-tuning, distillation, or serving/inference optimization.Demonstrated experience... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $262k - $365k

     ...task-specific models of in app AI (tiny Gemma/Juno Nano),...  ...evaluate/deploy across devices (Edge Portal /Model Explorer/Developer...  ...performance of on-device model inference via optimizations in the model...  ...qualifications:Master’s degree or PhD in Engineering, Computer Science, or a... 
    Senior

    Google

    Sunnyvale, CA
    3 days ago
  • $184k - $287.5k

    A leading technology company is seeking a Senior Software Engineer for AI and DL Kernel Libraries in Santa Clara, CA. The role involves designing and optimizing kernels for high-impact AI workloads and collaborating with engineers on innovative solutions. Candidates should... 
    Senior
    Remote job

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  • $229.9k - $262.4k

     ...Overview Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    more than 2 months ago
  •  ...of patients worldwide.We’re a team of engineers, clinicians, and innovators united by one...  ...-generation robotic platforms. As a Senior AI/ML Research Engineer (Computer Vision),...  ...and active-learning loops.Real-time / edge inference optimization (e.g., TensorRT, NVIDIA Jetson... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    4 days ago
  • $152k - $241.5k

     ...deep learning and eager to work on cutting-edge AI technology for safety-critical applications? Join NVIDIA's TensorRT team as a Senior Software Engineer, and be at the forefront of technology, enabling high-performance AI inference solutions for automotive safety and... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $170.6k - $261.3k

     ...meet the unique demands of AI and ML innovation,...  ...enhance the productivity of ML engineers, and drive the adoption of cutting-edge ML techniques. Our ML...  ...includes: AI Validation & Inference: Ensures robust model performance...  ...Position Overview: As a Senior AI/ML Full-Stack Engineer... 
    Senior
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    21 hours ago
  •  ...seeking an experienced embedded software engineer to design, build, and optimize reusable software...  ...future platforms. The role focuses on edge compute architecture, distributed...  ...covering Linux, device drivers, CUDA kernels, inference engines, and middleware. #J-18808-Ljbffr... 
    Senior

    Socket.dev

    Sunnyvale, CA
    12 hours ago
  • $224k - $356.5k

    NVIDIA in Santa Clara is seeking a System Software Engineer for Vision AI to develop high-performance vision systems that process massive data streams. The ideal candidate will have over 12 years of experience in software development with expertise in C++, Python, and... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $250k - $300k

     ...intelligence . As the only vertically integrated AI infrastructure company built from the...  ...in production. That means owning the inference stack end to end: profiling where time...  ...will also work directly with customer engineering teams to tailor deployments to their needs... 
    Senior
    Temporary work

    Crusoe

    Sunnyvale, CA
    25 days ago
  • NVIDIA is looking for a System Software Engineer focused on Vision AI to own core components of a strategic platform that processes massive video, image, and 3D data into actionable insights. You will work with perception, simulation, and large-model teams to bring research... 
    Senior

    Thomas To

    Santa Clara, CA
    12 hours ago
  • $152k - $241.5k

    We are seeking a Senior AI/ML Performance and Efficiency Engineer, GPU Clusters at NVIDIA to join our AI Efficiency efforts. As an Engineer, you will have...  ...Experience investigating, and resolving, training & inference performance end to endDebugging and optimization... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Edge AI Inference Engineer. Be the first to apply!