Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Engineer, Inference & Optimization

Makers Fund

Senior/Staff Level Inference Engineer We are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of cutting-edge inference acceleration, GPU parallelism, advanced model deployment, and video generation technologies. Your expertise will drive significant improvements to model speed and efficiency, ensuring our creative AI systems deliver industry-leading user experiences at scale. You will design and optimize inference pipelines, implement state-of-the-art acceleration techniques, and work closely with researchers and engineers across the team to push the boundaries of what's possible in real-time AI deployment. Your efforts will play a foundational role in powering the next generation of Pika's video and language models. What You'll Do Accelerate Inference: Lead and implement advanced inference acceleration techniques, including attention optimization and quantization for efficient model serving. Maximize GPU Parallelism: Engineer and optimize GPU strategies across tensor, sequence, and pipeline parallelism (TP, SP, PP) for maximal efficiency and scalability. Programming for Performance: Develop and optimize high-performance computing kernels and distributed workloads using CUDA and NCCL. Advance AI Deployment: Collaborate with research and engineering teams to bring state-of-the-art videogen and large language models into production. Improve Training Efficiency: (Bonus) Contribute to improvements in model training speed, stability, and resource utilization as part of our deployment lifecycle. Technical Excellence: Drive rigorous code reviews, participate in technical discussions, and mentor fellow engineers on best practices in inference and GPU programming. What We're Looking For Experience: 5+ years engineering experience, with a strong track record in inference acceleration and model deployment at scale. Inference Mastery: Proven expertise in inference optimization, including quantization, attention acceleration, and deep learning compiler stacks. GPU & Parallelism: Deep knowledge of GPU programming (CUDA, NCCL) and experience with SP, TP, PP, and other forms of parallelism for distributed inference. AI Domain Knowledge: Familiarity with video generation (videogen) models and large language models (LLMs). Collaboration: Strong cross-discipline communication skills; able to drive shared goals across research and engineering functions. Ownership Mindset: Self-driven, solutions-oriented, and capable of managing ambiguity in a fast-paced startup environment. Bonus: Experience in enhancing training efficiency, stability, or resource optimization for large models. Nice to Have Experience with high-throughput video or real-time streaming model deployment Familiarity with distributed training and optimization toolkits Contributions to open source projects in AI infrastructure or deep learning compilers Startup or rapid prototyping experience What We Offer Competitive salary in the AI industry Equity in a fast-growing startup shaping the future of AI Comprehensive health benefits, monthly stipends, company retreats A supportive and collaborative office culture—we're all building and launching together About Pika At Pika, we're crafting a future where video creation is seamless, intuitive, and universally accessible. Our mission is to empower creativity by breaking down technical barriers using the transformative power of AI. We're a tight-knit, energetic team based in Palo Alto, CA, valuing efficiency, curiosity, and the ambition to make a meaningful impact on the world. We work from our Palo Alto office 3–5 days a week and welcome applicants who are eager to contribute onsite. Makers Fund

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the ML Engineer, Inference & Optimization in Palo Alto, CA vacancy
  •  ...or the most expensive accelerators. We're looking for an Inference Optimization engineer to make Rhoda's models run fast, correctly, and cheaply on...  ...For ~2+ years of experience in inference optimization, ML systems, ML compilers, or a closely related field. ~ Deep... 
    Suggested
    Full time

    rhoda-ai

    Mountain View, CA
    8 days ago
  • $165.2k - $223.6k

    Amazon AI is looking for a machine learning engineer to be part of inference optimization team working on optimizing large language OSS models like Qwen, Gemma, gptoss, improving inference performance by development on inference stacks like vLLM, SGLAng, performance tuning... 
    Suggested
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Santa Clara, CA
    11 hours ago
  • $195.2k - $262.2k

     ...production deployment, without the cost and complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI... 
    Suggested
    Temporary work
    Immediate start
    Remote work

    Nebius

    Palo Alto, CA
    5 days ago
  •  ...positions About the role We are looking for a software engineer with deep experience in optimizing ML models and deploying them on production-grade...  ...strategies to optimize efficiency and latency of model inference for compute boards selected by our customers Work... 
    Suggested
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    12 days ago
  •  ...InworldInworld is a research lab and inference provider focused on realtime...  ...to make a case.Inference Optimization. Deep understanding of modern...  ...to major inference engines, or deep-dive technical write...  ...experience building backend or ML systems.Who Thrives HereYou don... 
    Suggested
    Full time
    Work at office
    Relocation package

    Inworld AI

    Mountain View, CA
    3 days ago
  • $250k - $300k

     ...Description Job Description Senior Machine Learning Engineer, Inference Job Summary For our client, a fast-growing AI company building...  ...Machine Learning Engineer with strong expertise in ML inference optimization to join its inference team. In this role, you will... 
    Permanent employment
    Full time
    Contract work
    H1b
    Local area
    Remote work
    Relocation
    Relocation package

    AIDA Recruitment

    Mountain View, CA
    4 days ago
  • $232k

     ...for a Staff Machine Learning Engineer to help define and build the next generation of matching optimization systems. This role sits at the...  ...matching optimization and ML systems.Design matching objectives...  ..., deep learning, causal inference, and sequential decision-making... 
    Full time
    Temporary work
    Work at office
    Remote work

    Uber

    Sunnyvale, CA
    3 hours ago
  •  ...is building a 100× better job search engine — fast, comprehensive, honest, and actually...  .... We are looking for a founding ML engineer who can help us turn powerful...  ...facing infrastructure: deploying models, optimizing inference latency and throughput, scaling serving... 
    Full time
    Relocation package

    hiring-cafe

    Cupertino, CA
    8 days ago
  •  ...advance your career. THE ROLE: We are hiring ML Systems Research Engineers to build the reinforcement learning, inference, and evaluation infrastructure behind AI-for-...  ...agent improvement. You will work across compute optimization, hardware engineering automation,... 

    AMD

    Santa Clara, CA
    2 days ago
  • $117.7k - $221.4k

     ...This operating model reflects how Cola engineers think: build durable intermediate artifacts...  ...quality, speed, and cost instead of optimizing any one of them in isolation.The RoleWe...  ...data processing, featurization, and inference foundations that power scalable world understanding... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    11 hours ago
  • $184k - $287.5k

    We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference Performance Analysis and Optimization team builds the answer from the ground up. We develop... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...705-0836 Summary Across Apple Services Engineering (ASE), efficiency is not just a technical...  ...commitment to environmental sustainability and optimal resource utilization. This team plays a...  ...at scale. This team also focuses on ML-driven forecasting, capacity planning, resource... 

    Apple

    Cupertino, CA
    2 days ago
  • $179k - $223k

     ...of the Autonomy stack. In this Senior ML Engineer role, you will play a key role in delivering...  ...models. This includes training, optimizing and shipping auto-labeling models in the...  ...Experience with onboard edge deployment, cloud inference architectures, and balancing compute/... 
    Full time
    Contract work
    Local area

    Rivian

    Palo Alto, CA
    2 days ago
  • $102.1k - $202.2k

     ...efficient deployment of LLM inference and training in Microsoft's Azure...  ...development and model optimization tooling proof-of-concept effort...  ...collaboration with companywide AI/ML teams.Work cross-functionally...  ...and ML researchers/engineers across organizations to align... 
    Ongoing contract
    Work at office
    Local area
    Worldwide

    Microsoft Corporation

    Mountain View, CA
    2 days ago
  • $250k - $350k

     ...alongside some of the world's leading ML systems engineers, including leaders behind Megatron-LM,...  ...infrastructure powering our large-scale training, inference, and reinforcement learning. You'll...  ...AI agents. What You'll Do Build and optimize large-scale training and reinforcement... 
    Visa sponsorship

    Periodic Labs

    Menlo Park, CA
    2 days ago
  • $180k - $330k

     ...Sr. ML Infrastructure Engineer Palo Alto, CA Apply SpaceX was founded under the belief that a...  ...play a pivotal role in building and optimizing the reliable, high-performance ML platform...  ...large-scale data, training, and inference systems Collaborating with ML teams... 
    Full time
    Temporary work

    SpaceXSI

    Palo Alto, CA
    22 days ago
  • $140k - $312k

     ...world's transition to sustainable energy by optimizing how batteries are charged and discharged...  ...energy every day. As a Machine Learning Engineer on Opticaster, you will own applied...  ...ll Do Develop, improve, and productionize ML components in Opticaster, including time-... 
    Hourly pay
    Daily paid
    Full time
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    2 days ago
  • $232k

     ...for a Staff Machine Learning Engineer to help define and build the next generation of matching optimization systems. This role sits at the...  ...matching optimization and ML systems. + Design matching...  ...modeling, deep learning, causal inference, and sequential decision-making... 
    Full time
    Temporary work
    Work at office
    Remote work

    Uber

    Sunnyvale, CA
    14 days ago
  • $251k - $310k

     ...collaborative group of machine learning (ML) engineers, software engineers, and ML research...  ...and identify bottlenecks in training and inference performance (e.g., memory bandwidth,...  ...distillation, and efficient attention mechanisms. Optimize model code for specific hardware... 
    Full time
    Remote work

    Latent Logic

    Mountain View, CA
    2 days ago
  • $298k - $368k

     ...work jointly with downstream teams on the optimization and integration into the Waymo Driver....  ...a diverse set of sensors, enabling engineers like you to (1) develop methods for efficiently...  ...expertise in low-latency on-device inference techniques and a deep understanding of... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    5 days ago
  • $207k - $300k

     ...generated content through advanced context engineering and agentic feedback loops to identify...  ...and serving AIGC content to optimize efficiency for low-latency surfaces.Navigate...  ...Experience optimizing machine learning inference, resolving system-level bottlenecks, and... 

    Google

    Mountain View, CA
    1 day ago
  •  ...AI in the hands of hardware engineers in over 70% of the world’s largest...  ...tasks Curate, manage, and optimize large-scale training and...  ...code , working across the full ML stack from paper to GPU....  ...optimizing model training and inference on GPUs using CUDA, including... 
    Full time
    Work at office
    Visa sponsorship

    voltai-com

    Menlo Park, CA
    3 days ago
  • ML Engineer Sunnyvale, California, United States About the Job Our client is a rapidly growing...  ...how businesses learn from and optimize their in-person customer experiences. About...  ...preprocessing, model training, deployment, inference, and monitoring in production... 
    Full time

    Catalyst Labs, LLC

    Sunnyvale, CA
    2 days ago
  • $140k - $258k

    Machine Learning Engineer As a Machine Learning Engineer on the Infrastructure DesignX team...  ...the Machine Learning Platform that optimizes and automates infrastructure planning and...  ...workflows, evaluation tools, data pipelines, or inference optimizations Experience developing... 
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    2 days ago
  • $160k - $225k

    Machine Learning Engineer Location: Mountain View, CA Company Stage...  ...AI agents that continuously optimize campaigns, make intelligent spending...  ..., streaming pipelines, and ML serving infrastructure....  ...that support model training and inference. Build customer-facing AI... 
    H1b
    Work at office
    Visa sponsorship

    Recruiting from Scratch

    Mountain View, CA
    2 days ago
  • $166k - $244k

    Role OverviewWe are seeking a Senior ML / AI Operations Engineer to architect, deploy, and scale our...  ...interconnection, autonomous grid dispatch and optimization, -long-term grid planning, and...  ...training clusters, high-throughput inference serving pipelines, and the agentic... 
    Full time
    Flexible hours

    X Company

    Mountain View, CA
    11 hours ago
  • $175k - $308.5k

     ...08-13SummaryWe are the Foundation Model Inference team within Cloud OS and AI Inference organization...  ...from the hardware beneath them. We optimize language, vision, and speech models with...  ...set the technical direction for the engineers around you.This role sits within CloudOS... 
    Worldwide
    Relocation

    Apple

    Santa Clara, CA
    2 days ago
  • $195k - $230k

     ...for a Senior Machine Learning Engineer to help evolve our large-...  ...ranking, and multi-objective optimization to balance engagement, retention...  ...from offline training online inference A/B experimentation metric analysis...  ...with large-scale data and ML systems (e.g., Spark,... 
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    11 hours ago
  • $188.5k - $282.7k

     ...Rubrik's Semantic AI Governance Engine, which is the first system...  ...lead even further.As an Applied ML Engineer on the SAGE team,...  ...supervised fine-tuning, preference optimization (DPO/RLAIF), and distillation...  ...Model Serving and Inference Infrastructure (25% of time)Designing... 
    Permanent employment

    Rubrik

    Palo Alto, CA
    3 days ago
  • $193.3k - $261.5k

     ...performance for AWS's custom ML accelerators. Working at the...  ...hardware-software boundary, our engineers craft high-performance...  ...every FLOP counts in delivering optimal performance for our customers...  ...PyTorch, enabling unparalleled ML inference and training performance.As... 
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Engineer, Inference & Optimization. Be the first to apply!