Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization

$182.5k - $260.5k

Netskope

About Netskope Today, there\'s more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve. We realized a new perimeter was needed, one that is built in the cloud and follows and protects data wherever it goes, so we started Netskope to redefine Cloud, Network and Data Security. Since 2012, we have built the market-leading cloud security company and an award-winning culture powered by hundreds of employees spread across offices in Santa Clara, St. Louis, Bangalore, London, Paris, Melbourne, Taipei, and Tokyo. Our core values are openness, honesty, and transparency, and we purposely developed our open desk layouts and large meeting spaces to support and promote partnerships, collaboration, and teamwork. From catered lunches and office celebrations to employee recognition events and social professional groups such as the Awesome Women of Netskope (AWON), we strive to keep work fun, supportive and interactive. Positions are available at Senior Staff and above. Candidates are assessed individually and leveled according to their specific skills and background. About the role As a Senior Staff Machine Learning Scientist, you own the inference and optimization layer that makes AI in agentic workflows fast, efficient, and production-grade. You fine-tune and evaluate models, push latency and throughput on real hardware, and build the runtime that executes bounded AI tasks, validated against usage from Netskope’s large customer base so you optimize where the data points, not where you guess. What’s in it for you High-impact ownership. You own the model layer of a net-new product that changes the performance and economics of agentic AI. Cutting-edge, unusual stack. The hard, interesting inference problems live here: quantization, KV-cache and memory management, sparsity, fine-tuning, and hardware acceleration under real-world resource constraints. Real scale to build against. Netskope’s customer footprint gives you production signals most teams never see, so you deploy, validate, and iterate fast. What you will be doing Build and optimize the model inference path : quantization, KV-cache optimization, batching, and latency/memory/throughput tuning on constrained, commodity hardware. Fine-tune and evaluate models for bounded tasks; build eval harnesses that gate a capability to release on real accuracy, latency, and security relevance. Design and grow the task execution runtime (bounded sub-agents), pushing toward dynamic task generation and context compaction. Drive hardware acceleration / sparsity and support for larger models as the platform matures. Partner with the systems and backend engineers to ship capabilities end-to-end and iterate on real production signals. Required skills and experience 10+ years of overall industry experience , with 4+ years hands-on in ML/AI (model development, fine-tuning, and inference optimization). Hands-on with fine-tuning (e.g.LoRA/QLoRA), quantization (GGUF/AWQ/GPTQ), and inference runtimes (vLLM/SGLang, TensorRT-LLM, ONNX Runtime, llama.cpp, or MLX/CoreML). On-device or edge inference experience is a strong plus. Strong Python; comfort reaching into C++ for low-level interop is a plus. Solid grasp of transformer internals and the levers that move real inference performance and cost: KV cache, attention, batching, memory footprint. Fluency with agentic coding systems and genuine curiosity about agent harnesses like Claude Code, Pi, and Codex , so you should already be building with them, or itching to. Clear communication: able to distill a model or infra bottleneck into an actionable concept for cross-functional teammates. Education MS in Computer Science, Machine Learning, Electrical Engineering, or equivalent technical degree required, with a focus in AI/ML research; PhD in a related field strongly preferred. Compensation: At Netskope, salary is one component of our competitive total rewards package. The salary range for this position is as listed below. This is a national range. For purposes of complying with applicable laws, the range applies to candidates in California, Colorado, Illinois, Maryland, New York, Washington, and other states. The successful candidate’s starting pay will also be determined based on job-related skills, experience, qualifications, location, and market conditions. For all sales roles, the posted salary range is the On Target Earnings (OTE) range for the role, which is the sum of base salary and target commission amount at 100% goal achievement. In addition to salary, candidates may be eligible for other forms of compensation such as participation in a bonus plan (for non-sales roles) and a stock award program. Candidates may also be eligible for a comprehensive health plan and other benefits that can be reviewed at Netskope Benefits site. Salary Range

$182,500 — $260,500 USD

Netskope is committed to implementing equal employment opportunities for all employees and applicants for employment. Netskope does not discriminate in employment opportunities or practices based on religion, race, color, sex, marital or veteran statues, age, national origin, ancestry, physical or mental disability, medical condition, sexual orientation, gender identity/expression, genetic information, pregnancy (including childbirth, lactation and related medical conditions), or any other characteristic protected by the laws or regulations of any jurisdiction in which we operate. Netskope respects your privacy and is committed to protecting the personal information you share with us, please refer to Netskope\'s Privacy Policy for more details. The application window for this position is expected to close within 50 days. You may apply by filling out the below information, or visiting our Netskope Careers site. #J-18808-Ljbffr Netskope

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization in Santa Clara, CA vacancy
  • $182.5k - $260.5k

     ...networking for the cloud and AI era. We secure and...  ...at Netskope to learn more. Follow us on LinkedIn...  ...are available at Senior Staff and above. Candidates...  ...roleAs a Senior Staff Machine Learning Scientist, you own the inference and optimization layer that makes AI in... 
    Senior

    Netskope

    Santa Clara, CA
    2 days ago
  • $192.2k - $260k

     ...looking for a Senior Applied Scientist to help drive...  ...conversational AI. You will contribute...  ...reinforcement learning) that shape...  ...closely with inference engineers to...  ...RL alignment, optimized for real-time...  ...years of building machine learning...  ...supervisors, and staff; adhere to standards... 
    Senior
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    3 days ago
  • Netskope is seeking a Senior Staff Machine Learning Scientist in Santa Clara to own the inference and optimization layer for AI in agentic workflows. You will fine-tune models, push latency and throughput on real hardware, and build a runtime that executes bounded AI tasks... 
    Senior

    Netskope

    Santa Clara, CA
    1 day ago
  • $195.2k - $262.2k

     ...infrastructure for the global AI economy. We are...  ...orchestration to inference optimization, we own the hard...  ...Token Factory needs scientists who can turn frontier...  ...inference capabilities. A Senior Applied Scientist...  ...computer science, machine learning, ML systems,... 
    Senior
    Temporary work
    Immediate start
    Remote work

    Nebius

    Palo Alto, CA
    13 hours ago
  • $192k - $304.75k

    We are now looking for a Senior Research Scientist for Human‑AI Perception & Interaction!...  ...interaction to shape perception, learning, and behavior. We bridge...  ..., multi-GPU training and inference workflows.Familiarity...  ...human behavior models to machine learning applications, or... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $171.6k - $222.2k

     ...We are seeking a Senior Applied Scientist to join our team in developing pioneering AI research, Generative AI, Agentic AI, Large...  ...Models, and other advanced Machine Learning and Deep Learning solutions...  ..., parsing, numerical optimization, data mining, parallel and distributed... 
    Senior
    Worldwide
    Flexible hours

    PVH (Tommy Hilfiger/Calvin Klein)

    Sunnyvale, CA
    2 days ago
  • $229.9k - $262.4k

     ...Overview Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform) Overview: At...  ...been an industry leader in using machine learning to create real-time, personalized...  ...functional team of engineers, research scientists, technical program managers, and... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    more than 2 months ago
  • $168k - $258.75k

    Inference is the fastest growing and most competitive...  ...in Generative AI today. It is where...  ...techniques. As a Senior Product Manager...  ...on enabling deep learning across all GPU use...  ...roadmaps for model optimization softwareWork with...  ...knowledge of GenAI or machine learning concepts,... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • NVIDIA is seeking a Senior Product Manager for AI Platform Inference to lead the development of tooling, SDKs, and libraries enabling developers to deploy...  ...roadmaps, and GTM plans, and collaborate with developers to optimize model deployment performance. Ideal candidates have... 
    Senior

    NVIDIA AI

    Santa Clara, CA
    4 days ago
  • $169.78k - $338.69k

     ...We are seeking an experienced and mission-driven Senior/Staff AI Infrastructure Engineer, Inference & Optimization to lead the performance tuning, deployment, and...  ...iteration and bridging the gap between frontier deep learning algorithms and real-time autonomous systems.... 
    Senior
    Full time

    DiDi Labs

    San Jose, CA
    2 days ago
  • $192k - $304.75k

    NVIDIA is searching for a world-class generative AI researcher to join the fundamental generative AI research team at NVIDIA Research...  ...team that consistently publishes at the top venues in machine learning and AI for science. You will be empowered to make contributions... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $168k - $258.75k

    Senior Product Manager - AI Platform Inference (Finance) Inference is the fastest growing and most...  ...focus on enabling deep learning across all GPU use cases...  ...roadmaps for model optimization software Work with leadership...  ...knowledge of GenAI or machine learning concepts, particularly... 
    Senior

    Nvidia Corporation in

    Santa Clara, CA
    3 days ago
  • $192k - $304.75k

     ...for an outstanding Senior Researcher working...  ...on efficient deep learning to join our...  ...post-training model optimization (pruning, quantization...  ...adaptive/dynamic inference, resource-efficient...  ...computer vision and machine learning. Our...  ...vacancy. NVIDIA uses AI tools in its recruiting... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $148.75k - $361k

     ...perform realtime multi-objective optimization with distributed systems at large scale and low latencies. We use Machine Learning, Reinforcement Learning, AI, Control and Optimization Systems...  ...Machine Learning, Experimentation and Inference Platform that powers the entire... 
    Senior
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    San Jose, CA
    3 days ago
  • $192k - $304.75k

     ...seeking an outstanding Research Scientist or Research Engineer with a passion...  .... As part of NVIDIA's Physical AI Platform Research team, you will...  ...a strong background in deep learning, artificial intelligence, computer vision, machine learning, simulation, or autonomous... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $174k - $252k

     ...specific types of work. As a Research Scientist, you'll setup large-scale tests and deploy...  ...breadth of computer science, such as machine (and deep) learning, data mining, natural language...  ...institutes all over the world.The Google Cloud AI Research team addresses AI challenges... 
    Senior

    Google

    Sunnyvale, CA
    1 day ago
  • $185k - $215k

     ...As a part of the global research, our AI research in Silicon Valley focuses on...  ...NeurIPS and CoRL.Job DescriptionAs a Senior Research Scientist- Robotics AI, you contribute to...  ...research and engineering in core AI and machine learning fields to enable Embodied AI (including... 
    Senior
    Work experience placement
    Local area
    Worldwide

    Robert Bosch

    Sunnyvale, CA
    3 days ago
  • $192.2k - $260k

     ...responsibilities• Build generative AI models that create...  ....• Drive end-to-end machine learning projects that have a...  ...-concept, experiment, optimize, and deploy your...  ...are seeking an Applied Scientist to advance the state of...  ..., supervisors, and staff; adhere to standards of... 
    Senior
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    2 days ago
  • $173k

     ...travelers everywhere.Senior Machine Learning ScientistThe Senior Machine Learning Scientist is responsible for building...  ...solutions and AI agents that improve post...  ...challenges, from inference problems on long-tail...  ...data to multi-objective optimization in a highly dynamic,... 
    Senior
    Full time
    Worldwide

    Expedia

    San Jose, CA
    2 days ago
  • $192.2k - $260k

     ...talented, and inventive Applied Scientist with a strong machine learning background to help build...  ...technology in generative AI and foundational models.As...  ...job responsibilitiesThe Senior Applied Scientist will...  ...employees, supervisors, and staff; adhere to standards of excellence... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Amazon

    Santa Clara, CA
    2 days ago
  • $193.3k - $261.5k

     ...accelerate deep learning and GenAI...  ...Amazon’s custom machine learning...  ...unparalleled ML inference and training...  ...fine tuned for optimal performance...  ...possible in AI acceleration....  ...team of applied scientists, system...  ...mentorship. Our senior members enjoy...  ...supervisors, and staff; adhere to... 
    Senior
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • d-Matrix in Santa Clara, CA is seeking a Sr. Staff ML Researcher to advance LLM algorithmic optimization on our DNN accelerators. You will design and implement efficient inference algorithms, collaborating with mathematicians, ML researchers and engineers on high-impact... 
    Senior
    3 days per week

    Entrada Ventures

    Santa Clara, CA
    1 day ago
  •  ...potential of generative AI to power the transformation...  ...days per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat you will...  ...of what it takes to optimize and trade-off various aspects...  ...architecture, and machine learning fundamentalsProficient in... 
    3 days per week

    d-Matrix

    Santa Clara, CA
    1 day ago
  •  ...Systems builds the world's largest AI chip, 56 times larger than GPUs....  ...deliver industry‑leading training and inference speeds and empowers machine learning users to effortlessly run large‑...  ...model training, and inference optimization. Experience supporting enterprise... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • An innovative AI lab in Santa Clara is seeking a senior researcher to drive original research in generative interactive video. The ideal candidate will have deep expertise in machine learning and a proven record in generative modeling. Responsibilities include formulating... 
    Senior

    Odyssey

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...unlimited potential of AI to define the next era...  ...for an outstanding Senior Agentic AI Applied Researcher...  ...for data science and machine learning. As a member of the...  ..., development, and optimization of agentic AI solutions...  ...learning frameworks and inference stacks. Proficiency in... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • Apple Inc. in Cupertino, California, is looking for a Sr. Machine Learning Scientist to enhance Siri's capabilities. The ideal candidate will lead developments in deep learning and dialog systems to improve AI-powered conversational experiences. This role demands a profound... 
    Senior

    Apple

    Cupertino, CA
    4 days ago
  • $152k - $241.5k

    2100 NVIDIA USA is seeking an AI Research Engineer / Applied Scientist to develop innovative technologies in machine learning compilers and AI systems. The ideal candidate will...  ...expertise in AI/ML, particularly in compiler optimization and low-level programming, along with 5+... 
    Senior

    2100 NVIDIA USA

    Santa Clara, CA
    13 hours ago
  • $184k - $287.5k

    NVIDIA is seeking an experienced AI systems engineer to innovate and develop cutting-edge technologies in AI inference systems. You will design and optimize kernel technologies to accelerate workloads for NVIDIA's hardware architecture. The ideal candidate holds a Master... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • Itlearn360 is looking for a Senior Applied Scientist to join the Delivery Foundation Model team in Santa Clara, CA. This role involves...  ...across Amazon's delivery network, leveraging cutting-edge AI and machine learning techniques. The ideal candidate holds a PhD or... 
    Senior

    Itlearn360

    Santa Clara, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization. Be the first to apply!