Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization

$124.5k - $272k

Netskope

Join the Future of Security at NetskopeNetskope (NASDAQ: NTSK) is a leader in modern security and networking for the cloud and AI era. We secure and accelerate cloud, data, and AI in real time, everywhere. Thousands of customers, including more than 30 of the Fortune 100, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network to gain full visibility and control without performance trade-offs.At Netskope, our technology is driven by our greatest strength: our people. We believe that belonging powers innovation, and success is both personal and organizational. We embrace differences in gender, ethnicity, beliefs, ability, and identity, creating an environment where every voice is heard and respected. We empower our employees to bring their authentic selves to work, grow their careers through continuous education and mentorship, and lead with transparency and curiosity. Join a team where you belong, where you are encouraged to be an entrepreneur, and where together, we continue to redefine the landscape of security.Visit Careers at Netskope to learn more. Follow us on LinkedIn and Instagram.Positions are available at Senior Staff and above. Candidates are assessed individually and leveled according to their specific skills and background.About the roleAs a Senior Staff Machine Learning Scientist, you own the inference and optimization layer that makes AI in agentic workflows fast, efficient, and production-grade. You fine-tune and evaluate models, push latency and throughput on real hardware, and build the runtime that executes bounded AI tasks, validated against usage from Netskope’s large customer base so you optimize where the data points, not where you guess.What’s in it for youHigh-impact ownership. You own the model layer of a net-new product that changes the performance and economics of agentic AI.Cutting-edge, unusual stack. The hard, interesting inference problems live here: quantization, KV-cache and memory management, sparsity, fine-tuning, and hardware acceleration under real-world resource constraints.Real scale to build against. Netskope’s customer footprint gives you production signals most teams never see, so you deploy, validate, and iterate fast.What you will be doingBuild and optimize the model inference path: quantization, KV-cache optimization, batching, and latency/memory/throughput tuning on constrained, commodity hardware.Fine-tune and evaluate models for bounded tasks; build eval harnesses that gate a capability to release on real accuracy, latency, and security relevance.Design and grow the task execution runtime (bounded sub-agents), pushing toward dynamic task generation and context compaction.Drive hardware acceleration / sparsity and support for larger models as the platform matures.Partner with the systems and backend engineers to ship capabilities end-to-end and iterate on real production signals.Required skills and experience10+ years of overall industry experience, with 4+ years hands-on in ML/AI (model development, fine-tuning, and inference optimization).Hands-on with fine-tuning (e.g. LoRA/QLoRA), quantization (GGUF/AWQ/GPTQ), and inference runtimes (vLLM/SGLang, TensorRT-LLM, ONNX Runtime, llama.cpp, or MLX/CoreML). On-device or edge inference experience is a strong plus.Strong Python; comfort reaching into C++ for low-level interop is a plus.Solid grasp of transformer internals and the levers that move real inference performance and cost: KV cache, attention, batching, memory footprint.Fluency with agentic coding systems and genuine curiosity about agent harnesses like Claude Code, Pi, and Codex, so you should already be building with them, or itching to.Clear communication: able to distill a model or infra bottleneck into an actionable concept for cross-functional teammates.EducationMS in Computer Science, Machine Learning, Electrical Engineering, or equivalent technical degree required, with a focus in AI/ML research; PhD in a related field strongly preferred.Compensation: At Netskope, salary is one component of our competitive total rewards package. The salary range for this position is as listed below. This is a national range. For purposes of complying with applicable laws, the range applies to candidates in California, Colorado, Illinois, Maryland, New York, Washington, and other states.The successful candidate’s starting pay will also be determined based on job-related skills, experience, qualifications, location, and market conditions. For all sales roles, the posted salary range is the On Target Earnings (OTE) range for the role, which is the sum of base salary and target commission amount at 100% goal achievement.In addition to salary, candidates may be eligible for other forms of compensation such as participation in a bonus plan (for non-sales roles) and a stock award program. Candidates may also be eligible for a comprehensive health plan and other benefits that can be reviewed at Netskope Benefits site. Salary Range$124,500—$272,000 USDNetskope is committed to implementing equal employment opportunities for all employees and applicants for employment. Netskope does not discriminate in employment opportunities or practices based on religion, race, color, sex, marital or veteran statues, age, national origin, ancestry, physical or mental disability, medical condition, sexual orientation, gender identity/expression, genetic information, pregnancy (including childbirth, lactation and related medical conditions), or any other characteristic protected by the laws or regulations of any jurisdiction in which we operate.Netskope respects your privacy and is committed to protecting the personal information you share with us, please refer to Netskope's Privacy Policy for more details.The application window for this position is expected to close within 50 days. You may apply by filling out the below information, or visiting our Netskope Careers site.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization in Santa Clara, CA vacancy
  • $192.2k - $260k

     ...looking for a Senior Applied Scientist to help drive...  ...conversational AI. You will contribute...  ...reinforcement learning) that shape...  ...closely with inference engineers to...  ...RL alignment, optimized for real-time...  ...years of building machine learning...  ...supervisors, and staff; adhere to standards... 
    Senior
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    5 days ago
  • $174k - $252k

     ...to advance autonomous AI systems.Solve complex...  ..., forecasting, and optimization) targeting operational...  ...submission(s) on agents in machine learning and natural language...  ...developing test-time/inference-time compute scaling...  ...work. As a Research Scientist, you'll setup large-... 
    Senior

    Google

    Mountain View, CA
    3 days ago
  • $168k - $258.75k

    Inference is the fastest growing and most competitive...  ...in Generative AI today. It is where...  ...techniques. As a Senior Product Manager...  ...on enabling deep learning across all GPU use...  ...roadmaps for model optimization softwareWork with...  ...knowledge of GenAI or machine learning concepts,... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...forefront of the generative AI revolution! The Algorithmic Model Optimization Team specifically...  ...models for maximal inference efficiency using techniques...  ...are now looking for a Senior Deep Learning Software Engineer to...  ...aspects of a typical machine learning stack including... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $192k - $304.75k

    NVIDIA is searching for a world-class generative AI researcher to join the fundamental generative AI research team at NVIDIA Research...  ...team that consistently publishes at the top venues in machine learning and AI for science. You will be empowered to make contributions... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $148.75k - $361k

     ...perform realtime multi-objective optimization with distributed systems at large scale and low latencies. We use Machine Learning, Reinforcement Learning, AI, Control and Optimization Systems...  ...Machine Learning, Experimentation and Inference Platform that powers the entire... 
    Senior
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    San Jose, CA
    2 days ago
  • $168k - $258.75k

     ...Inference is the fastest growing and most competitive...  ...in Generative AI today. It is where...  ...techniques. As a Senior Product Manager...  ...on enabling deep learning across all GPU use...  ...roadmaps for model optimization software Work with...  ...of GenAI or machine learning concepts,... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • $185k - $215k

     ...As a part of the global research, our AI research in Silicon Valley focuses on...  ...NeurIPS and CoRL.Job DescriptionAs a Senior Research Scientist- Robotics AI, you contribute to...  ...research and engineering in core AI and machine learning fields to enable Embodied AI (including... 
    Senior
    Work experience placement
    Local area
    Worldwide

    Robert Bosch

    Sunnyvale, CA
    5 days ago
  •  ...InworldInworld is a research lab and inference provider focused on realtime AI for consumer-facing applications....  ...from varied backgrounds who learn fast, thrive in ambiguity, and can...  ...need enough to make a case.Inference Optimization. Deep understanding of modern serving... 
    Full time
    Work at office
    Relocation package

    Inworld AI

    Mountain View, CA
    5 days ago
  •  ...potential of generative AI to power the transformation...  ...days per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat you will...  ...of what it takes to optimize and trade-off various aspects...  ...architecture, and machine learning fundamentalsProficient in... 
    3 days per week

    d-Matrix

    Santa Clara, CA
    2 days ago
  • $184k - $356.5k

    # Senior Software Engineer - AI Inference PerformanceNVIDIAUS, CA, Santa ClaraFull-time$184,000 – $356,500 /...  ...LinkedInXSave imageThis engineer will optimize large language and vision-language...  ...with 410 open senior machine learning jobs on October 10, 2026.Pay: This... 
    Senior
    Permanent employment
    Remote work

    We Love AI Jobs

    Santa Clara, CA
    3 days ago
  • $163.2k - $264k

     ...Inclusion. We weave AI into the fabric of everything...  ...CareerAs a Sr Principal AI Researcher, you will...  ...security research, machine learning, and research engineering...  ...-tuning, preference optimization, reinforcement...  ...training, large-scale inference, rollout generation,... 
    Senior
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    4 days ago
  •  ...builds the world's largest AI chip, 56 times larger than GPUs...  ...-leading training and inference speeds; over 10 times faster...  ...transformation pipeline, graph optimization infrastructure, high-performance...  ...at the intersection of machine learning frameworks, compiler technologies... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    6 days ago
  • $175k - $265k

     ...potential of generative AI to power the...  ...-Matrix is seeking a Senior Staff ML Researcher to join...  ...the intersection of machine learning, applied mathematics,...  ...techniques that improve LLM inference performance while preserving...  ...-network execution.Optimize key transformer... 
    Senior

    d-Matrix

    Santa Clara, CA
    3 days ago
  • $163.2k - $264k

     ...Inclusion. We weave AI into the...  ...SummaryYour CareerAs a Principal Applied AI...  ...efficiency optimizations, enabling high...  ..., lower inference latency, and streamline...  ...: Mentor senior and junior engineers...  ...continuous learning within the...  ...and deploying machine learning models... 
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    3 days ago
  • $174k - $252k

    Conduct AI research and development in the field of health technology, primarily focusing...  ...field.2 years of experience with modern machine learning frameworks such as JAX, PyTorch, or...  ...specific types of work. As a Research Scientist, you'll setup large-scale tests and deploy... 
    Senior

    Google

    Mountain View, CA
    2 days ago
  • $192.2k - $260k

    Are you a passionate scientist who wants to build AI agents that make a real difference...  ...in planning, tool use, learning from feedback, and reliability...  ...through highly optimized, integrated hardware and software...  ...employees, supervisors, and staff; adhere to standards of... 
    Senior
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    5 days ago
  • $192.2k - $260k

    The Foundational AI (FAI) team is looking for a passionate...  ..., and inventive Applied Scientist with a strong deep learning background, to build...  ...qualifications- 3+ years of building machine learning models for...  ...employees, supervisors, and staff; adhere to standards of... 
    Senior
    Local area
    Flexible hours
    Day shift

    Amazon

    Sunnyvale, CA
    4 days ago
  • $193.3k - $261.5k

     ...moment. As AI models...  ...disaggregated inference: splitting...  ...of the machine.In this role...  ...Build and optimize the low-level...  ...Machine Learning (ML) and...  ...engineers, scientists & architects...  ...expect senior mentorship...  ...numerous principal-level engineers...  ..., and staff; adhere to... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    5 days ago
  • $167.1k - $226.1k

     ...pioneering the use of Generative AI to empower the next...  ...efficient.We are seeking an Applied Scientist to advance the state of the...  ...you will be applying advanced machine learning techniques in Computer Vision...  ...employees, supervisors, and staff; adhere to standards of excellence... 
    Senior
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    2 days ago
  • $184k - $274.6k

     ...the Team At Foundation AI, we are leading...  ...systems, new algorithms, optimization methods, and scalable...  ...post-training methods, inference optimization, evaluation...  ...agentic AI, multimodal learning, and enterprise-scale...  ...articles for top-tier machine learning and AI conferences... 
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Jose, CA
    5 days ago
  •  ...Specialist For Amazon Sagemaker Ai Are you energized to drive...  ...world-wide adoption of AI Inference through Amazon SageMaker AI....  ...Digital natives and Startups with optimal price performance. You...  ...mapped to AI agentic as well as machine learning use cases), emerging open... 
    Senior
    Worldwide

    AWS

    Santa Clara, CA
    1 day ago
  • $183.83k - $275.98k

     ...scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro...  ...team, leveraging the cutting edge of machine learning research to solve challenging real-...  ...needs, and working to improve model optimization and inference speeds. You will use your applied research... 
    Senior

    Nuro - Mountain View, CA, US

    Mountain View, CA
    5 days ago
  • $193.3k - $261.5k

     ...accelerate deep learning and GenAI...  ...Amazon’s custom machine learning...  ...unparalleled ML inference and training...  ...fine tuned for optimal performance...  ...possible in AI acceleration....  ...team of applied scientists, system...  ...mentorship. Our senior members enjoy...  ...supervisors, and staff; adhere to... 
    Senior
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  •  ...that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems....  ...Together, we advance your career. THE ROLEWe are seeking a Principal GenAI Inference Optimization Engineer to join our Models and Applications team. This... 

    AMD

    San Jose, CA
    6 days ago
  •  ...artificial intelligence machine learning and eco-friendly...  ...a full-time research scientist. Depending on your qualifications...  ...is loop engineering AI infrastructure...  ...loop flows that automate optimize and explore SoC designs...  ...used by training and inference. Measure how device... 
    Full time

    SK hynix

    San Jose, CA
    11 days ago
  • $192k - $304.75k

     ...approach to accelerated computing. We're looking for a passionate AI research scientist with deep quantum computing expertise to path-find the future of fault-tolerant quantum systems powered by machine learning.Quantum computing is a strategic priority for NVIDIA, and our... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    6 days ago
  • $165k - $195k

     ...as advanced MEMS design.As a part of the global research, our AI research in Silicon Valley focuses on Foundation Models, Natural...  ...for Bosch products and services. By fusing cutting-edge machine learning, data analysis, and interactive visualization technologies, we... 
    Senior
    Full time
    Work experience placement
    Local area
    Worldwide

    Robert Bosch

    Sunnyvale, CA
    6 days ago
  • $142.8k - $193.2k

     ...the use of Generative AI to empower the next generation...  ...seeking an Applied Scientist to advance the state...  ...be applying advanced machine learning techniques in Computer...  ..., parsing, numerical optimization, data mining, parallel...  ..., supervisors, and staff; adhere to standards of... 
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    2 days ago
  • $184k - $287.5k

     ...architect that wants to change how the AI inference industry works. With agent adoption taking...  ...-scale disaggregation down to kernel optimization. You’ll write reference architectures...  ...reason, we're looking for someone with fast-learning technical agility and comfort with... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization. Be the first to apply!