Principal Machine Learning Engineer
$291.5k - $369.1kCisco
The application window is expected to close on:
Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received .
Meet the Team
Splunk, a Cisco company, is building a safer, more resilient digital world with an end‑to‑end, full‑stack platform designed for hybrid, multi‑cloud environments. Join the AI Models team at Splunk, where we advance the state of AI for high‑volume, real‑time, multi‑modal machine‑generated data — including logs, time series, traces, and events. We combine deep AI research expertise with the scale and operational excellence of Splunk and Cisco’s global engineering capabilities. Our work spans networking, security, observability, and customer experience — designing and deploying foundation models that enhance reliability, strengthen security, prevent downtime, and deliver predictive insights across Splunk Observability, Security, and Platform at enterprise scale. You’ll be part of a culture that values technical excellence, impact‑driven innovation, and cross‑functional collaboration — all within a flexible, growth‑oriented environment.
Your Impact
Set and Drive Vision:Define and champion the strategic vision for AI and foundation models across Splunk and Cisco platforms, shaping the research and technology roadmap to anticipate and address industry‑defining challenges.
Architect and Lead Breakthroughs: Lead the end‑to‑end lifecycle of research, design, and deployment for large‑scale foundation models targeting machine‑generated data, with deep focus on logs and complementary modalities (time series, traces, events).
Influence at Scale: Partner with executive leadership, engineering, product, and data science teams to ensure AI solutions align with broader organizational objectives, product strategies, and customer needs.
Mentorship and Thought Leadership: Cultivate organizational excellence by mentoring senior technical talent, fostering research communities, and driving best practices in AI across global teams.
Foster Innovation: Embed cutting‑edge research and technological advances into products, driving sustained competitive advantage and transformation at enterprise scale.
Minimum Qualifications:
PhD in Computer Science, or related quantitative field, plus7+ years of industry research experience.
Proven track record in at least one of the following areas: large language modeling for both structure and unstructured data, deep learning‑based time series modeling, advanced anomaly detection, and multi-modality modeling.
Solid proficiency in Python and deep learning frameworks (e.g., PyTorch, TensorFlow)
Experience translating research ideas into production systems.
Preferred Qualifications:
Deep NLP & Domain‑Adapted LLMs: Background in building and adapting large‑scale language models (e.g., T5, BERT, LLaMA, GPTs) for specialized domains including structured/unstructured logs, text, and event sequences.
Log Analytics Expertise – In‑depth knowledge of structured/unstructured system logs, event sequence analysis, anomaly detection, and root cause identification.
Advanced Anomaly Detection – Experience creating robust, scalable approaches (statistical, deep learning, or hybrid) for high‑volume, real‑time logs data.
Multi‑Modal AI Modeling – Strong track record fusing logs, time series, traces, tabular data, and graphs for foundation models tackling complex operational insights.
Large‑Scale Training & Optimization – Experience optimizing model architectures, distributed training pipelines, and inference efficiency to minimize cost and latency while preserving accuracy.
MLOps & Continuous Learning – Fluency in automated retraining, drift detection, incremental updates, and production monitoring of ML models.
Strong Research Track Record – Publications in top AI/ML conferences or journals (e.g., NeurIPS, ICML, ICLR, AAAI, CVPR, ACL, KDD) demonstrating contributions to state‑of‑the‑art methods and real‑world applications.
Why Cisco?
At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint.
Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere.
We are Cisco, and our power starts with you.
Message to applicants applying to work in the U.S. and/or Canada:
The starting salary range posted for this position is $291,500.00 to $369,100.00 and reflects the projected salary range for new hires in this position in U.S. and/or Canada locations, not including incentive compensation*, equity, or benefits.
Individual pay is determined by the candidate's hiring location, market conditions, job-related skillset, experience, qualifications, education, certifications, and/or training. The full salary range for certain locations is listed below. For locations not listed below, the recruiter can share more details about compensation for the role in your location during the hiring process.
U.S. employees are offered benefits, subject to Cisco’s plan eligibility rules, which include medical, dental and vision insurance, a 401(k) plan with a Cisco matching contribution, paid parental leave, short and long-term disability coverage, and basic life insurance. Please see the Cisco careers site to discover more benefits and perks. Employees may be eligible to receive grants of Cisco restricted stock units, which vest following continued employment with Cisco for defined periods of time.
U.S. employees are eligible for paid time away as described below, subject to Cisco’s policies:
10 paid holidays per full calendar year, plus 1 floating holiday for non-exempt employees
1 paid day off for employee’s birthday, paid year-end holiday shutdown, and 4 paid days off for personal wellness determined by Cisco
Non-exempt employees** receive 16 days of paid vacation time per full calendar year, accrued at rate of 4.92 hours per pay period for full-time employees
Exempt employees participate in Cisco’s flexible vacation time off program, which has no defined limit on how much vacation time eligible employees may use (subject to availability and some business limitations)
80 hours of sick time off provided on hire date and each January 1st thereafter, and up to 80 hours of unused sick time carried forward from one calendar year to the next
Additional paid time away may be requested to deal with critical or emergency issues for family members
Optional 10 paid days per full calendar year to volunteer
For non-sales roles, employees are also eligible to earn annual bonuses subject to Cisco’s policies.
Employees on sales plans earn performance-based incentive pay on top of their base salary, which is split between quota and non-quota components, subject to the applicable Cisco plan. For quota-based incentive pay, Cisco typically pays as follows:
.75% of incentive target for each 1% of revenue attainment up to 50% of quota;
1.5% of incentive target for each 1% of attainment between 50% and 75%;
1% of incentive target for each 1% of attainment between 75% and 100%; and
Once performance exceeds 100% attainment, incentive rates are at or above 1% for each 1% of attainment with no cap on incentive compensation.
For non-quota-based sales performance elements such as strategic sales objectives, Cisco may pay 0% up to 125% of target. Cisco sales plans do not have a minimum threshold of performance for sales incentive compensation to be paid.
The applicable full salary ranges for this position, by specific state, are listed below:
New York City Metro Area:
$291,500.00 - $424,400.00
Non-Metro New York state & Washington state:
$259,400.00 - $377,600.00
- For quota-based sales roles on Cisco’s sales plan, the ranges provided in this posting include base pay and sales target incentive compensation combined.
** Employees in Illinois, whether exempt or non-exempt, will participate in a unique time off program to meet local requirements.
Cisco is an Affirmative Action and Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.
Cisco will consider for employment, on a case by case basis, qualified applicants with arrest and conviction records.
$275k - $350k
...agents are how we intend to fix that. We're assembling a team of top researchers and engineers across AI and biology to build an AI scientist. Role As a Principal Machine Learning Engineer at Edison Scientific, you play a central role in building the models and...PrincipalWork at officeFlexible hours- ...Principal Software Engineer For Backend Development Our client is seeking a Principal Software Engineer focused on backend development to... ...focusing on performance, scalability, and state-of-the-art machine learning integration. You will collaborate with their founders...PrincipalRemote workFlexible hours
- ...Senior / Staff / Principal Machine Learning Engineer Location: Onsite San Francisco (5 days onsite AND hybrid options) We have multiple startups interested in talent. Here is a generic summary. Instead of a perfect job description, we present talented individuals...Principal
$209.7k - $272.6k
...Principal Machine Learning Engineer In this role, you are responsible for the design, development, programming methods, processes and systems to consolidate and analyze unstructured, diverse "big data" sources to generate actionable insights and solutions for businesses...PrincipalMinimum wage- ...for high-volume, real-time, multi-modal machine-generated data — including logs, time series... ...excellence of Splunk and Cisco's global engineering capabilities. Our work spans networking,... ...structure and unstructured data, deep learning-based time series modeling, advanced...PrincipalFlexible hours
$252k - $374k
...Principal, Machine Learning Engineer San Francisco, CA USA Your Impact at LILA Lila is building a platform where AI and automation co-evolve to solve the hardest problems in medicine. Within Life Science AI (LSAI), ML engineers build and operate the systems that...PrincipalFull timeWork at officeLocal areaFlexible hours$239k - $342k
...About the Role: The Machine Learning team at Tubi drives the innovation behind personalized... ...seeking a highly skilled Machine Learning Engineer to contribute to transformative... ...Staff Level $239,000 - $342,000 USD Principal Level $292,000 - $417,000 USD...PrincipalFull timeTemporary workLocal areaFlexible hours- A leading company is seeking a Senior / Staff / Principal Machine Learning Engineer to join their team in San Francisco. This role involves developing ML models, collaborating with engineers, and optimizing performance to ensure system reliability. Ideal candidates will...Principal
- airbnb, Inc. seeks a Senior Staff Machine Learning Engineer to fine-tune state-of-the-art LLMs and develop AI products. The role involves optimizing models for performance and collaborating with various teams to impact the travel industry. Candidates should have a PhD in...PrincipalRemote job
$231.28k - $429.52k
...measurable impact. You will be part of a thriving culture built on collaboration and innovation. Job Summary The Principal Machine Learning Engineer leads the strategic design and development of advanced machine learning models, driving innovation and exploring...PrincipalLocal areaRelocation package- A biotech AI company in San Francisco is seeking a Principal Machine Learning Engineer to accelerate scientific discovery through advanced AI models. You will interpret challenges, build training environments, and lead large-scale system training efforts. The role requires...Principal
- ...Principal Analytics & ML Engineer As we scale our self-service analytics and AI capabilities, we’re looking for a Principal Analytics & ML... ...related field. ~10+ years of experience in Data Science, Machine Learning, with a track record of building and scaling, and...PrincipalLocal area
$240k - $270k
...About the job Staff/Principal ML Engineer Staff / Principal ML Engineer Predictive Modelling for Alternative Assets Full-time | Remote... ...45 years focused on ML. Expert in Python, scikit-learn, XGBoost, and pandas. Proven MLOps experience (AWS, ECS,...PrincipalFull timeRemote work- ...foundation modeling and agentic systems. We are seeking a Principal ML Research Engineer to be the founding engineering leader on this team .... .... Advanced degree (MS or PhD) in Computer Science, Machine Learning, Engineering, or a related quantitative field, or...Principal
- ...shaping the vision. This is your chance to harness cutting‑edge machine learning to redefine how millions of people in the LGBTQ+ community... ...technical leadership across teams, collaborating with engineering, data science and product teams to turn bold ideas into tangible...PrincipalCasual workWork at officeImmediate startFlexible hours
$308k - $423.5k
...offline. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs... ...come join ours. About this role: We are seeking a Principal AI / ML Engineer to be a company-level technical thought leader and...PrincipalWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$300k - $400k
...New York City with offices around the world. To learn more, go to Role Description As a Principal AI/ML Engineer in our AdTech team, you will be a key individual... ...contributor driving the development of advanced machine learning models and AI-driven features for our advertising...Principal- ...Senior Machine Learning Engineer, Computer Vision, HD Map and SLAM Houston, TX or SF Bay Area preferred Company Introduction At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life...
$204k - $259k
...Senior Machine Learning Engineer, Simulation Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The...Work experience placement- ...technical discussions, stay proactive in learning, and apply new technologies to solve... ...problems. Track cutting-edge research in machine learning and incorporate advanced... ...’s degree in Computer Science, Software Engineering, AI, Mathematics, Physics, or a closely...Work experience placement
$180k - $220k
...Machine Learning Engineer At Ouster, we build sensors and tools for engineers, roboticists, and researchers, so they can make the world safer and more efficient. We've transformed LIDAR from an analog device with thousands of components to an elegant digital device...Work experience placementLocal area- ...with both traditional infrastructure such as load balancers, NLB, etc., as well as very different infrastructure around inference engines and GPU loads. This is a role that will inherently require deep experience with inference engines. Contributions to vLLM, SGLang...
- ...on problems that sit at the frontier of AI, manufacturing, and healthcare, this is the place. The Role As a Senior Machine Learning Engineer, you will bridge the gap between raw computer vision and physical, 3D-printed reality. You will own the pipeline that...Work at office
$212k - $318.4k
...Senior Machine Learning Engineer (Search) Apple Maps and the thousands of applications it empowers are being used by millions every single day! As a fundamental tool for human activity, Maps technology is evolving and new techniques are emerging. We are looking for...Local areaRelocation- ...Senior Machine Learning Engineer Location: San Francisco About Hum.ai Hum.ai is building planetary superintelligence. Backed by top funds, we've raised $10M+ and are now heads down building. Join us at the cutting edge, where we're scaling generative...Work experience placementRemote work
- ...Senior Machine Learning Engineer Oway Software Engineering San Francisco, CA, USA Supply chain is the circulatory system of the global economy. Every product on every shelf, every component in every factory, every meal in every restaurant, moved on a truck...Immediate start
- ...Machine Learning Engineer We are looking for a Machine Learning Engineer to join the growing AI and Machine Learning team at Strava. This team is responsible for sophisticated machine learning models and systems which provide value to Strava athletes including personalization...Work at officeWorldwideFlexible hours3 days per week
$200k - $260k
...Senior Machine Learning Engineer, Voice AI San Francisco About the Role Together AI is building the best inference infrastructure for voice applications. Our Voice AI platform powers production-grade, real-time voice agents and applications — serving speech-to...Full time$175k - $250k
...Machine Learning Engineer Kiddom is a groundbreaking educational platform that promotes student equity and growth by uniting high-quality instructional materials with dynamic digital learning. Through unparalleled curriculum management functionality, Kiddom empowers...Local areaFlexible hours- ...Role Mariana Minerals is building the critical minerals supply chain from the ground up—and we're looking for a Senior+ Machine Learning Engineer to help make it autonomous. We're not a software company selling tools to mining operators. We are a mining company that...Immediate startShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Machine Learning Engineer. Be the first to apply!
- director data engineering San Francisco, CA
- technical director engineering San Francisco, CA
- senior civil engineer project manager San Francisco, CA
- principal cloud engineer San Francisco, CA
- director of product engineering San Francisco, CA
- director systems engineering San Francisco, CA
- engineering director San Francisco, CA
- principal security engineer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
- principal network engineer San Francisco, CA

