Principal Machine Learning Engineer
$291.5k - $369.1kCisco
The application window is expected to close on:
Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received .
Meet the Team
Splunk, a Cisco company, is building a safer, more resilient digital world with an end‑to‑end, full‑stack platform designed for hybrid, multi‑cloud environments. Join the AI Models team at Splunk, where we advance the state of AI for high‑volume, real‑time, multi‑modal machine‑generated data — including logs, time series, traces, and events. We combine deep AI research expertise with the scale and operational excellence of Splunk and Cisco’s global engineering capabilities. Our work spans networking, security, observability, and customer experience — designing and deploying foundation models that enhance reliability, strengthen security, prevent downtime, and deliver predictive insights across Splunk Observability, Security, and Platform at enterprise scale. You’ll be part of a culture that values technical excellence, impact‑driven innovation, and cross‑functional collaboration — all within a flexible, growth‑oriented environment.
Your Impact
Set and Drive Vision:Define and champion the strategic vision for AI and foundation models across Splunk and Cisco platforms, shaping the research and technology roadmap to anticipate and address industry‑defining challenges.
Architect and Lead Breakthroughs: Lead the end‑to‑end lifecycle of research, design, and deployment for large‑scale foundation models targeting machine‑generated data, with deep focus on logs and complementary modalities (time series, traces, events).
Influence at Scale: Partner with executive leadership, engineering, product, and data science teams to ensure AI solutions align with broader organizational objectives, product strategies, and customer needs.
Mentorship and Thought Leadership: Cultivate organizational excellence by mentoring senior technical talent, fostering research communities, and driving best practices in AI across global teams.
Foster Innovation: Embed cutting‑edge research and technological advances into products, driving sustained competitive advantage and transformation at enterprise scale.
Minimum Qualifications:
PhD in Computer Science, or related quantitative field, plus7+ years of industry research experience.
Proven track record in at least one of the following areas: large language modeling for both structure and unstructured data, deep learning‑based time series modeling, advanced anomaly detection, and multi-modality modeling.
Solid proficiency in Python and deep learning frameworks (e.g., PyTorch, TensorFlow)
Experience translating research ideas into production systems.
Preferred Qualifications:
Deep NLP & Domain‑Adapted LLMs: Background in building and adapting large‑scale language models (e.g., T5, BERT, LLaMA, GPTs) for specialized domains including structured/unstructured logs, text, and event sequences.
Log Analytics Expertise – In‑depth knowledge of structured/unstructured system logs, event sequence analysis, anomaly detection, and root cause identification.
Advanced Anomaly Detection – Experience creating robust, scalable approaches (statistical, deep learning, or hybrid) for high‑volume, real‑time logs data.
Multi‑Modal AI Modeling – Strong track record fusing logs, time series, traces, tabular data, and graphs for foundation models tackling complex operational insights.
Large‑Scale Training & Optimization – Experience optimizing model architectures, distributed training pipelines, and inference efficiency to minimize cost and latency while preserving accuracy.
MLOps & Continuous Learning – Fluency in automated retraining, drift detection, incremental updates, and production monitoring of ML models.
Strong Research Track Record – Publications in top AI/ML conferences or journals (e.g., NeurIPS, ICML, ICLR, AAAI, CVPR, ACL, KDD) demonstrating contributions to state‑of‑the‑art methods and real‑world applications.
Why Cisco?
At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint.
Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere.
We are Cisco, and our power starts with you.
Message to applicants applying to work in the U.S. and/or Canada:
The starting salary range posted for this position is $291,500.00 to $369,100.00 and reflects the projected salary range for new hires in this position in U.S. and/or Canada locations, not including incentive compensation*, equity, or benefits.
Individual pay is determined by the candidate's hiring location, market conditions, job-related skillset, experience, qualifications, education, certifications, and/or training. The full salary range for certain locations is listed below. For locations not listed below, the recruiter can share more details about compensation for the role in your location during the hiring process.
U.S. employees are offered benefits, subject to Cisco’s plan eligibility rules, which include medical, dental and vision insurance, a 401(k) plan with a Cisco matching contribution, paid parental leave, short and long-term disability coverage, and basic life insurance. Please see the Cisco careers site to discover more benefits and perks. Employees may be eligible to receive grants of Cisco restricted stock units, which vest following continued employment with Cisco for defined periods of time.
U.S. employees are eligible for paid time away as described below, subject to Cisco’s policies:
10 paid holidays per full calendar year, plus 1 floating holiday for non-exempt employees
1 paid day off for employee’s birthday, paid year-end holiday shutdown, and 4 paid days off for personal wellness determined by Cisco
Non-exempt employees** receive 16 days of paid vacation time per full calendar year, accrued at rate of 4.92 hours per pay period for full-time employees
Exempt employees participate in Cisco’s flexible vacation time off program, which has no defined limit on how much vacation time eligible employees may use (subject to availability and some business limitations)
80 hours of sick time off provided on hire date and each January 1st thereafter, and up to 80 hours of unused sick time carried forward from one calendar year to the next
Additional paid time away may be requested to deal with critical or emergency issues for family members
Optional 10 paid days per full calendar year to volunteer
For non-sales roles, employees are also eligible to earn annual bonuses subject to Cisco’s policies.
Employees on sales plans earn performance-based incentive pay on top of their base salary, which is split between quota and non-quota components, subject to the applicable Cisco plan. For quota-based incentive pay, Cisco typically pays as follows:
.75% of incentive target for each 1% of revenue attainment up to 50% of quota;
1.5% of incentive target for each 1% of attainment between 50% and 75%;
1% of incentive target for each 1% of attainment between 75% and 100%; and
Once performance exceeds 100% attainment, incentive rates are at or above 1% for each 1% of attainment with no cap on incentive compensation.
For non-quota-based sales performance elements such as strategic sales objectives, Cisco may pay 0% up to 125% of target. Cisco sales plans do not have a minimum threshold of performance for sales incentive compensation to be paid.
The applicable full salary ranges for this position, by specific state, are listed below:
New York City Metro Area:
$291,500.00 - $424,400.00
Non-Metro New York state & Washington state:
$259,400.00 - $377,600.00
- For quota-based sales roles on Cisco’s sales plan, the ranges provided in this posting include base pay and sales target incentive compensation combined.
** Employees in Illinois, whether exempt or non-exempt, will participate in a unique time off program to meet local requirements.
Cisco is an Affirmative Action and Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.
Cisco will consider for employment, on a case by case basis, qualified applicants with arrest and conviction records.
- ...for high-volume, real-time, multi-modal machine-generated data — including logs, time series... ...excellence of Splunk and Cisco's global engineering capabilities. Our work spans networking,... ...structure and unstructured data, deep learning-based time series modeling, advanced...PrincipalFlexible hours
- Senior / Staff / Principal Machine Learning Engineer Location: Onsite San Francisco (5 days onsite AND hybrid options) We have multiple startups interested in talent. Here is a generic summary. Instead of a perfect job description, we present talented individuals to companies...Principal
$314.58k
...marketplace design and operations. What we're looking for Degree in Computer Science, Machine Learning, Statistics or related field. 10+ years of professional experience as a hands-on engineer and technical leader leading multiple projects. Strong software engineering and...PrincipalTemporary workWork at officeLocal areaRelocationRelocation package$252k - $374k
...medicine. Within Life Science AI (LSAI), ML engineers build and operate the systems that... ...science domains. We are seeking a Principal ML Engineer to design, build, and scale... ...degree or higher in Computer Science, Machine Learning, or a related quantitative field (or Bachelor...PrincipalFull timeWork at officeLocal areaFlexible hours$275k - $350k
...AI agents are how we intend to fix that. We're assembling a team of top researchers and engineers across AI and biology to build an AI scientist. Role As a Principal Machine Learning Engineer at Edison Scientific, you play a central role in building the models and...PrincipalWork at officeFlexible hours$239k - $342k
About the Role The Machine Learning team at Tubi drives the innovation behind personalized user... ...seeking a highly skilled Machine Learning Engineer to contribute to transformative... ...Angeles, New York City, and San Francisco. Principal Level: $292,000 - $417,000 USD. This role...Principal- A leading company is seeking a Senior / Staff / Principal Machine Learning Engineer to join their team in San Francisco. This role involves developing ML models, collaborating with engineers, and optimizing performance to ensure system reliability. Ideal candidates will...Principal
- A leading autonomous driving technology firm in San Francisco is seeking a Principal Software Engineer for their Perception team. The role involves developing sensor-fusion foundation models that enhance the Waymo Driver's understanding of its environment, and collaborating...Principal
- airbnb, Inc. seeks a Senior Staff Machine Learning Engineer to fine-tune state-of-the-art LLMs and develop AI products. The role involves optimizing models for performance and collaborating with various teams to impact the travel industry. Candidates should have a PhD in...PrincipalRemote job
- ...shaping the vision. This is your chance to harness cutting‑edge machine learning to redefine how millions of people in the LGBTQ+ community... ...technical leadership across teams, collaborating with engineering, data science and product teams to turn bold ideas into tangible...PrincipalCasual workWork at officeImmediate startFlexible hours
- A biotech AI company in San Francisco is seeking a Principal Machine Learning Engineer to accelerate scientific discovery through advanced AI models. You will interpret challenges, build training environments, and lead large-scale system training efforts. The role requires...Principal
- About the Role We are seeking a Principal / Distinguished AI/ML Researcher and/or Engineer with deep experience in reasoning, planning, and decision-making systems... ...with Knowledge Graphs , and applied Reinforcement Learning (RL) as a first-class component of adaptive...PrincipalLocal area
- A leading streaming service provider in Los Angeles is seeking an experienced Machine Learning Engineer to lead the design and implementation of advanced recommendation systems. The role demands expertise in building and deploying robust machine learning pipelines, as well...Principal
- The Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands‑on technical leadership role responsible for defining, building, and operating next‑generation AI systems on Oracle Cloud Infrastructure (OCI). This person will set architecture and engineering...Principal
- ...a systems thinker who turns ambiguous business problems into scalable ML architectures, serving as a bridge between research and engineering reality. You will have direct influence on the company’s AI roadmap. Responsibilities Architect end-to-end ML systems designed for...
- ...well‑funded AI startup building production‑grade ML infrastructure used by enterprise customers. They are looking for a Senior AI/ML Engineer to own model training pipelines, evaluation systems, and inference serving at scale. Full‑time, on‑site in San Francisco. What you...Full time
- ...Senior ML Engineer Supply chain is the circulatory system of the global economy. Every product on every shelf, every component in every... ...autonomous LLM-based dispatch agent, including reinforcement learning workflows, prompt engineering, and edge-case handling in live...Immediate start
- ...Machine Learning Engineer ESPN is investing in large-scale data infrastructure and real-time processing platforms that power next-generation personalization and live sports experiences. As a Machine Learning Engineer, you will focus on building and operating distributed...
- ...Senior Machine Learning Engineer Location: San Francisco About Hum.ai Hum.ai is building planetary superintelligence. Backed by top funds, we've raised $10M+ and are now heads down building. Join us at the cutting edge, where we're scaling generative...Work experience placementRemote work
$185k - $280k
...Machine Learning Engineer Kiddom is a groundbreaking educational platform that promotes student equity and growth by uniting high-quality instructional materials with dynamic digital learning. Through unparalleled curriculum management functionality, Kiddom empowers...Permanent employmentFull timeLocal areaFlexible hours$290k - $359.6k
...DUTIES Research, design, develop and test robotic and machine learning applications for an AV company. Duties may include: Contribute to... ...telecommute. REQUIREMENTS Master's degree in Data Science, Aerospace Engineering, Automotive Engineering, Computer Engineering, Robotics or a...Temporary workRemote work$116.9k - $200.4k
...that builds verification, optimization, and analytics solutions for the advertising industry. IAS is looking for a Senior Machine Learning Engineer on the Data Sciences Team. In this role you will oversee a sophisticated suite of data science systems making large‑scale...Full time$200k - $400k
...high-growth venture backed by forward‑thinking investors, and we are seeking an innovative strategic engineer to help us scale. Role Overview The Senior Machine Learning Engineer will play a central role in designing, building, and optimizing large‑scale machine...Work experience placement$204k - $259k
...serving as the foundation for training and validating the AV stack. We are an advanced ML and engineering team that leverages state-of-the-art computer vision, deep learning, and generative AI to automatically analyze driving logs, generate rich scene understanding, and...Full timeRemote work- ...We are looking for a Machine Learning Engineer to join the growing AI and Machine Learning team at Strava. This team is responsible for sophisticated machine learning models and systems which provide value to Strava athletes including personalization, recommendations,...Work at officeWorldwideFlexible hours3 days per week
- ...someone to work in a cross‑functional team of data scientists, engineers and data product managers to productize and scale the AI... ...cloud development preferably in AWS 2+ years of experience as a Machine Learning Engineer or relevant jobs Up‑to‑date knowledge of the latest...Work at officeLocal area
$200k - $280k
...Founding Senior Machine Learning Engineer Join to apply for the Founding Senior Machine Learning Engineer role at Retell AI. Base pay range $200,000 – $280,000 per year About Retell AI Retell AI is using first principles to reimagine the call center with...H1bWork at office- ...Hubspot, Under Armour, Hanes, etc.), and concrete growth metrics (7 figures ARR) have been generalized or removed. Senior Machine Learning Engineer About the Company We are a rapidly scaling, post-revenue technology company building foundational infrastructure...Immediate start
$180k - $300k
...Senior Software Engineer, Machine Learning We’re looking for a product-minded machine learning engineer who’s excited to push the boundaries of what’s possible with AI. At Arcade, you’ll experiment with the latest models to generate visuals, motion, and language that...Remote workRelocation- ...Senior Machine Learning Engineer Orchard Robotics is a Series A startup backed by top VCs like Quiet Capital, Shine Capital, and General Catalyst. We're securing America's food supply by building the AI farmer that automates our nation's farms. We've raised over $25...Full timeWork at officeFlexible hoursWeekend work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Machine Learning Engineer. Be the first to apply!
- principal safety engineer San Francisco, CA
- principal cloud engineer San Francisco, CA
- assistant chief engineer San Francisco, CA
- principal security engineer San Francisco, CA
- director of product engineering San Francisco, CA
- principal developer San Francisco, CA
- hotel chief engineer San Francisco, CA
- director systems engineering San Francisco, CA
- director data engineering San Francisco, CA
- senior principal engineer San Francisco, CA

