Principal Machine Learning Engineer
$291.5k - $369.1kCISCO, Inc.
The application window is expected to close on:
Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received .
Meet the Team
Splunk, a Cisco company, is building a safer, more resilient digital world with an end‑to‑end, full‑stack platform designed for hybrid, multi‑cloud environments. Join the AI Models team at Splunk, where we advance the state of AI for high‑volume, real‑time, multi‑modal machine‑generated data — including logs, time series, traces, and events. We combine deep AI research expertise with the scale and operational excellence of Splunk and Cisco’s global engineering capabilities. Our work spans networking, security, observability, and customer experience — designing and deploying foundation models that enhance reliability, strengthen security, prevent downtime, and deliver predictive insights across Splunk Observability, Security, and Platform at enterprise scale. You’ll be part of a culture that values technical excellence, impact‑driven innovation, and cross‑functional collaboration — all within a flexible, growth‑oriented environment.
Your Impact
Set and Drive Vision:Define and champion the strategic vision for AI and foundation models across Splunk and Cisco platforms, shaping the research and technology roadmap to anticipate and address industry‑defining challenges.
Architect and Lead Breakthroughs: Lead the end‑to‑end lifecycle of research, design, and deployment for large‑scale foundation models targeting machine‑generated data, with deep focus on logs and complementary modalities (time series, traces, events).
Influence at Scale: Partner with executive leadership, engineering, product, and data science teams to ensure AI solutions align with broader organizational objectives, product strategies, and customer needs.
Mentorship and Thought Leadership: Cultivate organizational excellence by mentoring senior technical talent, fostering research communities, and driving best practices in AI across global teams.
Foster Innovation: Embed cutting‑edge research and technological advances into products, driving sustained competitive advantage and transformation at enterprise scale.
Minimum Qualifications:
PhD in Computer Science, or related quantitative field, plus7+ years of industry research experience.
Proven track record in at least one of the following areas: large language modeling for both structure and unstructured data, deep learning‑based time series modeling, advanced anomaly detection, and multi-modality modeling.
Solid proficiency in Python and deep learning frameworks (e.g., PyTorch, TensorFlow)
Experience translating research ideas into production systems.
Preferred Qualifications:
Deep NLP & Domain‑Adapted LLMs: Background in building and adapting large‑scale language models (e.g., T5, BERT, LLaMA, GPTs) for specialized domains including structured/unstructured logs, text, and event sequences.
Log Analytics Expertise – In‑depth knowledge of structured/unstructured system logs, event sequence analysis, anomaly detection, and root cause identification.
Advanced Anomaly Detection – Experience creating robust, scalable approaches (statistical, deep learning, or hybrid) for high‑volume, real‑time logs data.
Multi‑Modal AI Modeling – Strong track record fusing logs, time series, traces, tabular data, and graphs for foundation models tackling complex operational insights.
Large‑Scale Training & Optimization – Experience optimizing model architectures, distributed training pipelines, and inference efficiency to minimize cost and latency while preserving accuracy.
MLOps & Continuous Learning – Fluency in automated retraining, drift detection, incremental updates, and production monitoring of ML models.
Strong Research Track Record – Publications in top AI/ML conferences or journals (e.g., NeurIPS, ICML, ICLR, AAAI, CVPR, ACL, KDD) demonstrating contributions to state‑of‑the‑art methods and real‑world applications.
Why Cisco?
At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint.
Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere.
We are Cisco, and our power starts with you.
Message to applicants applying to work in the U.S. and/or Canada:
The starting salary range posted for this position is $291,500.00 to $369,100.00 and reflects the projected salary range for new hires in this position in U.S. and/or Canada locations, not including incentive compensation*, equity, or benefits.
Individual pay is determined by the candidate's hiring location, market conditions, job-related skillset, experience, qualifications, education, certifications, and/or training. The full salary range for certain locations is listed below. For locations not listed below, the recruiter can share more details about compensation for the role in your location during the hiring process.
U.S. employees are offered benefits, subject to Cisco’s plan eligibility rules, which include medical, dental and vision insurance, a 401(k) plan with a Cisco matching contribution, paid parental leave, short and long-term disability coverage, and basic life insurance. Please see the Cisco careers site to discover more benefits and perks. Employees may be eligible to receive grants of Cisco restricted stock units, which vest following continued employment with Cisco for defined periods of time.
U.S. employees are eligible for paid time away as described below, subject to Cisco’s policies:
10 paid holidays per full calendar year, plus 1 floating holiday for non-exempt employees
1 paid day off for employee’s birthday, paid year-end holiday shutdown, and 4 paid days off for personal wellness determined by Cisco
Non-exempt employees** receive 16 days of paid vacation time per full calendar year, accrued at rate of 4.92 hours per pay period for full-time employees
Exempt employees participate in Cisco’s flexible vacation time off program, which has no defined limit on how much vacation time eligible employees may use (subject to availability and some business limitations)
80 hours of sick time off provided on hire date and each January 1st thereafter, and up to 80 hours of unused sick time carried forward from one calendar year to the next
Additional paid time away may be requested to deal with critical or emergency issues for family members
Optional 10 paid days per full calendar year to volunteer
For non-sales roles, employees are also eligible to earn annual bonuses subject to Cisco’s policies.
Employees on sales plans earn performance-based incentive pay on top of their base salary, which is split between quota and non-quota components, subject to the applicable Cisco plan. For quota-based incentive pay, Cisco typically pays as follows:
.75% of incentive target for each 1% of revenue attainment up to 50% of quota;
1.5% of incentive target for each 1% of attainment between 50% and 75%;
1% of incentive target for each 1% of attainment between 75% and 100%; and
Once performance exceeds 100% attainment, incentive rates are at or above 1% for each 1% of attainment with no cap on incentive compensation.
For non-quota-based sales performance elements such as strategic sales objectives, Cisco may pay 0% up to 125% of target. Cisco sales plans do not have a minimum threshold of performance for sales incentive compensation to be paid.
The applicable full salary ranges for this position, by specific state, are listed below:
New York City Metro Area:
$291,500.00 - $424,400.00
Non-Metro New York state & Washington state:
$259,400.00 - $377,600.00
- For quota-based sales roles on Cisco’s sales plan, the ranges provided in this posting include base pay and sales target incentive compensation combined.
** Employees in Illinois, whether exempt or non-exempt, will participate in a unique time off program to meet local requirements.
Cisco is an Affirmative Action and Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.
Cisco will consider for employment, on a case by case basis, qualified applicants with arrest and conviction records.
$275k - $350k
...Principal Machine Learning Engineer San Francisco, CA About Edison Scientific builds and commercializes AI agents for science. Scientific discovery moves too slowly, and autonomous AI agents are how we intend to fix that. We're assembling a team of top researchers...PrincipalWork at officeFlexible hours- ...Principal Software Engineer For Backend Development Our client is seeking a Principal Software Engineer focused on backend development to... ...focusing on performance, scalability, and state-of-the-art machine learning integration. You will collaborate with their founders...PrincipalRemote workFlexible hours
- ...for high-volume, real-time, multi-modal machine-generated data — including logs, time series... ...excellence of Splunk and Cisco's global engineering capabilities. Our work spans networking,... ...structure and unstructured data, deep learning-based time series modeling, advanced...PrincipalFlexible hours
- Senior / Staff / Principal Machine Learning Engineer Location: Onsite San Francisco (5 days onsite AND hybrid options) We have multiple startups interested in talent. Here is a generic summary. Instead of a perfect job description, we present talented individuals to companies...Principal
$184.5k - $230.7k
Principal Machine Learning & Data Engineer Remote - US Who we are At Twilio, we’re shaping the future of communications, all from the comfort of our homes. We deliver innovative solutions to hundreds of thousands of businesses and empower millions of developers worldwide...PrincipalRemote jobLocal areaWorldwide$276k - $414k
...express themselves, live in the moment, learn about the world, and have fun together.... ..., and other digital services. Snap Engineering teams build fun and technically sophisticated... ...at the forefront. We’re looking for a Principal Machine Learning Engineer to join the Content...PrincipalFull timeLive inWork at officeLocal area$239k - $342k
About the Role The Machine Learning team at Tubi drives the innovation behind personalized user... ...seeking a highly skilled Machine Learning Engineer to contribute to transformative... ...Angeles, New York City, and San Francisco. Principal Level: $292,000 - $417,000 USD. This role...Principal- The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical leadership role responsible for defining, building, and operating next-generation AI systems on Oracle Cloud Infrastructure (OCI). This person will set architecture and engineering...PrincipalFull timeFlexible hours
- A leading company is seeking a Senior / Staff / Principal Machine Learning Engineer to join their team in San Francisco. This role involves developing ML models, collaborating with engineers, and optimizing performance to ensure system reliability. Ideal candidates will...Principal
- airbnb, Inc. seeks a Senior Staff Machine Learning Engineer to fine-tune state-of-the-art LLMs and develop AI products. The role involves optimizing models for performance and collaborating with various teams to impact the travel industry. Candidates should have a PhD in...PrincipalRemote job
- A biotech AI company in San Francisco is seeking a Principal Machine Learning Engineer to accelerate scientific discovery through advanced AI models. You will interpret challenges, build training environments, and lead large-scale system training efforts. The role requires...Principal
- About the Role We are seeking a Principal / Distinguished AI/ML Researcher and/or Engineer with deep experience in reasoning, planning, and decision-making systems... ...with Knowledge Graphs , and applied Reinforcement Learning (RL) as a first-class component of adaptive...PrincipalLocal area
- A leading streaming service provider in Los Angeles is seeking an experienced Machine Learning Engineer to lead the design and implementation of advanced recommendation systems. The role demands expertise in building and deploying robust machine learning pipelines, as well...Principal
- ...shaping the vision. This is your chance to harness cutting‑edge machine learning to redefine how millions of people in the LGBTQ+ community... ...technical leadership across teams, collaborating with engineering, data science and product teams to turn bold ideas into tangible...PrincipalCasual workWork at officeImmediate startFlexible hours
- The Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands‑on technical leadership role responsible for defining, building, and operating next‑generation AI systems on Oracle Cloud Infrastructure (OCI). This person will set architecture and engineering...Principal
- ...a systems thinker who turns ambiguous business problems into scalable ML architectures, serving as a bridge between research and engineering reality. You will have direct influence on the company’s AI roadmap. Responsibilities Architect end-to-end ML systems designed for...
$198k - $221.5k
...time Location Type Hybrid Department Department Technology Engineering Compensation $198K – $221.5K • Offers Equity What You’ll Do... ...culture. What You’ll Bring to the Team Have worked on numerous machine learning problems and broken them into incremental tasks. Have...Full time$200k - $400k
...high-growth venture backed by forward‑thinking investors, and we are seeking an innovative strategic engineer to help us scale. Role Overview The Senior Machine Learning Engineer will play a central role in designing, building, and optimizing large‑scale machine...Work experience placement$200k - $280k
...Founding Senior Machine Learning Engineer Join to apply for the Founding Senior Machine Learning Engineer role at Retell AI. Base pay range $200,000 – $280,000 per year About Retell AI Retell AI is using first principles to reimagine the call center with...H1bWork at office$216.7k - $303.4k
...Join the Ads team as a Machine Learning Engineer and become a key contributor to Reddit’s business. In this hands‑on role, you will be responsible for the full lifecycle of our ML systems, from initial research and modeling to deployment and optimization in production....$180k - $300k
...Senior Software Engineer, Machine Learning We’re looking for a product-minded machine learning engineer who’s excited to push the boundaries of what’s possible with AI. At Arcade, you’ll experiment with the latest models to generate visuals, motion, and language that...Remote workRelocation- ...Senior Machine Learning Engineer Disney Entertainment & ESPN Technology On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's...Worldwide
$96.8k - $306.4k
...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical leadership role responsible for defining, building, and operating next-generation AI systems on Oracle Cloud Infrastructure (OCI). This person will set...PrincipalTemporary workFlexible hours- ...with both traditional infrastructure such as load balancers, NLB, etc., as well as very different infrastructure around inference engines and GPU loads. This is a role that will inherently require deep experience with inference engines. Contributions to vLLM, SGLang...
$160k - $250k
...Senior Machine Learning Engineer In order to execute our vision, we need to grow our team of best-in-class machine learning engineers. We are looking for developers who are excited about staying at the forefront of deep learning technology, prototyping state-of-the-...$204k - $259k
...serving as the foundation for training and validating the AV stack. We are an advanced ML and engineering team that leverages state-of-the-art computer vision, deep learning, and generative AI to automatically analyze driving logs, generate rich scene understanding, and...Full timeRemote work$244k - $320k
...email, and push notifications, our AI-powered personalization engine delivers bespoke experiences that drive performance, revenue... ...'s Corporate Equality Index [ About the Role Our Machine Learning Engineering team powers personalized experiences for hundreds...Full time$151.8k - $265.35k
...deliver hyper-personalized experiences at every touchpoint-from first awareness through closed revenue. We are looking for a Machine Learning Engineer to join our AI and Agents team, define and own the ML architecture vision for our B2B journey orchestration platform. In...Temporary workLocal areaWorldwide$161.93k - $227.33k
...Senior Machine Learning Engineer Brisbane, California About This Opportunity: At Freenome, we are seeking a Senior Machine Learning Research Engineer to join the Machine Learning Science (MLS) team, within the Computational Science department. The ideal candidate...Work at officeLocal areaRemote work2 days per week3 days per week- ...well-funded AI startup building production-grade ML infrastructure used by enterprise customers. They are looking for a Senior AI/ML Engineer to own model training pipelines, evaluation systems, and inference serving at scale. Full-time, on-site in San Francisco. What...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Machine Learning Engineer. Be the first to apply!
- principal network engineer San Francisco, CA
- senior director engineering San Francisco, CA
- engineering director San Francisco, CA
- principal engineer San Francisco, CA
- principal application developer San Francisco, CA
- assistant chief engineer San Francisco, CA
- principal security engineer San Francisco, CA
- director systems engineering San Francisco, CA
- director software engineering San Francisco, CA
- project engineer assistant project manager San Francisco, CA

