Principal Machine Learning Engineer
$291.5k - $369.1kCisco
The application window is expected to close on:
Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received .
Meet the Team
Splunk, a Cisco company, is building a safer, more resilient digital world with an end‑to‑end, full‑stack platform designed for hybrid, multi‑cloud environments. Join the AI Models team at Splunk, where we advance the state of AI for high‑volume, real‑time, multi‑modal machine‑generated data — including logs, time series, traces, and events. We combine deep AI research expertise with the scale and operational excellence of Splunk and Cisco’s global engineering capabilities. Our work spans networking, security, observability, and customer experience — designing and deploying foundation models that enhance reliability, strengthen security, prevent downtime, and deliver predictive insights across Splunk Observability, Security, and Platform at enterprise scale. You’ll be part of a culture that values technical excellence, impact‑driven innovation, and cross‑functional collaboration — all within a flexible, growth‑oriented environment.
Your Impact
Set and Drive Vision:Define and champion the strategic vision for AI and foundation models across Splunk and Cisco platforms, shaping the research and technology roadmap to anticipate and address industry‑defining challenges.
Architect and Lead Breakthroughs: Lead the end‑to‑end lifecycle of research, design, and deployment for large‑scale foundation models targeting machine‑generated data, with deep focus on logs and complementary modalities (time series, traces, events).
Influence at Scale: Partner with executive leadership, engineering, product, and data science teams to ensure AI solutions align with broader organizational objectives, product strategies, and customer needs.
Mentorship and Thought Leadership: Cultivate organizational excellence by mentoring senior technical talent, fostering research communities, and driving best practices in AI across global teams.
Foster Innovation: Embed cutting‑edge research and technological advances into products, driving sustained competitive advantage and transformation at enterprise scale.
Minimum Qualifications:
PhD in Computer Science, or related quantitative field, plus7+ years of industry research experience.
Proven track record in at least one of the following areas: large language modeling for both structure and unstructured data, deep learning‑based time series modeling, advanced anomaly detection, and multi-modality modeling.
Solid proficiency in Python and deep learning frameworks (e.g., PyTorch, TensorFlow)
Experience translating research ideas into production systems.
Preferred Qualifications:
Deep NLP & Domain‑Adapted LLMs: Background in building and adapting large‑scale language models (e.g., T5, BERT, LLaMA, GPTs) for specialized domains including structured/unstructured logs, text, and event sequences.
Log Analytics Expertise – In‑depth knowledge of structured/unstructured system logs, event sequence analysis, anomaly detection, and root cause identification.
Advanced Anomaly Detection – Experience creating robust, scalable approaches (statistical, deep learning, or hybrid) for high‑volume, real‑time logs data.
Multi‑Modal AI Modeling – Strong track record fusing logs, time series, traces, tabular data, and graphs for foundation models tackling complex operational insights.
Large‑Scale Training & Optimization – Experience optimizing model architectures, distributed training pipelines, and inference efficiency to minimize cost and latency while preserving accuracy.
MLOps & Continuous Learning – Fluency in automated retraining, drift detection, incremental updates, and production monitoring of ML models.
Strong Research Track Record – Publications in top AI/ML conferences or journals (e.g., NeurIPS, ICML, ICLR, AAAI, CVPR, ACL, KDD) demonstrating contributions to state‑of‑the‑art methods and real‑world applications.
Why Cisco?
At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint.
Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere.
We are Cisco, and our power starts with you.
Message to applicants applying to work in the U.S. and/or Canada:
The starting salary range posted for this position is $291,500.00 to $369,100.00 and reflects the projected salary range for new hires in this position in U.S. and/or Canada locations, not including incentive compensation*, equity, or benefits.
Individual pay is determined by the candidate's hiring location, market conditions, job-related skillset, experience, qualifications, education, certifications, and/or training. The full salary range for certain locations is listed below. For locations not listed below, the recruiter can share more details about compensation for the role in your location during the hiring process.
U.S. employees are offered benefits, subject to Cisco’s plan eligibility rules, which include medical, dental and vision insurance, a 401(k) plan with a Cisco matching contribution, paid parental leave, short and long-term disability coverage, and basic life insurance. Please see the Cisco careers site to discover more benefits and perks. Employees may be eligible to receive grants of Cisco restricted stock units, which vest following continued employment with Cisco for defined periods of time.
U.S. employees are eligible for paid time away as described below, subject to Cisco’s policies:
10 paid holidays per full calendar year, plus 1 floating holiday for non-exempt employees
1 paid day off for employee’s birthday, paid year-end holiday shutdown, and 4 paid days off for personal wellness determined by Cisco
Non-exempt employees** receive 16 days of paid vacation time per full calendar year, accrued at rate of 4.92 hours per pay period for full-time employees
Exempt employees participate in Cisco’s flexible vacation time off program, which has no defined limit on how much vacation time eligible employees may use (subject to availability and some business limitations)
80 hours of sick time off provided on hire date and each January 1st thereafter, and up to 80 hours of unused sick time carried forward from one calendar year to the next
Additional paid time away may be requested to deal with critical or emergency issues for family members
Optional 10 paid days per full calendar year to volunteer
For non-sales roles, employees are also eligible to earn annual bonuses subject to Cisco’s policies.
Employees on sales plans earn performance-based incentive pay on top of their base salary, which is split between quota and non-quota components, subject to the applicable Cisco plan. For quota-based incentive pay, Cisco typically pays as follows:
.75% of incentive target for each 1% of revenue attainment up to 50% of quota;
1.5% of incentive target for each 1% of attainment between 50% and 75%;
1% of incentive target for each 1% of attainment between 75% and 100%; and
Once performance exceeds 100% attainment, incentive rates are at or above 1% for each 1% of attainment with no cap on incentive compensation.
For non-quota-based sales performance elements such as strategic sales objectives, Cisco may pay 0% up to 125% of target. Cisco sales plans do not have a minimum threshold of performance for sales incentive compensation to be paid.
The applicable full salary ranges for this position, by specific state, are listed below:
New York City Metro Area:
$291,500.00 - $424,400.00
Non-Metro New York state & Washington state:
$259,400.00 - $377,600.00
- For quota-based sales roles on Cisco’s sales plan, the ranges provided in this posting include base pay and sales target incentive compensation combined.
** Employees in Illinois, whether exempt or non-exempt, will participate in a unique time off program to meet local requirements.
Cisco is an Affirmative Action and Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.
Cisco will consider for employment, on a case by case basis, qualified applicants with arrest and conviction records.
- ...for high-volume, real-time, multi-modal machine-generated data — including logs, time series... ...excellence of Splunk and Cisco's global engineering capabilities. Our work spans networking,... ...structure and unstructured data, deep learning-based time series modeling, advanced...PrincipalFlexible hours
- ...Machine Learning Engineer As a Machine Learning Engineer, build and maintain large scale ML Infrastructure and ML pipelines. Contribute to building advanced analytics, machine learning platform and tools to enable both prediction and optimization of models. Extend existing...SuggestedShift work
- ...Senior Machine Learning Engineer McLean, Virginia Senior Machine Learning Engineer Location: McLean, VA (hybrid); occasional travel to Durham, NC and customer sites About CoVar CoVar is a small AI/ML R&D software company with offices in Durham, NC and McLean...SuggestedTemporary workWork at officeLocal areaFlexible hoursShift work
- ...Machine Learning Engineer Machine Learning Engineer About CoVar CoVar is a small AI/ML R&D software company in Durham, NC, that uses artificial intelligence to solve problems that matter. We develop AI/ML tools to help the DoD detect enemies and threats, help...SuggestedTemporary workRelocation packageFlexible hours
- ...Sr. Machine Learning Engineer Duration: 12 -24 Months Location: Merrimack, NH/ Smithfield, RI/ Westlake, TX/ Durham, NC/ Covington, KY/ Jersey City, NJ/ Boston, MA Candidate should be local or willing to work onsite on any of the above locations for 5 days/ month...SuggestedLocal area
$110k - $140k
...Sunergi Inc. Machine Learning Engineer Full-time We are expanding rapidly and are seeking new, experienced and hands‑on team members who think outside of the box (and are not afraid to share their thoughts), will deliver unique ideas and like to work in a fast‑paced environment...Full timeRemote work$107.66k - $161.7k
...topics and providing a unique platform to learn and connect with others. Poe : a... ...About the Team and Role: Our small engineering team works on challenging problems every... ...product and our company. At Poe, we use Machine Learning in various parts of the product...Remote jobFull timeWork experience placementInternship- ...Data Engineer Hybrid Mode (5 days in month) Durham, NC Data Streaming & Messaging Technologies (Kafka, Kinesis, SNS, SQS) - Ability to build and deliver cloud infrastructure in AWS EC2, RDS and Azure using industry standard tools. - Proficiency building and deploying...Principal
- ...while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with senior engineers and...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
- ...including e-commerce, advertising, and fulfillment. We use machine learning and Internet-scale data to elevate customer experience,... ...Discovery ML team at Instacart works alongside world-class engineers, data scientists, and product managers to shape the future of...Remote jobPermanent employmentWork experience placementInternshipWork at officeWork from homeFlexible hours
- KBI Biopharma Inc. is seeking a highly skilled Senior Level Analytical Scientist to join our team in Durham, NC. This role is perfect for an experienced scientist with deep expertise in protein analytics. You will drive innovation in analytical testing and support client...Principal
$134k - $179k
Biogen, Inc. seeks a Senior Principal Analyst in Durham, North Carolina to lead statistical programming for clinical trials. This hybrid role demands 10+ years in data management and clinical programming, particularly with SAS. The ideal candidate will have experience in...Principal$168.15k - $277.35k
...distributed systems; automation tools, specifically their internal wrkings; wrking w/ upstream communities; coaching & mentoring jr engineers; & cross-portfolio &/ or cross-company collaborative tech design. Must have 2 yrs of exp prog in Typescript. Job ID: R-056653...PrincipalWork at officeRemote work$168.15k - $277.35k
A leading software solutions provider is seeking a Senior Principal Software Engineer in Durham, NC. You will provide technical leadership for the Ansible Automation Platform, mentoring engineers and devising strategies for product alignment. The ideal candidate has a Bachelor...PrincipalFlexible hours- KBI Biopharma Inc. is looking for a Sr/Principal Computer Systems Validation Specialist in Durham, NC. This individual will oversee enterprise software validation in a cGMP environment, providing expert guidance on validation lifecycle deliverables and ensuring compliance...PrincipalRemote job
- ...district in North Carolina is seeking an Assistant Elementary School Principal to assist in leadership and administration of educational... ...The role seeks a candidate dedicated to fostering a conducive learning environment and supporting student achievement. #J-18808-...Principal
- A progressive design firm is seeking a Design Principal specializing in Mixed-Use Developments. This role requires strong leadership and mentoring skills, with a focus on sustainable and regenerative design practices. The ideal candidate will work collaboratively with a...Principal
- Ampere in Durham, North Carolina is seeking a Distinguished Signal Integrity Engineer to design and validate high-performance interconnect solutions for multi-core processor products. You will work closely with package and PCB designers, influence technology roadmaps,...Principal
$178.5k - $231k
...Job Description Principal Software Engineer (Data Warehousing/Lakehouse and Analytics Solutions) The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop...Principal- KIPP North Carolina Public Schools seeks an Assistant Principal for its Change Academy in Durham. The ideal candidate will lead instructional efforts, support teachers, and manage school culture. Minimum qualifications include a Bachelor’s degree in a relevant area and...Principal
$115.9k - $243.9k
A leading global CRO is seeking a Senior or Principal Biostatistician for early phase clinical development. This remote position focuses on providing statistical support for drug development programs. Candidates should have a PhD or MS in Statistics with significant industry...PrincipalRemote job- A local education authority seeks an experienced Elementary School Principal to lead and supervise the educational program, ensuring student achievement and compliance with district policies. The ideal candidate must possess a Master's degree and have at least five years...PrincipalFull timeLocal area
- A leading architectural firm in Durham, North Carolina is seeking an experienced interior design leader. Responsibilities include leading design phases, engaging clients, and mentoring staff to ensure high-quality design execution. Candidates should possess a relevant degree...Principal
- A leading clinical research organization is seeking a Principal Biostatistician in North Carolina or remotely. This role involves providing statistical support for clinical trials, collaborating with multi-disciplinary teams, and authoring statistical analysis plans. Candidates...PrincipalRemote job
$98.2k - $273.2k
IQVIA Argentina is looking for a Principal Statistical Programmer to provide comprehensive statistical programming support across clinical programs. The role involves leadership in developing SDTM and ADaM datasets, ensuring compliance with CDISC standards, and contributing...PrincipalRemote job$95k - $154k
...looking for entry-level software programmers, Java Full stack developers, Python/Java developers, data analysts/data engineers/data scientists, and machine learning engineers for full-time positions with clients. We focus on Java/Full stack/DevOps and data science/data...Full timeH1bRemote work- ...Senior Staff / Principal Engineer - Digital Ecosystem Brazil, Belo Horizonte; Brazil, Campinas; Brazil, Rio de Janeiro; Brazil, Sao Paulo; USA, Durham; USA, Miami; USA, Palo Alto; USA, Washington DC Opportunity We are hiring a Senior Staff or Principal Engineer...PrincipalTemporary work
$178.5k - $231k
...Job Description Principal Software Engineer (Full Stack + Data + AI Specialist) The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for...Principal- CHURCHILL HOUSE VIP EVENTS in Durham, NC, is seeking an Assistant Principal dedicated to fostering vibrant school communities and driving academic excellence. This role involves observing and coaching teachers, developing relationships with students and families, and ensuring...Principal
$140k - $200k
A leading digital consultancy is seeking an experienced Associate Principal, CX Application Strategy, to drive digital transformation initiatives. In this hybrid role based in Durham, NC, you will lead efforts in enhancing customer experience through AI and technology integration...Principal
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Machine Learning Engineer. Be the first to apply!
- senior civil engineer project manager Durham, NC
- principal cloud engineer Durham, NC
- engineering director Durham, NC
- principal infrastructure engineer Durham, NC
- principal network engineer Durham, NC
- chief engineer Durham, NC
- data center chief engineer Durham, NC
- principal developer Durham, NC
- senior principal engineer Durham, NC
- hotel chief engineer Durham, NC


