Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI Engineer

$221k - $299k
Full-time

Rapid7

Our Engineering organisation is scaling its AI Engineering capabilities under new leadership, creating an opportunity to build the next generation of AI at Rapid7. We’re looking for Principal AI Engineers to join us and help shape what comes next by defining and influencing the technical direction of our LLM and agentic AI systems. As a Principal AI Engineer, you’ll raise the bar for engineering standards, and build truly cutting edge greenfield solutions that deliver real impact for our Global customers. Through your technical leadership and mentoring, you’ll help shape our product and platform investments and influence how we build and scale AI across the organisation.

About the Team
AI is reshaping cybersecurity on both sides. Attackers can use AI to strike at machine speed, and only AI-powered defense can keep up. At the same time, organizations can only adopt AI with confidence if it is secure. Rapid7 sits at the intersection of security and AI, and we are building industry-defining products for this new era.

Rapid7's AI Engineering team builds the AI that powers our security platform. We are AI engineers and applied scientists who take models from research to production, combining open-source and frontier LLMs, AI agents, and fast predictive models with more than 20 years of Rapid7 security expertise. Our work drives core use cases across Detection and Response, such as alert triage, threat investigation, and automated response, and Exposure and Remediation, such as vulnerability prioritization, attack surface risk assessment, and guided remediation. Together, these help customers stop threats faster and fix what matters most.

About the Role

As a Principal AI Engineer, you will set the technical direction for how Rapid7 builds, tunes and serves LLMs and agentic systems across its security products. You understand LLMs from the ground up, from transformer internals and training to fine-tuning and inference optimization, and you stay hands-on with the hardest problems. You know where LLMs shine and where they fall short, and you treat them as one tool in the AI toolbox, alongside predictive AI and classical ML, choosing the right approach for each problem. Specifically your focus will be to:

  • Define the architecture and technical roadmap for LLM and agentic AI systems across Detection and Response and Exposure and Remediation
  • Lead model strategy: when to use frontier or open-source models, and when to fine-tune, distill, or post-train
  • Fine-tune, distill and post-train open-source LLMs on security data, from data curation through training, evaluation and deployment
  • Set engineering standards for context engineering, inference optimization, and evaluation across teams
  • Optimize LLM inference at scale with techniques such as speculative decoding, KV-cache management, continuous batching, quantization and custom kernels, balancing quality, latency and cost
  • Establish evals as the release gate for every AI system we ship
  • Lead design reviews and resolve the hardest technical trade-offs
  • Stay hands-on: prototype and build critical model, training and inference code yourself
  • Mentor Staff and Senior engineers and shape product and platform investment

The skills and qualities you’ll bring include :

  • 12+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems. A PhD in Computer Science, Machine Learning, AI or a related field is preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributions
  • A track record of building scalable, production-grade AI systems used across multiple teams or products with a strong history of organization-wide impact through technical leadership, mentoring, and shared platforms and standards
  • LLMs from first principles:deep understanding of transformer architecture, attention, tokenization and positional encodings, and how models are trained and served, with the ability to implement core components from scratch
  • PyTorch: expert-level, including custom model code, training loops, mixed precision and distributed training (e.g., FSDP, DeepSpeed)
  • Fine-tuning and post-training:hands-on full and parameter-efficient fine-tuning (LoRA, QLoRA) of open-weight LLMs, distillation, and preference or RL-based methods (e.g., DPO, GRPO)
  • Context engineering: retrieval, memory, and context management for long-running agent workflows
  • Inference optimization: deep knowledge of prefill and decode, KV-cache management (e.g., PagedAttention, prefix caching), continuous batching, speculative decoding, FlashAttention and quantization, and serving at scale with vLLM, SGLang or TensorRT-LLM
  • Evals: defining evaluation strategy and benchmarks for LLM and agent systems
  • Strong predictive AI and classical ML fundamentals, and the judgment to choose between them and LLMs based on accuracy, latency and cost
  • Strong distributed systems and Python fundamentals
  • Takes ownership of significant technical outcomes across multiple teams, proactively identifying and addressing risks, driving complex challenges to resolution and ensuring solutions deliver against agreed technical and customer objectives
  • Strong communicator with the ability to explain technical trade-offs to engineering, product, and leadership audiences
  • Builds strong cross functional partnerships across Engineering, Product, and other teams to align on technical direction and deliver shared outcomes
  • Connects customer needs and business priorities to technical decisions, evaluating the value, cost and trade-offs of AI solutions to ensure investments deliver measurable customer and business outcomes
  • Embody our core values to foster a culture of excellence that drives meaningful impact and collective success

Preferred Skills and Experience:

  • Experience pre-training or training LLMs from scratch
  • Experience writing GPU kernels (CUDA or Triton) and profiling GPU workloads
  • Security domain experience, such as detection engineering, SOC/MDR, or vulnerability management
  • Experience running AI workloads on AWS at scale
  • Publications, patents, or open-source contributions in AI

We know that the best ideas and solutions come from multi-dimensional teams. That’s because these teams reflect a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact, please don’t be shy - apply today.

#LI-CG1 #LI-Remote

About Rapid7

At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what’s possible and drive extraordinary impact. We’re building a dynamic and collaborative workplace where new ideas are welcome.

Protecting 11,500+ customers against bad actors and threats means we’re continuing to push the envelope just like we’ ve been doing for the past 20 years. If you ’re ready to solve some of the toughest challenges in cybersecurity, we’re ready to help you take command of your career. Join us.

Rapid7, Inc. is committed to fair and equitable compensation practices. A candidate’s salary is determined by various factors including, but not limited to, relevant work experience, skills, and certifications. We evaluate compensation decisions on a case-by-case basis, and it is not typical for an individual to be hired at the very top of the salary range.

The annual salary range for this role, depending on location, is:

United States: $221,000.00 - 299,000.00 USD Annual

Salary ranges may vary based on geographical location. This range does not include variable/incentive compensation, equity and benefits (where applicable/eligible).

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or any other status protected by applicable national, federal, state or local law.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal AI Engineer in California vacancy
  •  ...Description About the Role As a Principal AI Engineer at Innovaccer, you will be one of our most senior engineers and you will stay deep in the code. You'll personally design and build the hardest, highest-impact parts of our platform — backend services, data pipelines... 
    Suggested
    Full time
    Temporary work

    Innovaccer

    San Francisco, CA
    4 days ago
  •  ...Principal AI Engineer — Velsera AI Platform & Enablement · Reports to the CTO · Senior individual contributor About the role Velsera builds software and infrastructure for precision medicine — research platforms, clinical and diagnostic applications, and the systems... 
    Suggested
    Shift work

    Velsera

    Mountain View, CA
    2 days ago
  •  ...We are seeking a Principal AI Engineer to design, build, and scale AI‑driven systems across our product platforms. This role is ideal for a deeply technical engineer who leads through hands‑on contribution, solves complex problems, and drives the adoption of AI into real... 
    Suggested

    EdCast

    Mountain View, CA
    4 days ago
  • $175.8k - $293k

     ...Basic Information Job Name Principal Innovator - USA (B) Country United States State California City...  ...a competitive advantage. We’re looking for a Principal AI Engineer to architect, build, and harden the agentic AI systems that power... 
    Suggested

    BMC Software

    Santa Clara, CA
    1 day ago
  • $138k - $234k

    ## Principal AI EngineerApply: Flexible: Atlanta, Georgia, United States of America: Northridge, California, United States of America: Full...  ...AI & Data Science team. We are looking for a Principal AI Engineer to be our senior technical anchor — the person who builds AI capabilities... 
    Suggested
    Full time
    Work at office
    Local area
    Flexible hours

    MiniMed Group

    Los Angeles, CA
    4 days ago
  • $238.2k - $322.2k

     ...Our Engineering organization is scaling its AI Engineering capabilities under new leadership, creating an opportunity to shape the next generation of AI at Rapid7. We’re looking for Senior Principal AI Engineers to define and influence the technical direction of our LLM... 
    Full time
    Work experience placement
    Local area
    Remote work

    Rapid7

    California
    3 days ago
  • $190.4k - $308k

     ...Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment...  ...that drives great outcomes. Job Summary We are hiring AI Engineers at the Principal and Senior Principal levels to join our IT Business... 
    Full time
    Work at office

    PaloAlto Networks

    California
    1 day ago
  •  ...build and manage their workforce through an intelligent, auditable AI platform that spans the entire employee lifecycle. As part of a confidential search, Scovai is seeking a Principal Generative AI Engineer to serve as the technical cornerstone of a rapidly growing AI... 
    Full time

    CONFIDENTIAL Scovai

    San Francisco, CA
    5 days ago
  • $10k

     ...most personal data people share, trust and safety at global scale, AI features shipping into consumer products, and regulation that...  ...traditional legal team role. It's for a tech-forward builder, an engineer or product person, who can find where AI can do legal work that... 
    Full time
    Contract work
    Immediate start
    Worldwide
    Flexible hours
    Shift work
    3 days per week

    Match Group

    West Hollywood, CA
    7 days ago
  • $248k - $391k

     ...Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU...  ...we can make a lasting impact on the world. We are seeking a Principal AI Workflow Engineer to join the Enterprise Integration and API Team, playing a... 
    Full time

    Nvidia

    Santa Clara, CA
    9 days ago
  • $250.44k - $375.67k

     ...and foster a friendly, rewarding, and diverse environment for every OK-er. About the Opportunity We are looking for a  Principal AI Engineer to lead the architecture and deployment of large-scale, LLM-powered conversational Chatbot systems serving both enterprise... 

    OKX

    San Jose, CA
    3 days ago
  • $183.6k - $297k

     ...Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the...  ...largest Google Cloud Platform customers. As a AI Platform Engineer, you will be part of a team building tooling to help manage this... 
    Full time
    Work at office

    PaloAlto Networks

    California
    1 day ago
  • $138k - $234k

     ...with purpose, breaking down barriers to innovation for a more connected, compassionate world. About the Role As Principal AI Data Science Engineer, Go-to-Market Analytics, you will apply statistical modeling, machine learning, and forecasting to customer, market,... 
    Full time
    Work at office
    Local area
    Flexible hours
    Shift work

    Minimed

    Northridge, CA
    2 days ago
  • $270k - $340k

     ...related physical artificial intelligence (“AI”) solutions, and other technologies to...  ...team members. What You’ll Do: As a Principal AI and ML fundamentalist who is an expert...  ...deployment.  Collaborate with other researcher engineers to prototype and validate complex... 
    Local area
    Worldwide
    Visa sponsorship

    Archer

    San Jose, CA
    3 days ago
  • $262.7k - $355.4k

    Job Summary:Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices?We’re looking for an experienced engineer to help customers achieve best-in-class inference performance for production AI models running on Arm... 
    Work at office
    Local area

    ARM

    San Jose, CA
    1 day ago
  • $202.9k - $300.26k

     ...infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is...  ...ecosystem at the intersection of machine learning and hardware engineering — systems that learn from how engineering actually plays out in... 
    Permanent employment
    Full time
    Internship
    Work from home

    Marvell

    Irvine, CA
    2 days ago
  • $261.5k - $353.5k

     ...part of Intuit's Enterprise Accountant Suite community as a Principal Software Engineer and contribute to our mission of powering global prosperity...  ...and final execution. We are dedicated to building AI-native experiences from the ground up, utilizing artificial... 
    Temporary work
    Work experience placement
    Worldwide

    Intuit

    Mountain View, CA
    2 days ago
  • Locations available: San Diego and San Jose, California or Austin, TexasNXP is searching for a hands-on AI Compiler Engineer who thrives at the convergence of cutting-edge AI, compiler tech, and hardware design. Here, you’ll not only architect and scale a production-class... 
    Full time
    Work at office
    Local area

    NXP Semiconductors

    San Jose, CA
    2 days ago
  • $90k - $110k

     ...operations.Design, develop, and operationalize secure agentic AI capabilities in risk & security operationsBuild, deploy, and maintain...  ...), OR equivalent experience leading enterprise-scale security engineering initiatives5+ years of progressive experience in cybersecurity,... 
    Full time

    Axis Capital

    San Francisco, CA
    4 days ago
  • Principal Agentic AI Security EngineerThis role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week...  ...up opportunities with HPE.Job Description:The Agentic AI Engineer is responsible for designing, building, and operating production... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise

    San Jose, CA
    5 days ago
  • $221.2k - $387.1k

     ...Company Description It all started when engineer Fred Luddy wrote code that automated a tedious...  ...work. Today, ServiceNow is the AI control tower for business reinvention. Our...  ...customer service, and field service. As Principal Forward Deployed Engineer, you are the lead... 
    Full time
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    11 days ago
  • $215.25k - $287.91k

     ...Job CategorySalesJob DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success together....  ...is a senior individual-contributor role combining software engineering, applied AI, solution architecture, and storytelling. You will... 
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $130.7k - $261.3k

     ...as the best place to work for diversity, working mothers, female executives, and scientists. THE OPPORTUNITY This Principal AI/ML Engineer position can work out of Alameda, CA location.   As Principal AI/ML Engineer, you will define and build the AI layer... 
    Worldwide

    Abbott

    Alameda, CA
    2 days ago
  • $296.3k - $423.9k

     ...on a global scale.  We are looking for a Principal Technical Lead Manager (TLM) to lead the...  ...Trajectory Generation team within the Embodied AI organization. This role combines deep...  ...You will lead a high-performing team of engineers building ML-driven trajectory generation... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago
  • $230k - $316.25k

     ...breakthroughs at the Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat climate...  ...and X.About the Role We’re looking for Deep Agentic Reasoning Engineer (open rank) to design and build multimodal reasoning models (e.g... 
    Permanent employment
    Full time
    Work at office
    Day shift

    Analog Devices

    San Jose, CA
    5 days ago
  •  ...Candidate Account, please Sign-In before you apply.Job Description:Broadcom’s GTO team is seeking a high-energy, visionary Principal AI Development Engineer to serve as a strategic leader and the primary architect of our AI transformation. In this Level 5 role, you are not... 
    Full time
    Local area

    Broadcom

    San Jose, CA
    1 day ago
  • Job DescriptionPrincipal Consultant - AI Platform & Governance Engineer - Infosys ConsultingInfosys Consulting's Tech Transformation Advisory Practice is seeking a Principal Consultant specializing in AI Platform & Governance EngineerPosition Overview:As a Principal Consultant... 
    Full time
    Temporary work
    Local area

    Infosys Technologies

    Los Angeles, CA
    3 days ago
  • $225k - $245k

    Principal AI/ML Engineer - AI Safety & EvaluationAbout the Team We’re building a future where AI systems are not only powerful but safe, aligned, and robust against misuse. Our team focuses on advancing practical safety techniques for large language models (LLMs) and multimodal... 
    Full time
    For subcontractor
    Local area

    A10 Networks

    San Jose, CA
    2 days ago
  • $230k - $316.25k

     ...breakthroughs at the Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat climate...  ...at and on LinkedIn and X.About the Role We are seeking a Principal AI Engineer in Time-Series & Sensor Foundation Models to advance AI... 
    Permanent employment
    Full time
    Work at office
    Day shift

    Analog Devices

    San Jose, CA
    5 days ago
  • Job DescriptionAdvantest is seeking a Senior Principal AI Test Automation Engineer todesign and deliver reliable automation for complex engineering and productiontest environments.This role combines advanced test engineering, software automation, CI/CD, andAI-enabled workflows... 

    Advantest

    San Jose, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI Engineer. Be the first to apply!