Principal AI Engineer
$221k - $299kRapid7
Our Engineering organisation is scaling its AI Engineering capabilities under new leadership, creating an opportunity to build the next generation of AI at Rapid7. We’re looking for Principal AI Engineers to join us and help shape what comes next by defining and influencing the technical direction of our LLM and agentic AI systems. As a Principal AI Engineer, you’ll raise the bar for engineering standards, and build truly cutting edge greenfield solutions that deliver real impact for our Global customers. Through your technical leadership and mentoring, you’ll help shape our product and platform investments and influence how we build and scale AI across the organisation.
About the Team
AI is reshaping cybersecurity on both sides. Attackers can use AI to strike at machine speed, and only AI-powered defense can keep up. At the same time, organizations can only adopt AI with confidence if it is secure. Rapid7 sits at the intersection of security and AI, and we are building industry-defining products for this new era.
Rapid7's AI Engineering team builds the AI that powers our security platform. We are AI engineers and applied scientists who take models from research to production, combining open-source and frontier LLMs, AI agents, and fast predictive models with more than 20 years of Rapid7 security expertise. Our work drives core use cases across Detection and Response, such as alert triage, threat investigation, and automated response, and Exposure and Remediation, such as vulnerability prioritization, attack surface risk assessment, and guided remediation. Together, these help customers stop threats faster and fix what matters most.
About the Role
As a Principal AI Engineer, you will set the technical direction for how Rapid7 builds, tunes and serves LLMs and agentic systems across its security products. You understand LLMs from the ground up, from transformer internals and training to fine-tuning and inference optimization, and you stay hands-on with the hardest problems. You know where LLMs shine and where they fall short, and you treat them as one tool in the AI toolbox, alongside predictive AI and classical ML, choosing the right approach for each problem. Specifically your focus will be to:
- Define the architecture and technical roadmap for LLM and agentic AI systems across Detection and Response and Exposure and Remediation
- Lead model strategy: when to use frontier or open-source models, and when to fine-tune, distill, or post-train
- Fine-tune, distill and post-train open-source LLMs on security data, from data curation through training, evaluation and deployment
- Set engineering standards for context engineering, inference optimization, and evaluation across teams
- Optimize LLM inference at scale with techniques such as speculative decoding, KV-cache management, continuous batching, quantization and custom kernels, balancing quality, latency and cost
- Establish evals as the release gate for every AI system we ship
- Lead design reviews and resolve the hardest technical trade-offs
- Stay hands-on: prototype and build critical model, training and inference code yourself
- Mentor Staff and Senior engineers and shape product and platform investment
The skills and qualities you’ll bring include :
- 12+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems. A PhD in Computer Science, Machine Learning, AI or a related field is preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributions
- A track record of building scalable, production-grade AI systems used across multiple teams or products with a strong history of organization-wide impact through technical leadership, mentoring, and shared platforms and standards
- LLMs from first principles:deep understanding of transformer architecture, attention, tokenization and positional encodings, and how models are trained and served, with the ability to implement core components from scratch
- PyTorch: expert-level, including custom model code, training loops, mixed precision and distributed training (e.g., FSDP, DeepSpeed)
- Fine-tuning and post-training:hands-on full and parameter-efficient fine-tuning (LoRA, QLoRA) of open-weight LLMs, distillation, and preference or RL-based methods (e.g., DPO, GRPO)
- Context engineering: retrieval, memory, and context management for long-running agent workflows
- Inference optimization: deep knowledge of prefill and decode, KV-cache management (e.g., PagedAttention, prefix caching), continuous batching, speculative decoding, FlashAttention and quantization, and serving at scale with vLLM, SGLang or TensorRT-LLM
- Evals: defining evaluation strategy and benchmarks for LLM and agent systems
- Strong predictive AI and classical ML fundamentals, and the judgment to choose between them and LLMs based on accuracy, latency and cost
- Strong distributed systems and Python fundamentals
- Takes ownership of significant technical outcomes across multiple teams, proactively identifying and addressing risks, driving complex challenges to resolution and ensuring solutions deliver against agreed technical and customer objectives
- Strong communicator with the ability to explain technical trade-offs to engineering, product, and leadership audiences
- Builds strong cross functional partnerships across Engineering, Product, and other teams to align on technical direction and deliver shared outcomes
- Connects customer needs and business priorities to technical decisions, evaluating the value, cost and trade-offs of AI solutions to ensure investments deliver measurable customer and business outcomes
- Embody our core values to foster a culture of excellence that drives meaningful impact and collective success
Preferred Skills and Experience:
- Experience pre-training or training LLMs from scratch
- Experience writing GPU kernels (CUDA or Triton) and profiling GPU workloads
- Security domain experience, such as detection engineering, SOC/MDR, or vulnerability management
- Experience running AI workloads on AWS at scale
- Publications, patents, or open-source contributions in AI
We know that the best ideas and solutions come from multi-dimensional teams. That’s because these teams reflect a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact, please don’t be shy - apply today.
About Rapid7
At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what’s possible and drive extraordinary impact. We’re building a dynamic and collaborative workplace where new ideas are welcome.
Protecting 11,500+ customers against bad actors and threats means we’re continuing to push the envelope just like we’ ve been doing for the past 20 years. If you ’re ready to solve some of the toughest challenges in cybersecurity, we’re ready to help you take command of your career. Join us.
Rapid7, Inc. is committed to fair and equitable compensation practices. A candidate’s salary is determined by various factors including, but not limited to, relevant work experience, skills, and certifications. We evaluate compensation decisions on a case-by-case basis, and it is not typical for an individual to be hired at the very top of the salary range.
The annual salary range for this role, depending on location, is:
United States: $221,000.00 - 299,000.00 USD AnnualSalary ranges may vary based on geographical location. This range does not include variable/incentive compensation, equity and benefits (where applicable/eligible).
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or any other status protected by applicable national, federal, state or local law.
- ...Job Description Job Description Principal AI Engineer Summary: Design and advance AI models and system innovations in close collaboration with cross-functional teams, including Product Management, Software Engineering, and Pre-Sales—to ensure high-quality performance...SuggestedFull timeWork at office
$238.2k - $322.2k
...Our Engineering organization is scaling its AI Engineering capabilities under new leadership, creating an opportunity to shape the next generation of AI at Rapid7. We’re looking for Senior Principal AI Engineers to define and influence the technical direction of our LLM...SuggestedFull timeWork experience placementLocal areaRemote work$190.4k - $308k
...Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment... ...that drives great outcomes. Job Summary We are hiring AI Engineers at the Principal and Senior Principal levels to join our IT Business...SuggestedFull timeWork at office$248k - $391k
...Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU... ...we can make a lasting impact on the world. We are seeking a Principal AI Workflow Engineer to join the Enterprise Integration and API Team, playing a...SuggestedFull time$10k
...most personal data people share, trust and safety at global scale, AI features shipping into consumer products, and regulation that... ...traditional legal team role. It's for a tech-forward builder, an engineer or product person, who can find where AI can do legal work that...SuggestedFull timeContract workImmediate startWorldwideFlexible hoursShift work3 days per week- ...build and manage their workforce through an intelligent, auditable AI platform that spans the entire employee lifecycle. As part of a confidential search, Scovai is seeking a Principal Generative AI Engineer to serve as the technical cornerstone of a rapidly growing AI...Full time
$130.7k - $261.3k
...the best place to work for diversity, working mothers, female executives, and scientists. THE OPPORTUNITY This Principal AI/ML Engineer position can work out of Alameda, CA location. As Principal AI/ML Engineer, you will define and build the AI layer...Full timeWorldwide$183.6k - $297k
...Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the... ...largest Google Cloud Platform customers. As a AI Platform Engineer, you will be part of a team building tooling to help manage this...Full timeWork at office- ...Job Description Job Description About the Role As a Principal AI Engineer at Innovaccer, you will be one of our most senior engineers and you will stay deep in the code. You'll personally design and build the hardest, highest-impact parts of our platform — backend...Temporary work
$202.9k - $300.26k
...infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is... ...ecosystem at the intersection of machine learning and hardware engineering — systems that learn from how engineering actually plays out in...Permanent employmentFull timeInternshipWork from home- DescriptionAbout the RoleAs a Principal AI Engineer at Innovaccer, you will be one of our most senior engineers and you will stay deep in the code. You'll personally design and build the hardest, highest-impact parts of our platform — backend services, data pipelines, and...Full timeTemporary work
$221.2k - $387.1k
...Company Description It all started when engineer Fred Luddy wrote code that automated a tedious... ...work. Today, ServiceNow is the AI control tower for business reinvention. Our... ...customer service, and field service. As Principal Forward Deployed Engineer, you are the lead...Full timeWork at officeImmediate startRemote workFlexible hours$262.7k - $355.4k
Job Summary:Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices?We’re looking for an experienced engineer to help customers achieve best-in-class inference performance for production AI models running on Arm...Work at officeLocal area- Locations available: San Diego and San Jose, California or Austin, TexasNXP is searching for a hands-on AI Compiler Engineer who thrives at the convergence of cutting-edge AI, compiler tech, and hardware design. Here, you’ll not only architect and scale a production-class...Full timeWork at officeLocal area
$261.5k - $353.5k
...part of Intuit's Enterprise Accountant Suite community as a Principal Software Engineer and contribute to our mission of powering global prosperity... ...and final execution. We are dedicated to building AI-native experiences from the ground up, utilizing artificial...Temporary workWork experience placementWorldwide$90k - $110k
...operations.Design, develop, and operationalize secure agentic AI capabilities in risk & security operationsBuild, deploy, and maintain... ...), OR equivalent experience leading enterprise-scale security engineering initiatives5+ years of progressive experience in cybersecurity,...Full time- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver... ...high-speed inference.About the RoleCerebras is seeking a Principal AI Security Engineer to lead hands-on security engineering for enterprise IT,...
- Principal Agentic AI Security EngineerThis role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week... ...up opportunities with HPE.Job Description:The Agentic AI Engineer is responsible for designing, building, and operating production...Full timeWork experience placementWork at officeLocal areaImmediate start2 days per week
$270k - $340k
...related physical artificial intelligence (“AI”) solutions, and other technologies to... ...of our team members.What You’ll Do:As a Principal AI and ML fundamentalist who is an expert... ...deployment. Collaborate with other researcher engineers to prototype and validate complex...Local areaWorldwideVisa sponsorship$296.3k - $423.9k
...on a global scale. We are looking for a Principal Technical Lead Manager (TLM) to lead the... ...Trajectory Generation team within the Embodied AI organization. This role combines deep... ...You will lead a high-performing team of engineers building ML-driven trajectory generation...Full timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$215.25k - $287.91k
...Job CategorySalesJob DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success together.... ...is a senior individual-contributor role combining software engineering, applied AI, solution architecture, and storytelling. You will...Full time- ...Candidate Account, please Sign-In before you apply.Job Description:Broadcom’s GTO team is seeking a high-energy, visionary Principal AI Development Engineer to serve as a strategic leader and the primary architect of our AI transformation. In this Level 5 role, you are not...Full timeLocal area
$260.36k - $358k
...breakthroughs at the Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat climate... ...and X.About the Role We’re looking for Deep Agentic Reasoning Engineer (open rank) to design and build multimodal reasoning models (e.g...Permanent employmentFull timeWork at officeDay shift$250.44k - $375.67k
...processes, and foster a friendly, rewarding, and diverse environment for every OK-er.About the OpportunityWe are looking for a Principal AI Engineer to lead the architecture and deployment of large-scale, LLM-powered conversational Chatbot systems serving both enterprise...$345.04k - $399.42k
...helping to create safer, more civil shared experiences for everyone.As a Principal Software Engineer on the Build Platform team, you will set the technical direction for the infrastructure behind AI-powered creation on Roblox. Build lets anyone make a game by describing...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday$225k - $245k
Principal AI/ML Engineer - AI Safety & EvaluationAbout the Team We’re building a future where AI systems are not only powerful but safe, aligned, and robust against misuse. Our team focuses on advancing practical safety techniques for large language models (LLMs) and multimodal...Full timeFor subcontractorLocal area- ...Head of Applied AI Engineering About the Company Profitable AI platform turning healthcare data into measurable enterprise action Industry Computer Software Type Privately Held, VC-backed About the Role The Company is seeking a Head of Applied...
- Job DescriptionPrincipal Consultant - AI Platform & Governance Engineer - Infosys ConsultingInfosys Consulting's Tech Transformation Advisory Practice is seeking a Principal Consultant specializing in AI Platform & Governance EngineerPosition Overview:As a Principal Consultant...Full timeTemporary workLocal area
- ...Introduction Join the pioneering AI Foundations Research team at IBM Research and contribute to shaping the future foundations of artificial intelligence. Our group of scientists, engineers, and designers is dedicated to conducting end-to-end research that delivers real...Full timeContract workPart timeFixed term contractInternshipShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal AI Engineer. Be the first to apply!
- senior chief engineer California
- principal data engineer California
- principal infrastructure engineer California
- senior civil engineer project manager California
- principal cloud engineer California
- principal network engineer California
- principal engineer California
- data center chief engineer California
- senior director engineering California
- chief engineer California






