Principal AI Engineer
$221k - $299kRapid7
Our Engineering organisation is scaling its AI Engineering capabilities under new leadership, creating an opportunity to build the next generation of AI at Rapid7. We’re looking for Principal AI Engineers to join us and help shape what comes next by defining and influencing the technical direction of our LLM and agentic AI systems. As a Principal AI Engineer, you’ll raise the bar for engineering standards, and build truly cutting edge greenfield solutions that deliver real impact for our Global customers. Through your technical leadership and mentoring, you’ll help shape our product and platform investments and influence how we build and scale AI across the organisation.
About the Team
AI is reshaping cybersecurity on both sides. Attackers can use AI to strike at machine speed, and only AI-powered defense can keep up. At the same time, organizations can only adopt AI with confidence if it is secure. Rapid7 sits at the intersection of security and AI, and we are building industry-defining products for this new era.
Rapid7's AI Engineering team builds the AI that powers our security platform. We are AI engineers and applied scientists who take models from research to production, combining open-source and frontier LLMs, AI agents, and fast predictive models with more than 20 years of Rapid7 security expertise. Our work drives core use cases across Detection and Response, such as alert triage, threat investigation, and automated response, and Exposure and Remediation, such as vulnerability prioritization, attack surface risk assessment, and guided remediation. Together, these help customers stop threats faster and fix what matters most.
About the Role
As a Principal AI Engineer, you will set the technical direction for how Rapid7 builds, tunes and serves LLMs and agentic systems across its security products. You understand LLMs from the ground up, from transformer internals and training to fine-tuning and inference optimization, and you stay hands-on with the hardest problems. You know where LLMs shine and where they fall short, and you treat them as one tool in the AI toolbox, alongside predictive AI and classical ML, choosing the right approach for each problem. Specifically your focus will be to:
- Define the architecture and technical roadmap for LLM and agentic AI systems across Detection and Response and Exposure and Remediation
- Lead model strategy: when to use frontier or open-source models, and when to fine-tune, distill, or post-train
- Fine-tune, distill and post-train open-source LLMs on security data, from data curation through training, evaluation and deployment
- Set engineering standards for context engineering, inference optimization, and evaluation across teams
- Optimize LLM inference at scale with techniques such as speculative decoding, KV-cache management, continuous batching, quantization and custom kernels, balancing quality, latency and cost
- Establish evals as the release gate for every AI system we ship
- Lead design reviews and resolve the hardest technical trade-offs
- Stay hands-on: prototype and build critical model, training and inference code yourself
- Mentor Staff and Senior engineers and shape product and platform investment
The skills and qualities you’ll bring include :
- 12+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems. A PhD in Computer Science, Machine Learning, AI or a related field is preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributions
- A track record of building scalable, production-grade AI systems used across multiple teams or products with a strong history of organization-wide impact through technical leadership, mentoring, and shared platforms and standards
- LLMs from first principles:deep understanding of transformer architecture, attention, tokenization and positional encodings, and how models are trained and served, with the ability to implement core components from scratch
- PyTorch: expert-level, including custom model code, training loops, mixed precision and distributed training (e.g., FSDP, DeepSpeed)
- Fine-tuning and post-training:hands-on full and parameter-efficient fine-tuning (LoRA, QLoRA) of open-weight LLMs, distillation, and preference or RL-based methods (e.g., DPO, GRPO)
- Context engineering: retrieval, memory, and context management for long-running agent workflows
- Inference optimization: deep knowledge of prefill and decode, KV-cache management (e.g., PagedAttention, prefix caching), continuous batching, speculative decoding, FlashAttention and quantization, and serving at scale with vLLM, SGLang or TensorRT-LLM
- Evals: defining evaluation strategy and benchmarks for LLM and agent systems
- Strong predictive AI and classical ML fundamentals, and the judgment to choose between them and LLMs based on accuracy, latency and cost
- Strong distributed systems and Python fundamentals
- Takes ownership of significant technical outcomes across multiple teams, proactively identifying and addressing risks, driving complex challenges to resolution and ensuring solutions deliver against agreed technical and customer objectives
- Strong communicator with the ability to explain technical trade-offs to engineering, product, and leadership audiences
- Builds strong cross functional partnerships across Engineering, Product, and other teams to align on technical direction and deliver shared outcomes
- Connects customer needs and business priorities to technical decisions, evaluating the value, cost and trade-offs of AI solutions to ensure investments deliver measurable customer and business outcomes
- Embody our core values to foster a culture of excellence that drives meaningful impact and collective success
Preferred Skills and Experience:
- Experience pre-training or training LLMs from scratch
- Experience writing GPU kernels (CUDA or Triton) and profiling GPU workloads
- Security domain experience, such as detection engineering, SOC/MDR, or vulnerability management
- Experience running AI workloads on AWS at scale
- Publications, patents, or open-source contributions in AI
We know that the best ideas and solutions come from multi-dimensional teams. That’s because these teams reflect a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact, please don’t be shy - apply today.
About Rapid7
At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what’s possible and drive extraordinary impact. We’re building a dynamic and collaborative workplace where new ideas are welcome.
Protecting 11,500+ customers against bad actors and threats means we’re continuing to push the envelope just like we’ ve been doing for the past 20 years. If you ’re ready to solve some of the toughest challenges in cybersecurity, we’re ready to help you take command of your career. Join us.
Rapid7, Inc. is committed to fair and equitable compensation practices. A candidate’s salary is determined by various factors including, but not limited to, relevant work experience, skills, and certifications. We evaluate compensation decisions on a case-by-case basis, and it is not typical for an individual to be hired at the very top of the salary range.
The annual salary range for this role, depending on location, is:
United States: $221,000.00 - 299,000.00 USD AnnualSalary ranges may vary based on geographical location. This range does not include variable/incentive compensation, equity and benefits (where applicable/eligible).
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or any other status protected by applicable national, federal, state or local law.
- ...Description About the Role As a Principal AI Engineer at Innovaccer, you will be one of our most senior engineers and you will stay deep in the code. You'll personally design and build the hardest, highest-impact parts of our platform — backend services, data pipelines...SuggestedFull timeTemporary work
- ...Principal AI Engineer — Velsera AI Platform & Enablement · Reports to the CTO · Senior individual contributor About the role Velsera builds software and infrastructure for precision medicine — research platforms, clinical and diagnostic applications, and the systems...SuggestedShift work
- ...We are seeking a Principal AI Engineer to design, build, and scale AI‑driven systems across our product platforms. This role is ideal for a deeply technical engineer who leads through hands‑on contribution, solves complex problems, and drives the adoption of AI into real...Suggested
$175.8k - $293k
...Basic Information Job Name Principal Innovator - USA (B) Country United States State California City... ...a competitive advantage. We’re looking for a Principal AI Engineer to architect, build, and harden the agentic AI systems that power...Suggested$138k - $234k
## Principal AI EngineerApply: Flexible: Atlanta, Georgia, United States of America: Northridge, California, United States of America: Full... ...AI & Data Science team. We are looking for a Principal AI Engineer to be our senior technical anchor — the person who builds AI capabilities...SuggestedFull timeWork at officeLocal areaFlexible hours$238.2k - $322.2k
...Our Engineering organization is scaling its AI Engineering capabilities under new leadership, creating an opportunity to shape the next generation of AI at Rapid7. We’re looking for Senior Principal AI Engineers to define and influence the technical direction of our LLM...Full timeWork experience placementLocal areaRemote work$190.4k - $308k
...Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment... ...that drives great outcomes. Job Summary We are hiring AI Engineers at the Principal and Senior Principal levels to join our IT Business...Full timeWork at office- ...build and manage their workforce through an intelligent, auditable AI platform that spans the entire employee lifecycle. As part of a confidential search, Scovai is seeking a Principal Generative AI Engineer to serve as the technical cornerstone of a rapidly growing AI...Full time
$10k
...most personal data people share, trust and safety at global scale, AI features shipping into consumer products, and regulation that... ...traditional legal team role. It's for a tech-forward builder, an engineer or product person, who can find where AI can do legal work that...Full timeContract workImmediate startWorldwideFlexible hoursShift work3 days per week$248k - $391k
...Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU... ...we can make a lasting impact on the world. We are seeking a Principal AI Workflow Engineer to join the Enterprise Integration and API Team, playing a...Full time$250.44k - $375.67k
...and foster a friendly, rewarding, and diverse environment for every OK-er. About the Opportunity We are looking for a Principal AI Engineer to lead the architecture and deployment of large-scale, LLM-powered conversational Chatbot systems serving both enterprise...$183.6k - $297k
...Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the... ...largest Google Cloud Platform customers. As a AI Platform Engineer, you will be part of a team building tooling to help manage this...Full timeWork at office$138k - $234k
...with purpose, breaking down barriers to innovation for a more connected, compassionate world. About the Role As Principal AI Data Science Engineer, Go-to-Market Analytics, you will apply statistical modeling, machine learning, and forecasting to customer, market,...Full timeWork at officeLocal areaFlexible hoursShift work$270k - $340k
...related physical artificial intelligence (“AI”) solutions, and other technologies to... ...team members. What You’ll Do: As a Principal AI and ML fundamentalist who is an expert... ...deployment. Collaborate with other researcher engineers to prototype and validate complex...Local areaWorldwideVisa sponsorship$262.7k - $355.4k
Job Summary:Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices?We’re looking for an experienced engineer to help customers achieve best-in-class inference performance for production AI models running on Arm...Work at officeLocal area$202.9k - $300.26k
...infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is... ...ecosystem at the intersection of machine learning and hardware engineering — systems that learn from how engineering actually plays out in...Permanent employmentFull timeInternshipWork from home$261.5k - $353.5k
...part of Intuit's Enterprise Accountant Suite community as a Principal Software Engineer and contribute to our mission of powering global prosperity... ...and final execution. We are dedicated to building AI-native experiences from the ground up, utilizing artificial...Temporary workWork experience placementWorldwide- Locations available: San Diego and San Jose, California or Austin, TexasNXP is searching for a hands-on AI Compiler Engineer who thrives at the convergence of cutting-edge AI, compiler tech, and hardware design. Here, you’ll not only architect and scale a production-class...Full timeWork at officeLocal area
$90k - $110k
...operations.Design, develop, and operationalize secure agentic AI capabilities in risk & security operationsBuild, deploy, and maintain... ...), OR equivalent experience leading enterprise-scale security engineering initiatives5+ years of progressive experience in cybersecurity,...Full time- Principal Agentic AI Security EngineerThis role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week... ...up opportunities with HPE.Job Description:The Agentic AI Engineer is responsible for designing, building, and operating production...Full timeWork experience placementWork at officeLocal areaImmediate start2 days per week
$221.2k - $387.1k
...Company Description It all started when engineer Fred Luddy wrote code that automated a tedious... ...work. Today, ServiceNow is the AI control tower for business reinvention. Our... ...customer service, and field service. As Principal Forward Deployed Engineer, you are the lead...Full timeWork at officeImmediate startRemote workFlexible hours$215.25k - $287.91k
...Job CategorySalesJob DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success together.... ...is a senior individual-contributor role combining software engineering, applied AI, solution architecture, and storytelling. You will...Full time$130.7k - $261.3k
...as the best place to work for diversity, working mothers, female executives, and scientists. THE OPPORTUNITY This Principal AI/ML Engineer position can work out of Alameda, CA location. As Principal AI/ML Engineer, you will define and build the AI layer...Worldwide$296.3k - $423.9k
...on a global scale. We are looking for a Principal Technical Lead Manager (TLM) to lead the... ...Trajectory Generation team within the Embodied AI organization. This role combines deep... ...You will lead a high-performing team of engineers building ML-driven trajectory generation...Full timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$230k - $316.25k
...breakthroughs at the Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat climate... ...and X.About the Role We’re looking for Deep Agentic Reasoning Engineer (open rank) to design and build multimodal reasoning models (e.g...Permanent employmentFull timeWork at officeDay shift- ...Candidate Account, please Sign-In before you apply.Job Description:Broadcom’s GTO team is seeking a high-energy, visionary Principal AI Development Engineer to serve as a strategic leader and the primary architect of our AI transformation. In this Level 5 role, you are not...Full timeLocal area
- Job DescriptionPrincipal Consultant - AI Platform & Governance Engineer - Infosys ConsultingInfosys Consulting's Tech Transformation Advisory Practice is seeking a Principal Consultant specializing in AI Platform & Governance EngineerPosition Overview:As a Principal Consultant...Full timeTemporary workLocal area
$225k - $245k
Principal AI/ML Engineer - AI Safety & EvaluationAbout the Team We’re building a future where AI systems are not only powerful but safe, aligned, and robust against misuse. Our team focuses on advancing practical safety techniques for large language models (LLMs) and multimodal...Full timeFor subcontractorLocal area$230k - $316.25k
...breakthroughs at the Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat climate... ...at and on LinkedIn and X.About the Role We are seeking a Principal AI Engineer in Time-Series & Sensor Foundation Models to advance AI...Permanent employmentFull timeWork at officeDay shift- Job DescriptionAdvantest is seeking a Senior Principal AI Test Automation Engineer todesign and deliver reliable automation for complex engineering and productiontest environments.This role combines advanced test engineering, software automation, CI/CD, andAI-enabled workflows...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal AI Engineer. Be the first to apply!
- principal cloud engineer California
- senior civil engineer project manager California
- principal developer California
- principal data engineer California
- principal engineer California
- director data engineering California
- hotel chief engineer California
- general engineer California
- senior chief engineer California
- data center chief engineer California



