Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Principal AI Engineer

$255.9k - $346.2k

Rapid7

Senior Principal AI Engineer Our Engineering organization is scaling its AI Engineering capabilities under new leadership, creating an opportunity to shape the next generation of AI at Rapid7. We're looking for Senior Principal AI Engineers to define and influence the technical direction of our LLM and agentic AI systems across the organization. You'll tackle our most complex technical challenges, establish architectural principles and engineering standards, and drive greenfield innovation that delivers meaningful impact for our global customers. Through technical leadership and mentoring, you'll shape strategic product and platform investments and influence how we build and scale AI across Rapid7. About the Team: AI is reshaping cybersecurity on both sides. Attackers can use AI to strike at machine speed, and only AI-powered defense can keep up. At the same time, organizations can only adopt AI with confidence if it is secure. Rapid7 sits at the intersection of security and AI, and we are building industry-defining products for this new era. Rapid7's AI Engineering team builds the AI that powers our security platform. We are AI engineers and applied scientists who take models from research to production, combining open-source and frontier LLMs, AI agents, and fast predictive models with more than 20 years of Rapid7 security expertise. Our work drives core use cases across Detection and Response, such as alert triage, threat investigation, and automated response, and Exposure and Remediation, such as vulnerability prioritization, attack surface risk assessment, and guided remediation. Together, these help customers stop threats faster and fix what matters most. About the Role: As a Senior Principal AI Engineer, you will set the technical direction for how Rapid7 builds, tunes and serves LLMs and agentic systems across its security products. You understand LLMs from the ground up, from transformer internals and training to fine-tuning and inference optimization, and you stay hands-on with the hardest problems. You know where LLMs shine and where they fall short, and you treat them as one tool in the AI toolbox, alongside predictive AI and classical ML, choosing the right approach for each problem. Specifically your focus will be to: Set the AI technical vision, architecture and multi-year roadmap for LLM and agentic systems across Detection and Response and Exposure and Remediation Define company-wide model strategy, including when to use frontier or open-source models, when to fine-tune, distill or post-train, and where to invest in new capabilities Lead the most complex and highest-risk technical initiatives across multiple teams, including fine-tuning, distillation and post-training of open-source LLMs on security data Establish company-wide standards for context engineering, inference optimization and evaluation, with evals as the release gate for every AI system we ship Lead optimization of LLM inference at scale, balancing quality, latency and cost Lead design reviews, resolve the most complex technical trade-offs, and stay hands-on by prototyping and building critical model, training and inference code Mentor and develop Principal, Staff and Senior engineers, building the depth of AI engineering talent across Rapid7 Represent Rapid7's AI engineering to executives, customers and the external community, influencing product, platform and business strategy The skills and qualities you'll bring include: 14+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems A PhD in Computer Science, Machine Learning, AI or a related field is preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributions A track record of building scalable, production-grade AI systems and shared platforms adopted across multiple products, with company-wide impact through technical leadership, mentoring and standards Leading-edge expertise in LLMs, including transformer architecture, attention, tokenization and positional encodings, and how models are trained and served, with advanced PyTorch skills spanning custom model code, mixed precision and distributed training (e.g., FSDP, DeepSpeed) Hands-on fine-tuning and post-training of open-weight LLMs, including full and parameter-efficient methods (LoRA, QLoRA), distillation, and preference or RL-based methods (e.g., DPO, GRPO), ideally including experience training LLMs from scratch Deep experience with context engineering (retrieval, memory, and context management for long-running agent workflows) and with defining evaluation strategy and benchmarks for LLM and agent systems Deep knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding and quantization, and serving at scale with vLLM, SGLang or TensorRT-LLM, ideally on AWS and including GPU kernel work (CUDA or Triton) Strong predictive AI, classical ML, distributed systems and Python fundamentals, with the judgment to make efficient, transparent decisions between these approaches and LLMs based on accuracy, latency and cost Takes accountability for organization-wide technical outcomes, proactively addressing systemic risks and removing barriers to delivery while ensuring technical decisions align with strategic priorities An influential communicator who can articulate complex architectural trade-offs, build consensus and influence technical and product decisions across the organization Builds alignment across Engineering, Product and other functions on technical direction, driving decisions that shape product and platform investments. Anticipates evolving customer needs and shapes AI architecture and technical strategy to maximize customer value, making informed trade-offs between capability, performance, cost and scalability to guide product and platform investment Thrives in ambiguity at the leading edge of AI, driving change and focusing forward as the technology and the threat landscape evolve Recognition as an expert in AI, evidenced by publications, patents, open-source contributions or industry engagement Embodies our core values to foster a culture of excellence that drives meaningful impact and collective success We know that the best ideas and solutions come from multi-dimensional teams. That's because these teams reflect a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact, please don't be shy - apply today. About Rapid7: At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what's possible and drive extraordinary impact. We're building a dynamic and collaborative workplace where new ideas are welcome. Protecting 11,500+ customers against bad actors and threats means we're continuing to push the envelope just like we've been doing for the past 20 years. If you're ready to solve some of the toughest challenges in cybersecurity, we're ready to help you take command of your career. Join us. Rapid7, Inc. is committed to fair and equitable compensation practices. A candidate's salary is determined by various factors including, but not limited to, relevant work experience, skills, and certifications. We evaluate compensation decisions on a case-by-case basis, and it is not typical for an individual to be hired at the very top of the salary range. The annual salary range for this role, depending on location, is: United States: $255,900.00 - 346,200.00 USD Annual Salary ranges may vary based on geographical location. This range does not include variable/incentive compensation, equity and benefits (where applicable/eligible). All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or any other status protected by applicable national, federal, state or local law. Rapid7 is creating a more secure digital future for all by helping organizations strengthen their security programs in the face of accelerating digital transformation. Our portfolio of best-in-class solutions empowers security professionals to manage risk and eliminate threats across the entire threat landscape from apps to the cloud to traditional infrastructure to the dark web. We foster open source communities and cutting-edge research–using these insights to optimize our products and arm the global security community with the latest in attacker methodology. Trusted by more than 11,000 customers worldwide, our industry-leading solutions and services help businesses stay ahead of attackers, ahead of the competition, and future-ready for what's next. Rapid7

Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Senior Principal AI Engineer in New York, NY vacancy
  •  ...0 countries, and we believe that scaling AI responsibly is what makes it durable. Technology...  ...of deep industry knowledge, applied AI engineering, and trusted AI governance. We help the...  ...teams.You Are:You are a Responsible AI Senior Manager who makes trustworthy AI real by... 
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    1 day ago
  • $293.5k

    General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work Areas Analytics, Data & Research, Management Consulting, Technology & Engineering Employment Type Permanent Full-Time Location(s) Atlanta, Austin, Boston... 
    Senior
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    New York, NY
    1 day ago
  • $190k - $230k

    OVERVIEWThe Senior Manager, Applied AI Engineering will play a key leadership role in establishing and growing the Firm's Applied AI Engineering function. This position offers an opportunity to help shape how Cravath develops and deploys innovative AI solutions that enhance... 
    Senior
    Work at office

    Cravath Swaine & Moore

    New York, NY
    5 days ago
  • $254k - $407k

     ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Principal AI Engineer- AI Center of Excellence Our Purpose: Mastercard powers economies and empowers people in 200+ countries and territories... 
    Senior
    Full time
    Part time
    Remote work
    Worldwide
    Flexible hours

    Mastercard

    New York, NY
    8 days ago
  •  ...brands turn customer interactions into an engine for growth, moving service beyond a cost center...  ...relationship with their customers.Service AI & Data puts AI at the heart of this work....  ...team leader with deep experience managing senior stakeholder relationships. You will need... 
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    1 day ago
  • $132.5k - $366.3k

     ...technology and intelligence. Visit us at: About the RoleWe are building out practitioners within our Song - Sales practice: AI Forward Deployed Engineers who embed directly with clients to design, prototype, and deploy Agentic AI solutions that transform how our clients... 
    Senior
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    1 day ago
  •  ...50000We’re seeking a future team member for the role of Senior Director, Full-Stack Engineering to join our Data Solutions & Services team. This role is...  ...and quality assurance practices.Architect and implement AI-powered solutions utilizing Large Language Models (LLMs)... 
    Senior
    Full time
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    4 days ago
  • $124k - $280k

     ...LevelSenior ManagerJob Description & SummaryThe OpportunityAs an AI Engineering Lead, you will play a pivotal role in transforming raw data...  ...to design and develop robust data solutions for clients. As a Senior Manager, you will apply your skills and professional network to... 
    Senior
    Full time
    H1b

    PwC

    New York, NY
    1 day ago
  •  ...brands turn customer interactions into an engine for growth, moving service beyond a cost center...  ...relationship with their customers.Service AI & Data puts AI at the heart of this work....  ...team leader with deep experience managing senior stakeholder relationships. You will need... 
    Senior
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    New York, NY
    1 day ago
  • Senior Director, Java Full-Stack Engineer - AI Hub Engineering We're seeking a future team member for the role of Senior Director, Java Full-Stack Engineering to join our Data Solutions & Services team. This role is located in New York, NY or Pittsburgh, PA. In this role... 
    Senior

    BNY

    New York, NY
    3 days ago
  •  ...Job Description *About the Role *This role is part of Intelligent Operations team: "We support and guardrail AI forward deployed engineering engagements across SAP industries, ensuring quality, security and lasting impact." What you'll build You're building Intelligent... 
    Permanent employment
    Full time
    Flexible hours

    SAP

    New York, NY
    2 days ago
  • $200k - $225k

     ...JOB TITLE: AI Principal Engineer REPORTS TO: Engineering & Product Leadership, Silverside.AI Role Type: Full-time hybrid; contract-to-...  ...and agentic workflows. The ideal candidate is a strong senior technical individual contributor, roughly 4–7 years of professional... 
    Full time
    Contract work
    Temporary work
    For contractors
    Work at office

    SILVERSIDE

    New York, NY
    11 days ago
  •  ...AppGate safeguards Fortune 500 enterprises worldwide. Learn more at appgate.com.    About the Role We're looking for a senior AI/ML Engineer who will design, build, and operationalize the detection algorithms, ML inference pipelines, and risk aggregation systems... 
    Senior
    For contractors
    Worldwide

    AppGate Cybersecurity, Inc.

    New York, NY
    14 days ago
  • $112.7k - $193.2k

    Senior Manager Of Software Engineering Optum Tech is a global leader in health care innovation. Our teams develop cutting-edge solutions that help people...  ...work better for everyone. From advanced data analytics and AI to cybersecurity, we use innovative approaches to solve... 
    Senior
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    Reliant Medical Group

    New York, NY
    3 days ago
  • $165k

    03rd November, 2026 Our client in NYC is seeking a Senior Data & AI Architect & Engineering Manager to join their team! This is a hybrid/full-time/direct-hire position Salary range based on experience: Starting at $165K Mission Lead the Data and AI architecture and... 
    Senior
    Full time

    JMS Technical Solutions

    New York, NY
    3 days ago
  •  ...Role Overview We are looking for a highly experienced Senior Backend AI Engineer – Agentic AI to design, develop, and scale distributed backend systems and production-grade Agentic AI solutions. The ideal candidate will have strong expertise in Node.js, TypeScript... 
    Senior
    Full time

    Neshent Technologies

    New York, NY
    13 days ago
  • $286.2k - $326.7k

     ...Sr. Director, AI Engineer (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences... 
    Senior
    Full time
    Part time
    Work at office
    Local area
    Remote work
    Shift work

    Capital One

    New York, NY
    2 days ago
  • $275k - $350k

     ...experiences, and perspectives can build careers within this exciting and growing industry.Job DescriptionOverviewThe Principal AI Engineer is a senior technical leader within the central AI Engineering function, sitting at the heart of a hub-and-spoke Data & AI organization... 
    Full time
    Temporary work
    Work experience placement
    Flexible hours

    Ares Management

    New York, NY
    4 days ago
  •  ...Hybrid - 3 days per week Technology, Data, AI and Ventures:Within the Tech, Data, AI,...  ...built to last.Role OverviewAs a Principal AI Engineer within the Artificial Intelligence & Data...  ...AI&D) organization, you will serve as a senior technical leader responsible for designing... 
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    1 day ago
  • $206.6k - $284.3k

     ...today about how it will leverage AI over the next decade. Few...  ...its viability through hands-on engineering. This role requires both.We...  ...healthcare outcomes for members.As a Principal AI Applied Engineer, you will...  ...teams.Mentor Lead Engineers, Senior Engineers, and emerging... 
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Relocation
    3 days per week

    Humana

    New York, NY
    4 days ago
  •  ...Senior AI Engineer – Talent Management New York City – Onsite 3 days per week *Must be US Citizen or Green Card holder to apply, no Contract or C2C arrangements are available for this opportunity* Position Summary This role is available with one of the most... 
    Senior
    Full time
    Contract work
    3 days per week

    1872 Consulting

    New York, NY
    5 days ago
  •  ...is not available for this position. About the Role The Principal AI Engineer sits at the intersection of software engineering, data...  ...architecture, and engineering practices — regularly consulted by senior stakeholders at the design and strategy stages. Bridge technical... 
    Full time
    Work at office
    Remote work
    Relocation package

    Phizenix

    New York, NY
    more than 2 months ago
  •  ...the 30+ products its consultants use, and AI is now going into all of them. Existing...  ...much of it yourself. The firm is hiring Principal Engineers first and building teams around them, so...  ...everyone else follows. Your users are senior partners who have little patience for AI... 
    Contract work
    Temporary work
    Remote work

    midwestern-interactive

    New York, NY
    4 days ago
  • $110 - $150 per hour

     ...pay, diversity in tech, and the best job fit for every candidate we place. Our client, an investment firm, is seeking a Senior AI Engineer to join their team in New York, NY! This role is ideal for an experienced software engineer who understands how to design... 
    Senior

    Eleven Recruiting

    New York, NY
    4 days ago
  •  ...New York, NY Principal AI Engineer - 12.11.26 Loaction New York, NY Job Type Full-time Experience 5 - 10 Remote work policy On-site Visa sponsorship No Preferred time zone ET About the role This role owns the design and implementation... 
    Full time
    Remote work
    Visa sponsorship

    Eino

    New York, NY
    5 days ago
  • $250k

     ...AI Software Engineer Location: New York City, NY Work Model: Hybrid, NYC office Compensation: Up to $250,000 base salary plus equity Authorization: No sponsorship available (if you need sponsorship post OPT, this cannot be provided) Job Description... 
    Senior
    Full time
    Work at office

    Stott and May

    New York, NY
    3 days ago
  • $98.3k - $135.2k

     ...Senior and Lead Software Engineers (AI Engineering, .NET, Azure) Chicago, Dallas, Houston or New York (Hybrid) Full-time, direct hire Multiple openings at both levels About the Company Our client is a top global law firm investing heavily in AI. Its growing... 
    Senior
    Full time
    Internship
    Relocation package

    1872 Consulting

    New York, NY
    3 days ago
  •  ...Description Hybrid 3 days onsite in New York, NY Our client is seeking a Senior AI Enablement Engineer to design, build, integrate, and operationalize AI-powered tools and workflows across the business. This hands-on individual contributor role focuses on transforming... 
    Senior

    Eliassen Group

    New York, NY
    18 days ago
  •  ...Position: Lead / Senior AI Engineer Location: NYC, NY “Hybrid Office BI-weekly “ Mode Of Hire: Long term Contract Role Overview The Senior AI Engineer designs, builds, and supports secure, reliable AI-enabled applications and backend services for firmwide... 
    Senior
    Long term contract
    Full time
    Work at office

    InfiCare Staffing

    New York, NY
    4 days ago
  • $150k - $210k

     ...shape the future of our communities.We have multiple Software Engineering positions open at Associate, Director and VP levels, which are...  ...testing, code quality)Learn and apply new technologies, including AI/ML and prompt‑based approaches, where they add valueWhat We’re... 
    Temporary work
    Worldwide

    Morgan Stanley

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Principal AI Engineer. Be the first to apply!