Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Engineer - LLM and Agentic AI

$225.4k - $280.6k
Full-time

Capital One

Salary: $225,400 - 280,600 per year Requirements:

  • Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or similar fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Masters degree in similar fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • Minimum of 6 years of programming experience with Python, Go, Scala, or Java
  • 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud) (preferred)
  • Experience in designing, developing, integrating, delivering, and supporting complex AI systems (preferred)
  • Proven ability to lead and mentor an engineering team and influence cross-functional stakeholders (preferred)
  • Experience with developing AI and ML algorithms or technologies using Python, C++, C#, Java, or Golang (preferred)
  • Familiarity with state-of-the-art techniques for optimizing training and inference software (preferred)
  • Excellent communication and presentation skills with an ability to convey complex AI concepts clearly (preferred)
Responsibilities:
  • Collaborate within a diverse team to create AI-powered solutions that enhance employee workflows and customer interactions
  • Design, develop, test, deploy, and support AI software components, including foundation model training and large language model inference
  • Utilize a comprehensive array of Open Source and SaaS AI technologies like AWS Ultraclusters, Huggingface, and PyTorch
  • Develop and implement cutting-edge LLM optimization techniques to boost performance across production AI systems
  • Contribute to the technical vision and long-term strategies for foundational AI systems at Capital One
Technologies:
  • AI
  • AWS
  • Azure
  • C#
  • Cloud
  • Golang
  • Support
  • Java
  • LLM
  • Machine Learning
  • PyTorch
  • Python
  • Scala
  • Hardware

More:

At Capital One, we are pioneering responsible and reliable AI systems that aim to transform banking for the better. As a recognized leader in leveraging machine learning for real-time, personalized customer experiences, we strive to be at the cutting edge of AI in enterprise applications. Our Intelligent Foundations and Experiences (IFX) team plays a critical role in executing our AI vision, collaborating across departments to advance science and engineering in AI, while delivering proprietary solutions of immense value to millions of customers. We are excited to offer a competitive salary and a comprehensive suite of benefits to support our team members overall well-being, as we continue to build world-class applied science and engineering teams.

last updated 32 week of 2026

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer - LLM and Agentic AI in Cambridge, MA vacancy
  • $229.9k - $262.4k

     ...Overview Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    15 days ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for...  ...and more. Invent and introduce state-of-the-art LLM optimization techniques to improve the performance... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    1 day ago
  •  ...130k - $160kJob Description A Saas company in Watertown is hiring an AI-focused Staff Software Engineer for their team. You’ll be a point person for modernizing their legacy environment using Agentic AI workflows. The company focuses on modern construction solutions,... 
    Senior
    Full time

    Motion Recruitment

    Boston, MA
    20 hours ago
  •  ...AgentsJoin the elite technical and product engine of the Accenture Google Business Group (...  ...shift in technology: the move to Agentic AI and Product-Led Operating Models. As a Google...  ...Platform (GCP) Agentic AI Delivery Senior Engineer, you are a new breed of technologist... 
    Senior
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    Boston, MA
    20 hours ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    20 hours ago
  • $110.7k - $372.9k

     ...need. Deloitte has a new AI-first effort, backed by...  ...reasoning models and agentic systems to rebuild how...  ...lab. As an Agentic AI Engineer, you will design, build...  ...and operationalize the LLM- and SLM-powered systems...  ...entry-level employees to senior leaders, we believe... 
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    2 days ago
  • $336k - $375k

     ...procurement teams with automation, AI, and GenAI so they can source...  ...building a brand new AI and Agentic business line from scratch,...  ...foundation, stack decisions, and engineering culture for a scaling team...  ...experience building and deploying LLM powered applications or... 
    Full time
    Remote work

    Fairmarkit

    Boston, MA
    20 hours ago
  • $75 per hour

    Overview Senior AI Platform Engineer with Agentic AI & Model Context Protocol (MCP) Location: Preferred local candidates but open to 100% remote working EST HOURS This is a long term contract. Open to W2 and CTC Contractors. This role supports AthenaHealth’s Internal... 
    Senior
    Remote job
    Long term contract
    Contract work
    For contractors
    Local area

    Yoh, A Day & Zimmermann Company

    Boston, MA
    1 day ago
  • $175k - $215k

     ...place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform -...  ...hands-on production role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize AI systems for accuracy... 
    Senior
    Full time
    Local area

    Brown Brothers Harriman

    Boston, MA
    3 days ago
  •  ...Senior AI Engineer Location: Nashville (preferred) or Boston | Travel: ~15% | Reports to:...  ...genuinely pushing the frontier of what agentic AI can do in the real world. What You...  ...demonstrated hands-on experience with LLM frameworks and agentic tooling such as... 
    Senior
    Full time

    Synquery

    Boston, MA
    20 hours ago
  • $145.9k - $234.2k

    The RoleModerna is seeking a Senior AI Engineer in Cambridge, MA/ Warsaw, Poland to provide deep...  ...software delivery, GenAI applications, agentic workflows, ML services, and cloud-based...  ...experience architecting and operating LLM/GenAI systems, including RAG, agents/tool... 
    Senior
    Permanent employment
    Full time
    Work at office
    Work from home

    Moderna Therapeutics

    Cambridge, MA
    2 days ago
  • $163.2k - $220.8k

     ...growth. Wilson Sonsini is looking for a Senior AI Security Engineer to join the Security Operations team....  ...MCP server integrations and agentic architectures, and serving as the technical...  ...designing secure-by-default patterns for LLM integration, agentic workflows, retrieval... 
    Senior
    Full time
    Work experience placement
    Remote work
    Worldwide
    Shift work

    Wilson Sonsini Goodrich & Rosati

    Boston, MA
    1 day ago
  •  ...Cybersecurity Forward Deployed Engineer is a production engineer who...  ...and engineering teams—to make AI systems secure, governed, and...  ...security posture improvement.Agentic coding is not a supporting skill...  ...stakeholder client environments—LLM systems, multi-agent pipelines... 
    Senior
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    3 days ago
  • $216k - $324k

     ...Team OverviewThe Amplify Engineering team builds the...  ...tools, platforms, and AI-powered automation that...  ...smoothly.This role is for senior technical leaders who own...  ...tools — coding assistants, agentic workflows, RAG...  ...tools — coding assistants, LLM APIs and SDKs, agentic... 
    Senior
    Immediate start
    Relocation

    Klaviyo

    Boston, MA
    3 days ago
  • $158k - $197.5k

     ...which we practice. About the RoleThe Senior AI Defense Engineer is a technical leader responsible for...  ...controls across Copilot and other commercial LLM platforms. Adversarial Testing & Red...  ..., Semantic Kernel, LlamaIndex) or agentic/orchestration platforms. Experience doing... 
    Senior
    Work experience placement
    Shift work

    Wilmer Hale

    Boston, MA
    3 days ago
  •  ...Senior AI Engineer We are a cutting-edge cybersecurity tech startup, extending our Security Data Pipeline Platform to help security...  .... We are seeking a Senior AI Engineer to build innovative agentic and LLM product features that empower our customers. We are seeking... 
    Senior
    Remote work

    Realm.Security, Inc

    Boston, MA
    20 hours ago
  • $293.5k

    General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work Areas...  ...generation generative AI systems and agentic solutions for Bain’s clients. As a...  ...frameworks, and data labeling strategies for LLM appsDeep experience with:Advanced RAG... 
    Senior
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    Boston, MA
    4 days ago
  •  ...Senior AI Engineer Working with Us Challenging. Meaningful. Life-changing. Those aren't words...  ...engineering of cloud-native applications, agentic AI products, and the knowledge and...  ...or similar technologies that integrate LLM APIs, AI agents, retrieval systems, workflow... 
    Senior

    Bristol-Myers Squibb

    Cambridge, MA
    3 days ago
  • $140k - $165k

     ...Senior AI Engineer Boston, MA InvoiceCloud is a fast-growing fintech leader recognized with...  ...-agent systems, ML scoring models, and LLM-powered products that serve millions of...  ...Engineering Lead. You'll own implementation of agentic pipelines, ML models, eval frameworks,... 
    Senior
    Work at office
    3 days per week

    Invoice Cloud Inc

    Boston, MA
    20 hours ago
  • $200k - $325k

    Job DescriptionWe are building an AI Engineering function to enable productivity and agentic capabilities across the firm, for...  ..., and business teams.As a Senior AI Platform Engineer, you will design...  ...core AI platform, including managed LLM inference services (Amazon... 
    Senior
    Full time
    Work at office
    Local area

    Arrowstreet Capital

    Boston, MA
    2 days ago
  •  ...Senior AI Application Engineer Working with Us Challenging. Meaningful. Life-changing. Those aren't words...  ...including, but not limited to, agentic AI products and cross functional knowledge...  ..., and a variety of approved frontier LLM models and APIs. This is a role... 
    Senior

    Bristol-Myers Squibb

    Cambridge, MA
    2 days ago
  • $225.4k - $280.6k

     ...year Requirements: ~ Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 6...  ...~ Background in developing AI and ML algorithms such as LLM Inference and Similarity Search ~ Practical knowledge of... 
    Senior
    Full time

    Capital One

    Cambridge, MA
    2 days ago
  •  ...leadership in cloud, data and AI with unmatched industry...  ...applied AI and data engineering. We help the world’s...  ....You Are:You are a Senior AI engineering Leader who...  ...for how generative and agentic AI is built, secured, and...  ...enterprise AI/LLM platforms across major... 
    Senior
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    3 days ago
  • $120k - $202.5k

     ...Analytics (CyberDNA) team is seeking a Senior AI Security Automation Engineer to help shape the next generation of...  ...-on delivery of scalable, reliable agentic AI platforms for security...  ...Generative AI and Large Language Model (LLM) based solutions, including agentic... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    Shift work
    2 days per week

    State Street Bank

    Boston, MA
    1 day ago
  • $131k - $218.3k

    Position Summary Our Deloitte AI & Engineering team to transform technology platforms, drive...  ...innovation. Work You’ll Do As an Agentic Capability Engineer, you will operate as...  ...development From entry-level employees to senior leaders, we believe there’s always room... 
    Local area

    Deloitte

    Boston, MA
    20 hours ago
  • $188k - $282k

    Job DescriptionVertex is seeking a Senior Principal AI Engineer to design, build, and optimize the shared platform capabilities that power AI-enabled...  ...workflows across the enterprise. Working within the Agentic AI Platform team, this role will focus on delivering production... 
    Senior
    Full time
    Summer work

    Vertex Pharmaceuticals

    Boston, MA
    20 hours ago
  •  ...Senior AI Engineer, Ares Platform Team: Ares AI Engineering Reports to: Ilir Osmanaj, VP of AI Engineering Location: Boston, MA (hybrid...  ...systems, with at least 2 years working directly on LLMs or LLM-powered agents. ~ Deep Python; strong, production-grade... 
    Senior
    Full time
    Remote work

    Assail

    Boston, MA
    20 hours ago
  • $55k - $151.47k

     ...people in data and analytics engineering focus on leveraging advanced technologies...  ...part of the People Tech & AI team you will develop, test,...  ...with PwC standards. As a Senior Associate you will analyze complex...  ...Automate platform- Executing LLM evaluation frameworks using... 
    Senior
    Full time
    Work experience placement
    H1b
    Remote work

    PwC

    Boston, MA
    4 days ago
  •  ...your capabilities, then consider a career in Advisory.KPMG is currently seeking a Senior Associate, AI Engineer to join our Advisory Services practice.Responsibilities:Develop GenAI / LLM applications and integrations using foundational models under the guidance of senior... 
    Senior
    H1b
    Local area

    KPMG

    Boston, MA
    15 hours ago
  • $216k - $324k

     ...destiny.Job Title: Sr. Lead AI EngineerLocation:...  ...the shared services and agentic capabilities that power...  ...Klaviyo.As a Sr.Lead AI Engineer in the AI & Analytics...  ...uplevel engineers. Coach senior and mid‑level engineers...  ...AI applications (e.g., LLM‑backed flows, tool‑... 
    Senior
    Local area

    Klaviyo

    Boston, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Engineer - LLM and Agentic AI. Be the first to apply!