Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Engineer - LLM and Agentic AI

$225.4k - $280.6k
Full-time

Capital One

Salary: $225,400 - 280,600 per year Requirements:

  • Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or similar fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Masters degree in similar fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • Minimum of 6 years of programming experience with Python, Go, Scala, or Java
  • 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud) (preferred)
  • Experience in designing, developing, integrating, delivering, and supporting complex AI systems (preferred)
  • Proven ability to lead and mentor an engineering team and influence cross-functional stakeholders (preferred)
  • Experience with developing AI and ML algorithms or technologies using Python, C++, C#, Java, or Golang (preferred)
  • Familiarity with state-of-the-art techniques for optimizing training and inference software (preferred)
  • Excellent communication and presentation skills with an ability to convey complex AI concepts clearly (preferred)
Responsibilities:
  • Collaborate within a diverse team to create AI-powered solutions that enhance employee workflows and customer interactions
  • Design, develop, test, deploy, and support AI software components, including foundation model training and large language model inference
  • Utilize a comprehensive array of Open Source and SaaS AI technologies like AWS Ultraclusters, Huggingface, and PyTorch
  • Develop and implement cutting-edge LLM optimization techniques to boost performance across production AI systems
  • Contribute to the technical vision and long-term strategies for foundational AI systems at Capital One
Technologies:
  • AI
  • AWS
  • Azure
  • C#
  • Cloud
  • Golang
  • Support
  • Java
  • LLM
  • Machine Learning
  • PyTorch
  • Python
  • Scala
  • Hardware

More:

At Capital One, we are pioneering responsible and reliable AI systems that aim to transform banking for the better. As a recognized leader in leveraging machine learning for real-time, personalized customer experiences, we strive to be at the cutting edge of AI in enterprise applications. Our Intelligent Foundations and Experiences (IFX) team plays a critical role in executing our AI vision, collaborating across departments to advance science and engineering in AI, while delivering proprietary solutions of immense value to millions of customers. We are excited to offer a competitive salary and a comprehensive suite of benefits to support our team members overall well-being, as we continue to build world-class applied science and engineering teams.

last updated 35 week of 2026

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer - LLM and Agentic AI in Cambridge, MA vacancy
  • $197.3k - $225.1k

    Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    4 days ago
  • $286.2k - $326.7k

     ...Senior Director, AI Engineering -Agentic AI PlatformAt Capital One, we are creating responsible and reliable AI systems, changing banking for good. For...  ...PyTorch, and moreInvent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability... 
    Senior
    Full time
    Part time
    Remote work

    Capital One

    Cambridge, MA
    2 days ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...and more. ~ Invent and introduce state-of-the-art LLM optimization techniques to improve the performance —... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    1 day ago
  • $250.8k - $286.2k

    Senior Lead AI Engineer (GenAI Platform Services, Agentic Platform) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...and more. Invent and introduce state-of-the-art LLM optimization techniques to improve the performance —... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    6 days ago
  •  ...130k - $160kJob Description A Saas company in Watertown is hiring an AI-focused Staff Software Engineer for their team. You’ll be a point person for modernizing their legacy environment using Agentic AI workflows. The company focuses on modern construction solutions,... 
    Senior
    Full time

    Motion Recruitment

    Boston, MA
    1 day ago
  • $122k - $240.5k

    Position Summary Agentic AI is moving from experimentation to production, and organizations...  ...and at scale. We're growing a team of engineers who want to work at the center of that...  ...From entry-level employees to senior leaders, we believe there’s always room... 
    Senior
    Work at office
    Local area
    Visa sponsorship
    Shift work

    Deloitte

    Boston, MA
    4 days ago
  •  ...AgentsJoin the elite technical and product engine of the Accenture Google Business Group (...  ...shift in technology: the move to Agentic AI and Product-Led Operating Models. As a Google...  ...Platform (GCP) Agentic AI Delivery Senior Engineer, you are a new breed of technologist... 
    Senior
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    Boston, MA
    1 day ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    1 day ago
  • AMC Health is seeking a Senior Software Engineer to advance real-time voice AI, LLM pipelines, and traditional ML in a regulated healthcare setting. The role emphasizes production systems, telemetry-driven debugging, and end-to-end data workflows across cloud and on-prem... 
    Senior

    amchealth

    Boston, MA
    3 days ago
  • Plymouth Rock Assurance seeks an AI Engineer to design and deploy Generative and Agentic AI systems that transform how the company operates and serves customers. You will work with LLMs, RAG, MCP servers, and Agentic AI across enterprise use cases. The ideal candidate has... 

    Plymouth Rock Assurance

    Boston, MA
    4 days ago
  • $336k - $375k

     ...procurement teams with automation, AI, and GenAI so they can source...  ...building a brand new AI and Agentic business line from scratch,...  ...foundation, stack decisions, and engineering culture for a scaling team...  ...experience building and deploying LLM powered applications or... 
    Full time
    Remote work

    Fairmarkit

    Boston, MA
    13 hours ago
  • $110.7k - $372.9k

     ...need. Deloitte has a new AI-first effort, backed by...  ...reasoning models and agentic systems to rebuild how...  ...lab. As an Agentic AI Engineer, you will design, build...  ...and operationalize the LLM- and SLM-powered systems...  ...entry-level employees to senior leaders, we believe... 
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    3 days ago
  • Invicti Security Corp is seeking a Senior Software Engineer, Agentic AI, to join its AI team and advance the next-generation Agentic AppSec solution. You will design, build, and own features across the stack from agent architectures to security tool integrations, focusing... 
    Senior

    Invicti Security Corp

    Boston, MA
    3 days ago
  • $75 - $90 per hour

    A global staffing organization is seeking a Senior AI Platform Engineer to enhance development workflows with agentic AI capabilities. This role involves improving unit tests and building MCP servers in support of CI/CD pipelines. Candidates should have expertise in agentic... 
    Senior
    Remote job
    Hourly pay

    Yoh, A Day & Zimmermann Company

    Boston, MA
    4 days ago
  •  ...Senior AI Engineer Location: Nashville (preferred) or Boston | Travel: ~15% | Reports to:...  ...genuinely pushing the frontier of what agentic AI can do in the real world. What You...  ...demonstrated hands-on experience with LLM frameworks and agentic tooling such as... 
    Senior
    Full time

    Synquery

    Boston, MA
    13 hours ago
  • $75 per hour

    Overview Senior AI Platform Engineer with Agentic AI & Model Context Protocol (MCP) Location: Preferred local candidates but open to 100% remote working EST HOURS This is a long term contract. Open to W2 and CTC Contractors. This role supports AthenaHealth’s Internal... 
    Senior
    Remote job
    Long term contract
    Contract work
    For contractors
    Local area

    Yoh, A Day & Zimmermann Company

    Boston, MA
    2 days ago
  • $175k - $215k

     ...place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform -...  ...hands-on production role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize AI systems for accuracy... 
    Senior
    Full time
    Local area

    Brown Brothers Harriman

    Boston, MA
    4 days ago
  • $140k - $165k

     ...as well as our leadership in AI maturity and responsible innovation...  ...highly skilled and hands-on Senior AI Engineer to join a small, high-impact...  ..., ML scoring models, and LLM-powered products that serve millions...  ...You’ll own implementation of agentic pipelines, ML models, eval... 
    Senior
    Work at office
    3 days per week

    InvoiceCloud

    Boston, MA
    3 days ago
  • $145.9k - $234.2k

    The RoleModerna is seeking a Senior AI Engineer in Cambridge, MA/ Warsaw, Poland to provide deep...  ...software delivery, GenAI applications, agentic workflows, ML services, and cloud-based...  ...experience architecting and operating LLM/GenAI systems, including RAG, agents/tool... 
    Senior
    Permanent employment
    Full time
    Work at office
    Work from home

    Moderna Therapeutics

    Cambridge, MA
    3 days ago
  • $163.2k - $220.8k

     ...growth. Wilson Sonsini is looking for a Senior AI Security Engineer to join the Security Operations team....  ...MCP server integrations and agentic architectures, and serving as the technical...  ...designing secure-by-default patterns for LLM integration, agentic workflows, retrieval... 
    Senior
    Full time
    Work experience placement
    Remote work
    Worldwide
    Shift work

    Wilson Sonsini Goodrich & Rosati

    Boston, MA
    2 days ago
  •  ...Cybersecurity Forward Deployed Engineer is a production engineer who...  ...and engineering teams—to make AI systems secure, governed, and...  ...security posture improvement.Agentic coding is not a supporting skill...  ...stakeholder client environments—LLM systems, multi-agent pipelines... 
    Senior
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    4 days ago
  • $216k - $324k

     ...Team OverviewThe Amplify Engineering team builds the...  ...tools, platforms, and AI-powered automation that...  ...smoothly.This role is for senior technical leaders who own...  ...tools — coding assistants, agentic workflows, RAG...  ...tools — coding assistants, LLM APIs and SDKs, agentic... 
    Senior
    Immediate start
    Relocation

    Klaviyo

    Boston, MA
    4 days ago
  • $229.9k - $262.4k

     ...Overview Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems...  ...and more. Invent and introduce state-of-the-art LLM optimization techniques to improve the performance... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    a month ago
  • $293.5k

    General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work Areas...  ...generation generative AI systems and agentic solutions for Bain’s clients. As a...  ...frameworks, and data labeling strategies for LLM appsDeep experience with:Advanced RAG... 
    Senior
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    Boston, MA
    13 hours ago
  •  ...Senior AI Engineer Working with Us Challenging. Meaningful. Life-changing. Those aren't words...  ...engineering of cloud-native applications, agentic AI products, and the knowledge and...  ...or similar technologies that integrate LLM APIs, AI agents, retrieval systems, workflow... 
    Senior

    Bristol-Myers Squibb

    Cambridge, MA
    3 days ago
  • $158k - $197.5k

     ...which we practice. About the RoleThe Senior AI Defense Engineer is a technical leader responsible for...  ...controls across Copilot and other commercial LLM platforms. Adversarial Testing & Red...  ..., Semantic Kernel, LlamaIndex) or agentic/orchestration platforms. Experience doing... 
    Senior
    Work experience placement
    Shift work

    Wilmer Hale

    Boston, MA
    4 days ago
  • $102.75k - $195.25k

     ...infrastructure behind an agentic software development...  ...knowledge bases that other engineering teams will depend on...  ...you. Work you'll do As a Senior Consultant, Agentic...  ...techniques to keep the LLM Wiki and AWS Bedrock-managed...  ....Engineer grounded AI capabilities by developing... 
    Senior
    Work at office
    Local area
    Remote work
    Visa sponsorship

    Deloitte

    Boston, MA
    1 day ago
  • $200k - $325k

    Job DescriptionWe are building an AI Engineering function to enable productivity and agentic capabilities across the firm, for...  ..., and business teams.As a Senior AI Platform Engineer, you will design...  ...core AI platform, including managed LLM inference services (Amazon... 
    Senior
    Full time
    Work at office
    Local area

    Arrowstreet Capital

    Boston, MA
    3 days ago
  • $269.1k - $307.2k

     ...Distinguished AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating...  ...hours, mentoring Staff, Principal and Senior engineers, authoring technical design documents...  ...ML algorithms or technologies (e.g. LLM Inference, Similarity Search and... 
    Full time
    Part time
    Work at office
    Remote work

    Capital One

    Cambridge, MA
    5 days ago
  •  ...Senior AI Application EngineerWorking with Us Challenging. Meaningful...  ....As a Senior Application Engineer within Bristol Myers Squibb's...  ...including, but not limited to, agentic AI products and cross functional...  ...variety of approved frontier LLM models and APIs.This is a... 
    Senior

    Bristol-Myers Squibb

    Cambridge, MA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Engineer - LLM and Agentic AI. Be the first to apply!