Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Applied Researcher 4 (AI Foundations: Multimodal Guardrails and VLM's)

$218.7k - $249.6k
Full-time

Capital One

Applied Researcher 4 (AI Foundations: Multimodal Guardrails and VLM's) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent, automated customer experiences. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to building world-class applied science and engineering teams and continue our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build. Team Description: The AI Foundations team is at the center of bringing our vision for AI at Capital One to life. Our work touches every aspect of the research life cycle, from partnering with Academia to building production systems. We work with product, technology and business leaders to apply the state of the art in AI to our business. What You’ll Do:

  • Partner with a cross-functional team of data scientists, software engineers, machine learning engineers and product managers to deliver AI-powered products that change how customers interact with their money.
  • Leverage a broad stack of technologies — Pytorch, AWS Ultraclusters, Huggingface, Lightning, and more — to reveal the insights hidden within huge volumes of numeric and textual data.
  • Build AI foundation models through all phases of development, from design through training, evaluation, validation, and implementation.
  • Engage in high impact applied research to take the latest AI developments and push them into the next generation of customer experiences.
  • Flex your interpersonal skills to translate the complexity of your work into tangible business goals.
  • Collaborate with senior researchers to prepare internal tech reports or conference submissions summarizing novel methods or findings
The Ideal Candidate:
  • You love the process of analyzing and creating, but also share our passion to do the right thing. You know at the end of the day it’s about making the right decision for our customers
  • Innovative. You continually research and evaluate emerging technologies. You stay current on published state-of-the-art methods, technologies, and applications and seek out opportunities to apply them
  • Creative. You thrive on bringing definition to big, undefined problems. You love asking questions and pushing hard to find answers. You’re not afraid to share a new idea
  • A leader. You challenge conventional thinking and work with stakeholders to identify and improve the status quo. You’re passionate about talent development for your own team and beyond
  • Technical. You’re comfortable with open-source languages and are passionate about developing further. You have hands-on experience developing AI foundation models and solutions using open-source tools and cloud computing platforms
  • Has a deep understanding of the foundations of AI methodologies
  • Experience building large deep learning models, whether on language, images, events, or graphs, as well as expertise in one or more of the following: training optimization, self-supervised learning, robustness, explainability, RLHF
  • An engineering mindset as shown by a track record of delivering models at scale both in terms of training data and inference volumes
  • Experience in delivering libraries, platform level code or solution level code to existing products
  • A professional with a track record of coming up with high quality ideas or improving upon existing ideas in machine learning, demonstrated by accomplishments such as first author publications or projects
  • Possess the ability to own and pursue a research agenda, including choosing impactful research problems and autonomously carrying out long-running projects
Basic Qualifications:
  • Currently has, or is in the process of obtaining, a PhD in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or related fields, with an exception that required degree will be obtained on or before the scheduled start date or M.S. in Electrical Engineering, Computer Engineering, Computer Science, AI, Mathematics, or related fields plus 2 years of experience in Applied Research
Preferred Qualifications:
  • PhD in Computer Science, Machine Learning, Computer Engineering, Applied Mathematics, Electrical Engineering or related fields
  • LLM
  • PhD focus on NLP or Masters with 5 years of industrial NLP research experience
  • Multiple publications on topics related to the pre-training of large language models (e.g. technical reports of pre-trained LLMs, SSL techniques, model pre-training optimization)
  • Member of team that has trained a large language model from scratch (10B + parameters, 500B+ tokens)
  • Publications in deep learning theory
  • Publications at ACL, NAACL and EMNLP, Neurips, ICML or ICLR
  • Optimization (Training & Inference)
  • PhD focused on topics related to optimizing training of very large deep learning models
  • Multiple years of experience and/or publications on one of the following topics: Model Sparsification, Quantization, Training Parallelism/Partitioning Design, Gradient Checkpointing, Model Compression
  • Experience optimizing training for a 10B+ model
  • Deep knowledge of deep learning algorithmic and/or optimizer design
  • Experience with compiler design
  • Finetuning
  • PhD focused on topics related to guiding LLMs with further tasks (Supervised Finetuning, Instruction-Tuning, Dialogue-Finetuning, Parameter Tuning)
  • Demonstrated knowledge of principles of transfer learning, model adaptation and model guidance
  • Experience deploying a fine-tuned large language model
  • Demonstrated ability to reproduce and extend peer-reviewed AI research using modern open-source frameworks
  • Experience designing controlled experiments and documenting reproducibility results for internal or public research
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked. Cambridge, MA: $218,700 - $249,600 for Applied Researcher 4 McLean, VA: $218,700 - $249,600 for Applied Researcher 4 New York, NY: $238,600 - $272,300 for Applied Researcher 4 San Jose, CA: $238,600 - $272,300 for Applied Researcher 4 Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate’s offer letter. This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan. Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the [Capital One Careers website]( Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at View phone number on joinrs.com or via email at [View email address on joinrs.com](mailto:View email address on joinrs.com). All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to [View email address on joinrs.com](mailto:View email address on joinrs.com) Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Applied Researcher 4 (AI Foundations: Multimodal Guardrails and VLM's) in Cambridge, MA vacancy
  • $218.7k - $249.6k

     ...Overview Applied Researcher 4 (AI Foundations: Multimodal Guardrails and VLM's) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create... 
    Foundation
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    Cambridge, MA
    a month ago
  • $218.7k - $249.6k

     ...Applied Researcher 4 (AI Foundations - LLM, Optimization and Finetuning) Overview: At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create... 
    Foundation
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    Cambridge, MA
    3 days ago
  • $218.7k - $249.6k

     ...Applied Researcher 4 (AI Foundations, LLM Core and Agentic AI) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent... 
    Foundation
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    Cambridge, MA
    3 days ago
  •  ...Applied Researcher in Robotics - Perception & AI Pickle is looking for a dynamic and driven Applied Researcher in Robotics - Perception & AI to revolutionize...  ...pipeline efficiency. Leverage recent advances in foundation models, particularly vision language models, to... 
    Foundation

    Pickle Robot Company

    Charlestown, MA
    4 days ago
  • $262.5k - $299.6k

     ...Applied Researcher 5 (AI Foundations, LLM Core and Agentic AI) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for...  ...Computer Science, AI, Mathematics, or related fields plus 4 years of experience in Applied Research Preferred Qualifications... 
    Foundation
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    Cambridge, MA
    2 days ago
  • $218.7k - $249.6k

     ...Applied Researcher 4 At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry...  ...services we build. Team Description: The AI Foundations team is at the center of bringing our vision... 
    Foundation
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    Cambridge, MA
    3 days ago
  •  ...Community. The Group conducts research and development at the...  ...The Group invents and applies novel RF machine-...  ...experimental methods, and modern AI to extract actionable...  ...who has a strong foundation in AI, machine learning...  ...development. Level 4 - Associate Staff Bachelor... 
    Foundation
    Internship
    Remote work
    Shift work

    Lincoln Laboratory

    Lexington, MA
    20 hours ago
  • IBM in Cambridge, MA invites ambitious AI Applied Scientist Interns to join a hands-on research program. You will help advance foundation models, multimodal AI, and enterprise AI initiatives, working in small, mentored teams from ideation to publication and patent pursuit... 
    Foundation
    Internship

    International Business Machines Corporation

    Cambridge, MA
    6 days ago
  • $197.3k - $225.1k

    AI Engineer 4 (AI Foundations, VLM Customization) At Capital One, we are creating responsible...  ...to build world-class applied science and engineering...  ...team of engineers, research scientists, technical program...  ...workflows, similarity search, guardrails, model evaluation,... 
    Foundation
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    3 days ago
  • $190k - $230k

     ...and peak performance. We are seeking a Senior AI Researcher to join our Foundation AI team. This team builds the multimodal foundation models that underpin WHOOP’s next generation...  ...text, biomarkers, and behavioral data.Conduct applied research in self-supervised learning,... 
    Foundation
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    2 days ago
  • $270k - $300k

     ...performance.We are seeking a Principal AI Researcher to join our Foundation AI team. This team builds the...  ...(transformers, state space models), multimodal training, self-supervised and representation...  ...? We encourage you to still apply! At WHOOP, we believe there is much... 
    Foundation
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    2 days ago
  • $306.3k - $349.5k

     ...Staff Applied Researcher At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good...  ...Description: The AI Foundations team is at the center...  ...related fields plus 4 years of experience...  ...foundation models, multimodal reasoning) Capital... 
    Foundation
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    Cambridge, MA
    2 days ago
  •  ...As an AI Applied Scientist Intern, you will engage in the applied research lifecycle to pioneer new advancements in artificial intelligence. Your role will...  .... You will help advance our research in foundation models and multimodal AI, business process intelligence and automation... 
    Foundation
    Internship

    IBM

    Cambridge, MA
    5 days ago
  •  ...made it possible for AI to impact clinical care...  ...The Senior Scientist, Applied Machine Learning and Generative...  ...frameworks, and foundation models in the life...  ...has one of the largest multimodal patient datasets ever...  ...collaboration: Work with Research, Engineering & Data... 
    Foundation
    Full time
    Shift work

    Tempus

    Boston, MA
    1 day ago
  •  ...We build embodied foundation models, starting with a...  ...pioneered large embodied multimodal models and vision-language...  ...scaled ChatGPT and GPT-4 to hundreds of millions...  ...About the Role Applied Scientists own the mastery...  ...role is a hybrid of research, engineering, and operations... 
    Foundation

    Generalist

    Somerville, MA
    2 days ago
  • $55k

    Researcher - MIT AI Risk Initiative (Technical Associate) Position overview As AI capabilities rapidly...  ...support the MIT AI Risk Initiative's applied research, data analysis, and project...  ..., and engineerswho study the foundations and economic implications of progress... 
    Foundation
    Full time
    Part time
    Internship
    Work at office
    Afternoon shift

    AISafety

    Cambridge, MA
    4 days ago
  • MIT FutureTech is seeking an early-career Researcher to support the MIT AI Risk Initiative as a Technical Associate. You will contribute to applied research, data analysis, and project delivery, synthesizing evidence on AI risks and mitigations for decision-makers. The... 

    AISafety

    Cambridge, MA
    4 days ago
  • $229.9k - $262.4k

     ...AI Engineer 5 (AI Foundations, VLM Customization) At Capital One, we are creating...  ...build world-class applied science and...  ...team of engineers, research scientists, technical...  ...similarity search, guardrails, model evaluation, experimentation...  ...plus at least 4 years of experience... 
    Foundation
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    2 days ago
  • $219k - $246k

     ...purpose-built to power AI-enabled precision...  ...solutions that accelerate research and improve care for individuals...  ..., Verily transforms multimodal health data into...  ...As an AI Applied Scientist, you will occupy...  ...advanced research into foundational healthcare models and... 
    Foundation
    Full time
    Remote work

    Verily Health

    Boston, MA
    4 days ago
  • $167.1k - $226.1k

    The Foundational AI Assets (FAI) team is looking for a passionate, talented, and inventive Senior Applied Scientist with a strong deep learning background, to build industry-leading...  ...problems, taking solutions from research through production deployment while maintaining... 
    Foundation
    Temporary work
    Flexible hours
    Shift work
    Day shift

    Amazon

    Boston, MA
    2 days ago
  • $198.9k - $269k

    The Frontier AI Assets (FAI) team is looking for a passionate...  ...talented, and inventive Principal Applied Scientist with a strong deep...  ...development skills of Nova foundational models. As a Principal...  ...modeling, verification, and other research procedures. You probe assumptions... 
    Foundation
    Flexible hours

    Amazon

    Boston, MA
    1 day ago
  •  ...at the intersection of multimodal large language models and embodied AI in dynamic indoor environments...  ...to collaborate with researchers in computer vision at...  ...algorithms Strong foundations in machine learning and...  ...facilities. This policy applies to all terms and conditions... 
    Foundation
    Internship
    Local area

    Mitsubishi Electric Research Laboratories, Inc.

    Cambridge, MA
    3 days ago
  •  ...of Position: Biomedical AI Scientist Summary of...  ...While this role involves foundational work in signal and image...  ...this data into a multimodal reasoning engine. The candidate...  ...and a passion for applying technology to healthcare...  ...of on‑site presence 3‑4 days per week to support... 
    Foundation
    Remote work
    3 days per week

    Image

    Cambridge, MA
    4 days ago
  •  ...Senior Scientist, AI for Oncology Clinical DevelopmentLocations...  ...ImpactWhat if your AI research could help transform...  ..., and decision-making.Apply data, models, and...  ...: Training and tuning foundation models Bayesian...  ...Reinforcement learning Multimodal integration and modelling... 
    Foundation
    Work at office
    Remote work

    AstraZeneca

    Cambridge, MA
    4 days ago
  •  ...building mechanistic AI models to predict how...  ...broader goal of building foundational models that can reason...  ...are looking for an AI Research Scientist to help...  ...problems, not simply apply existing models to biological...  ..., transformers, multimodal learning, representation... 
    Foundation
    Remote work
    Flexible hours

    Absentia Labs

    Boston, MA
    2 days ago
  • $168k - $252k

     ...accelerate the application of AI and agentic systems across...  ...Scientific Transformation Through Applied AI and Agentic SystemsDrive...  ...innovation across Discovery Research.Lead Platform Strategy, Adoption...  ...practice.Define operational guardrails governing model usage, data... 
    Full time
    Summer work
    Remote work
    Flexible hours
    2 days per week
    3 days per week

    Vertex Pharmaceuticals

    Boston, MA
    4 days ago
  • $229.9k - $262.4k

     ...responsible and reliable AI systems, changing...  ...build world-class applied science and...  ...: The Intelligent Foundations and Experiences (IFX...  ...of engineers, research scientists, technical...  ...similarity search, guardrails, model evaluation,...  ...plus at least 4 years of experience... 
    Foundation
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    3 days ago
  • $229.9k - $262.4k

     ...Overview Sr. Manager, AI Engineer (Gen AI...  ...: Agentic AI, Guardrails, Evaluation) At...  ...build world-class applied science and...  ...The Intelligent Foundations and Experiences (IFX...  ...team of engineers, research scientists, technical...  ...fields plus at least 4 years of... 
    Foundation
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    a month ago
  •  ...We are seeking a Staff Applied Machine Learning...  ...modeling, and applied AI. You will develop novel...  ...physiological time-series and multimodal sensor data, with a...  ...initiatives from research and prototyping through...  ...multimodal sensor data.Strong foundation in digital and... 
    Foundation
    Work at office
    Relocation

    WHOOP

    Boston, MA
    4 days ago
  • $166.77k - $202.09k

     ...patient benefit. IPS conducts applied computational research in areas that include...  ...is forming Translational AI Foundations (TAIF), a small team of computational...  ...scalable. Clinical and multimodal patient-derived datasets...  ...training, with 4+ years of relevant academic... 
    Foundation
    Hourly pay
    Full time
    Part time
    Summer work
    Live in
    Local area
    Immediate start
    Remote work
    Flexible hours

    Bristol Myers Squibb

    Cambridge, MA
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Applied Researcher 4 (AI Foundations: Multimodal Guardrails and VLM's). Be the first to apply!