Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI and Large Language Model (LLM) Engineer

Black Canyon Consulting

LOCATION: Bethesda, Maryland (On-site / Not-remote)

Overview

We are seeking an experienced AI/LLM Engineer to lead the design, customization, and integration of large language models (LLMs) into biomedical research workflows and information retrieval systems. We are looking for someone with hands-on experience training, fine-tuning, augmenting, and deploying LLMs in production environments, ideally within biomedical or life sciences domains. The role is product-oriented and forward-looking, focused on building the next generation of AI-enabled search, retrieval, and knowledge discovery tools.

This role serves as a subject matter expert (SME) across multiple product and engineering teams. The selected candidate will help define, architect, and implement LLM-driven capabilities across a portfolio of NCBI services. The position requires strong technical depth, sound architectural judgment, and the ability to collaborate effectively within existing product and technical ecosystems.

This is a hands-on, build-oriented role with strategic influence. The candidate must be capable of guiding both what gets built and how it gets built.

Only serious candidates accepted - we are not seeking candidates that have recently graduated with a masters degree in the past 1-2 years .

We are seeking candidates with at least 3+ years experience doing this work after your last degree.

 

Key Responsibilities

  • Serve as the AI/LLM subject matter expert across product and engineering teams.
  • Collaborate with product managers and technical leads to define AI-enabled capabilities and define the use of LLMs across NCBI platforms (e.g., PubMed and related systems).
  • Develop and implement retrieval-augmented generation (RAG) systems integrating LLMs with large-scale biomedical datasets.
  • Provide architectural guidance on model selection, domain adaptation, evaluation strategies, and deployment approaches.
  • Improve model grounding, factual accuracy, and scientific reliability in domain-sensitive applications.
  • Support engineering teams in productionizing AI solutions, ensuring scalability, performance, and maintainability.
  • Evaluate emerging LLM techniques and recommend practical adoption strategies aligned with organizational priorities.

Required Qualifications

  • 3+ years of hands-on experience working with large language models (training, fine-tuning, augmentation, or deployment).
  • Demonstrated experience integrating LLMs into production systems (e.g., semantic search, RAG pipelines, domain-specific QA).
  • Strong experience in ML system architecture and scalable deployment.
  • Proven ability to work cross-functionally with product and technical teams.
  • Experience serving as a technical SME guiding multi-team initiatives.
  • Strong programming skills in Python.
  • Experience with modern ML frameworks (e.g., PyTorch, Hugging Face) and retrieval infrastructure (e.g., embeddings, vector databases).

Preferred Qualifications

  • Experience building LLM-based systems for biomedical research or life sciences.
  • Familiarity with large scientific corpora, biomedical ontologies, structured knowledge bases, or biological datasets.
  • Experience developing generative AI systems for DNA, RNA, or protein sequence analysis.
  • Background in bioinformatics, computational biology, or related disciplines.
  • Experience improving factual grounding and reducing hallucinations in scientific or regulated environments.

Ideal Candidate Profile

  • Technically deep in LLM training, augmentation, and evaluation.
  • Comfortable influencing architecture across multiple teams.
  • Able to move between strategy, design, and implementation.
  • Pragmatic and product-oriented.
  • Capable of integrating into existing systems and elevating technical execution immediately.
  • Experience with life sciences corpora.

Benefits and Salary

We attract the best people in the business with our competitive benefits package that includes medical, dental and vision coverage, 401k plan with employer contribution, paid holidays, vacation, and tuition reimbursement.

We offer a competitive salary commensurate with experience and location.

If you enjoy being a part of a high performing, professional service and technology focused organization, please apply today!

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI and Large Language Model (LLM) Engineer in Bethesda, MD vacancy
  • $86.25k - $172.5k

     ...Quantitative Analytics & Model Analyst Senior within PNC's...  ..., and AI-enabled automation...  ...quantitative and data-engineering capabilities, and...  ...outputs; analyze large, complex datasets...  ...generative AI, and LLM-based capabilities...  ...License(s)Language AssessmentsNo Required... 
    Senior
    Language
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office

    The PNC Financial Services Group

    West Mclean, VA
    3 days ago
  • $175k - $250k

     ...Senior Cloud Infrastructure Engineer Location: San Francisco, CA (On‑site only) — must live...  ...interact with generative AI. Our node‑based visual...  ...deployment, and maintenance of large‑scale distributed systems...  ...different programming languages or frameworks. Skills fluxcd... 
    Senior
    Language
    Full time
    Relocation

    The Recruiting Guy

    Arlington, VA
    3 days ago
  •  ...Intelligence Operations Engineer with experience...  ...artificial intelligence (AI) solutions for cybersecurity...  ...of AI technologies and models and will have exceptional...  ...tools, and scripting languages such as Python, BashFamiliarity...  ...with open source LLM models, such Llama,... 
    Senior
    Language
    Remote work

    System One Holdings, LLC

    Washington DC
    2 days ago
  •  ...build strong connections. AI at Cvent: Leading the Future...  ...collaboration, we’d love to meet you. Senior Site Reliability Engineer As a Senior Site...  ...championing CI/CD. Scripting languages like Ruby, Groovy, Bash,...  ...remediation. Experience integrating LLM-based or AI-driven tools... 
    Senior
    Language
    Work experience placement
    Work at office
    Worldwide

    Cvent

    Falls Church, VA
    3 days ago
  • $140k - $170k

    Senior FPGA Design Engineer### Senior FPGA Design EngineerApply: Arlington, VA: Full...  ...research, and emerging AI-assisted design...  ...Proficiency with scripting languages such as Python or TCL.* Proficiency...  ....* Experience applying large language model assisted design to FPGAs... 
    Senior
    Language
    Full time
    Work experience placement
    Local area

    University of Southern California

    Arlington, VA
    2 days ago
  • $148k - $223k

     ...Salesforce is the #1 AI CRM, where humans with...  ...The Experience The Senior Infrastructure Engineer, Systems –...  ...integrations, and governance models that let teams plan and...  ...enterprise scale, including large user bases, cross-...  ...or automation languages (e.g., Python, JavaScript... 
    Senior
    Language
    Full time

    Salesforce

    Washington DC
    10 days ago
  •  ...cross-functional teams to develop and implement AI and HLT solutions, including capabilities that leverage large language model technology Analyze language processing needs...  ...a Bachelor’s degree in computer science, engineering, linguistics, or related disciplines; or 3... 
    Senior
    Language
    Work experience placement
    Immediate start

    MITRE Corporation

    Mc Lean, VA
    3 days ago
  • $160k - $200k

     ...options Keep mission-critical AI systems reliable, secure,...  ..., computer vision, natural language processing, data...  ...applications. We are looking for a Senior Site Reliability Engineer to help build, operate, and...  ..., not slideware. Large IT programs run 45% over budget... 
    Senior
    Language
    Remote work
    Flexible hours

    BluJuniper, Inc.

    Arlington, VA
    3 days ago
  • $128.5k - $190k

     ...The Site Reliability Engineering organization at Medallia...  ...SaaS platform. As a Senior Site Reliability Engineer...  ...solutions, and AI-assisted workflows that...  ...operating and supporting large-scale production environments...  ..., Go, Bash, or similar languages. ~ Demonstrated... 
    Senior
    Language
    Temporary work
    Work experience placement
    Local area

    Medallia

    McLean, VA
    1 day ago
  • $229.9k - $262.4k

    Senior Manager, Machine Learning Engineer (People Leader) Do you love building and pioneering in the AI and technology space? Do you enjoy...  ...scaling production models across Capital...  ...that enable running large footprint ML...  ...Use programming languages like Python, Scala... 
    Senior
    Language
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    2 days ago
  • $229.9k - $262.4k

    Senior Manager, Full-stack Engineer (People Leader)-EDT Do you love building and pioneering...  ...our capabilities for the AI world and strategically...  ...utilizing programming languages like Java, Scala, Python,...  ...and ensuring delivery of large-scale, cross-functional initiatives... 
    Senior
    Language
    Full time
    Part time
    Internship
    Local area

    Capital One

    McLean, VA
    3 days ago
  • $142.9k - $266k

     ...Platform and Reliability Engineer, Senior Manager The...  ...for enterprise agentic AI. You will provide cloud...  ...infrastructure, shared runtimes, model access, deployment...  ...issues ~ Knowledge of LLM operational requirements...  ...operational workflows using languages such as Python or Bash,... 
    Senior
    Language
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    2 days ago
  • $119.8k - $234.7k

     ...Overview Microsoft Security is seeking Senior AI Model Security Researcher s to join a new...  ...reproducible evidence that research engineering product and independent review teams...  ...tests. Experience testing large language models post-training or reinforcement... 
    Senior
    Language
    Ongoing contract
    Full time
    Local area

    Microsoft

    Washington DC
    1 day ago
  • $165.2k - $223.6k

     ...a Forward Deployed Engineer II (FDE II) on the Custom Model and Optimization team...  ...run custom generative AI models in production...  ...for new domains, languages, and modalities; migrate...  ...serving. Build large-scale training and inference...  ...- Experience with LLM post-training,... 
    Language
    Temporary work
    Internship
    Flexible hours

    AmazonWebServices

    Arlington, VA
    2 days ago
  • $229.9k - $262.4k

    Full-stack Engineer 5 (Senior Manager, IC) Cloud Operations Resilience Engineering...  ...Utilize programming languages like Java, Scala, Python, Go,...  ...design and implementation of large-scale, distributed, or cloud-...  ...Experience leveraging modern AI-based coding tools and IDE copilots... 
    Senior
    Language
    Full time
    Part time
    Internship
    Local area

    Capital One

    McLean, VA
    1 day ago
  • $157k - $224k

     ...Job Description STR is hiring a Lead Model-Based Systems Engineer (MBSE)  in our Arlington, VA office...  ...open architectures and integrating with large scale software-intensive systems and...  ..., or object-oriented programming languages ~ Agile software development experience... 
    Language
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours
    Night shift

    STR

    Arlington, VA
    27 days ago
  • $99k - $225k

     ...Data Scientist, Senior The Opportunity: As...  ...science programming languages, such as Python or R...  ...analysis, predictive modeling, and machine learning...  ...with Deep Learning and AI frameworks, including...  ...Generation (RAG) and Large Language Models (LLM) Experience with distributed... 
    Senior
    Language
    Full time
    Contract work
    Part time
    Local area
    Remote work

    BOOZ, ALLEN & HAMILTON, INC.

    Kensington, MD
    5 days ago
  • $162.5k - $260.4k

     ...worldwide. As part of our AI‑First Innovation team,...  ...driven Sr. Consultant Engineer who thrives at the...  ...distributed systems, and large‑scale customer impact....  ...new technologies, model types, LLM‑based features, and platform...  ...familiarity with languages and frameworks such as... 
    Senior
    Language
    Full time
    Work experience placement
    Work at office
    Local area
    Worldwide

    VISA

    Washington DC
    a month ago
  • $162.5k - $260.4k

     ...the Future of Enterprise AI at Scale  We are looking...  ...agentic applications. This is a senior, hands-on engineering role for someone who...  ...application patterns, including large language models, agentic workflows,...  ...OpenAI, Anthropic, and related LLM APIs/SDKs, including... 
    Senior
    Language
    Full time
    Work experience placement
    Work at office
    Local area

    VISA

    Washington DC
    1 day ago
  • $99k - $225k

     ...Scientist and Automation Engineer, SeniorThe Opportunity:...  ...? We are seeking a Senior Data Scientist and Automation...  ...solutions that enable large‑scale records...  ...solutions using scripting languages such as Python or PowerShellExperience...  ...with Python, R, ML, or AI analytics workflows... 
    Senior
    Language
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Washington DC
    4 days ago
  •  ...high-caliber Site Reliability Engineer (SRE) to join our Forward...  ...that our complex, data-driven AI platforms remain resilient, scalable...  ...—bridging the gap between model development and production-...  ...-efficient performance for Large Language Models (LLMs). Pipeline Resilience... 
    Senior
    Language
    Local area

    Tiger Analytics

    Washington DC
    1 day ago
  •  ...Job Description Senior AI Security Engineer / Technical SETA SME...  ...systems, machine learning models, and supporting...  ...pipelines supporting large scale analytics and intelligence...  ...use of large language models, AI agents, and...  ...learning frameworks, LLM infrastructure, and cybersecurity... 
    Senior
    Language
    Full time
    For contractors
    Work experience placement

    TRIAEM, LLC

    Bethesda, MD
    10 days ago
  • $197.3k - $225.1k

    AI Engineer 4 (Vision model (VLM) customization experience) At Capital One, we are...  ...foundation model training, large language model inference, agents and...  ...met Mentor Principal and Senior Associates on scalable...  ...algorithms or technologies (e.g. LLM Inference, Similarity... 
    Language
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    2 days ago
  •  ...Apple is building the next generation of AI data center infrastructure to power large language model (LLM) services at scale. We are looking for a senior engineer to own the correctness consistency and stability of LLM inference in production. You will design and build... 
    Senior
    Language
    Full time

    Apple

    Washington DC
    37 minutes ago
  • $209k - $238.5k

     ...Senior Manager, Data Science - Model Risk Office Data is at the center of everything...  ...use our machine learning, AI, software engineering, and business expertise...  ...comfortable with open-source languages and are passionate about...  ...languages for large scale data analysis At... 
    Senior
    Language
    Full time
    Part time
    Work at office
    Local area
    Flexible hours

    Capital One

    McLean, VA
    2 days ago
  • $200k - $220k

     ...Position Overview AI/ML Engineer to join this role you...  ...evaluating machine learning models preparing datasets...  ...Technical Performance - Senior Skills: Supervised...  ...Experience with LLM engineering such as prompt...  ...Experience working with large language models and prompt... 
    Senior
    Language
    Full time
    Flexible hours

    Halvik

    McLean, VA
    1 day ago
  • $90k - $150k

     ...success. As a Quantitative Analytics & Model Development Analyst Senior within PNC's Data, Model & Analytics...  ...in Artificial Intelligence (AI), with the ability to support and contribute...  ...Certification(s)LicensesNo Required License(s)Language AssessmentsNo Required or Preferred... 
    Senior
    Language
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office

    The PNC Financial Services Group

    West Mclean, VA
    1 day ago
  • $145k - $185k

    OverviewWe are looking for an experienced Senior LLMOps Engineer to design, implement, and maintain production-grade large language model (LLM) pipelines, deployment architectures, and...  ...role in operationalizing generative AI capabilities, ensuring that LLM-based applications... 
    Senior
    Language

    Steampunk

    McLean, VA
    4 days ago
  • $143.6k - $215.4k

     ...The Mitre Corporation is seeking a Senior AI Engineer to develop, evaluate, and clearly communicate...  .../Data Science techniques including Large Language Models , Natural Language Processing ,...  ...Augmented Generation (RAG) , and LLM fine-tuning and hosting Agentic... 
    Senior
    Language
    Immediate start
    3 days per week

    The MITRE Corporation

    McLean, VA
    1 day ago
  •  ...Senior Data ScientistWashington D.C. / New...  ...Senior Data Scientist (AI/ML) to join our...  ...of credit scoring models, generation of...  ...in AI/ML and GenAI/Large Language Models (LLMs) to advance...  ....Partner with engineers to operationalize...  ...emerging AI/ML, GenAI/LLM technologies,... 
    Senior
    Language
    Flexible hours

    VantageScore®

    Washington DC
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI and Large Language Model (LLM) Engineer. Be the first to apply!