Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI and Large Language Model (LLM) Engineer

Black Canyon Consulting

LOCATION: Bethesda, Maryland (On-site / Not-remote)

Overview

We are seeking an experienced AI/LLM Engineer to lead the design, customization, and integration of large language models (LLMs) into biomedical research workflows and information retrieval systems. We are looking for someone with hands-on experience training, fine-tuning, augmenting, and deploying LLMs in production environments, ideally within biomedical or life sciences domains. The role is product-oriented and forward-looking, focused on building the next generation of AI-enabled search, retrieval, and knowledge discovery tools.

This role serves as a subject matter expert (SME) across multiple product and engineering teams. The selected candidate will help define, architect, and implement LLM-driven capabilities across a portfolio of NCBI services. The position requires strong technical depth, sound architectural judgment, and the ability to collaborate effectively within existing product and technical ecosystems.

This is a hands-on, build-oriented role with strategic influence. The candidate must be capable of guiding both what gets built and how it gets built.

Only serious candidates accepted - we are not seeking candidates that have recently graduated with a masters degree in the past 1-2 years .

We are seeking candidates with at least 3+ years experience doing this work after your last degree.

 

Key Responsibilities

  • Serve as the AI/LLM subject matter expert across product and engineering teams.
  • Collaborate with product managers and technical leads to define AI-enabled capabilities and define the use of LLMs across NCBI platforms (e.g., PubMed and related systems).
  • Develop and implement retrieval-augmented generation (RAG) systems integrating LLMs with large-scale biomedical datasets.
  • Provide architectural guidance on model selection, domain adaptation, evaluation strategies, and deployment approaches.
  • Improve model grounding, factual accuracy, and scientific reliability in domain-sensitive applications.
  • Support engineering teams in productionizing AI solutions, ensuring scalability, performance, and maintainability.
  • Evaluate emerging LLM techniques and recommend practical adoption strategies aligned with organizational priorities.

Required Qualifications

  • 3+ years of hands-on experience working with large language models (training, fine-tuning, augmentation, or deployment).
  • Demonstrated experience integrating LLMs into production systems (e.g., semantic search, RAG pipelines, domain-specific QA).
  • Strong experience in ML system architecture and scalable deployment.
  • Proven ability to work cross-functionally with product and technical teams.
  • Experience serving as a technical SME guiding multi-team initiatives.
  • Strong programming skills in Python.
  • Experience with modern ML frameworks (e.g., PyTorch, Hugging Face) and retrieval infrastructure (e.g., embeddings, vector databases).

Preferred Qualifications

  • Experience building LLM-based systems for biomedical research or life sciences.
  • Familiarity with large scientific corpora, biomedical ontologies, structured knowledge bases, or biological datasets.
  • Experience developing generative AI systems for DNA, RNA, or protein sequence analysis.
  • Background in bioinformatics, computational biology, or related disciplines.
  • Experience improving factual grounding and reducing hallucinations in scientific or regulated environments.

Ideal Candidate Profile

  • Technically deep in LLM training, augmentation, and evaluation.
  • Comfortable influencing architecture across multiple teams.
  • Able to move between strategy, design, and implementation.
  • Pragmatic and product-oriented.
  • Capable of integrating into existing systems and elevating technical execution immediately.
  • Experience with life sciences corpora.

Benefits and Salary

We attract the best people in the business with our competitive benefits package that includes medical, dental and vision coverage, 401k plan with employer contribution, paid holidays, vacation, and tuition reimbursement.

We offer a competitive salary commensurate with experience and location.

If you enjoy being a part of a high performing, professional service and technology focused organization, please apply today!

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI and Large Language Model (LLM) Engineer in Bethesda, MD vacancy
  • $168.1k - $227.4k

    As a Senior Forward Deployed Engineer (Senior FDE) on the Custom Model and Optimization team, you are...  ...custom generative AI models at the heart...  ...learning, and migrating large training and...  ...software programming language experience - 5+...  ...vLLM, or TensorRT-LLM, on AWS Trainium (... 
    Senior
    Language
    Full time
    Internship
    Local area
    Flexible hours

    Amazon

    Washington DC
    28 days ago
  • $191k - $254k

     ...technology, and business model of the 21st century’s...  ...by Lattice OS, an AI-powered operating system...  ...THE JOB We're hiring Senior Software Engineers to join our team. You'...  ...move and reconcile large volumes of data reliably...  ...one modern backend language. We value strong engineering... 
    Senior
    Language
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Washington DC
    2 days ago
  • $86.25k - $172.5k

     ...Quantitative Analytics & Model Analyst Senior within PNC's Credit...  ...development, data engineering, quantitative analytics...  ...analysis on large and complex datasets...  ...frameworks.•Leverage AI, machine learning, and...  ...LicensesNo Required License(s)Language AssessmentsNo... 
    Senior
    Language
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office

    The PNC Financial Services Group

    West Mclean, VA
    3 days ago
  • $86.25k - $172.5k

     ...Quantitative Analytics & Model Analyst Senior within PNC's...  ..., and AI-enabled automation...  ...quantitative and data-engineering capabilities, and...  ...outputs; analyze large, complex datasets...  ...generative AI, and LLM-based capabilities...  ...License(s) Language Assessments... 
    Senior
    Language
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office

    PNC Bank

    Washington DC
    6 days ago
  •  ...shape their hybrid cloud and AI journeys. With support from our...  ...As a Forward Deployed Engineer - AI, you will work directly...  ...Systems: Design and implement LLM-powered agents, tool use and...  ...building GenAI applications with large language models, including RAG, prompt and context... 
    Senior
    Language
    Worldwide

    IBM

    Washington DC
    20 days ago
  •  ...Intelligence Operations Engineer with experience...  ...artificial intelligence (AI) solutions for cybersecurity...  ...of AI technologies and models and will have exceptional...  ...tools, and scripting languages such as Python, BashFamiliarity...  ...with open source LLM models, such Llama,... 
    Senior
    Language
    Remote work

    System One Holdings, LLC

    Washington DC
    17 hours ago
  • $165.2k - $223.6k

     ...a Forward Deployed Engineer II (FDE II) on the Custom Model and Optimization team...  ...run custom generative AI models in production...  ...for new domains, languages, and modalities; migrate...  ...serving. Build large-scale training and inference...  ...- Experience with LLM post-training,... 
    Language
    Temporary work
    Internship
    Flexible hours

    AmazonWebServices

    Arlington, VA
    1 day ago
  • $140k - $170k

     ...’s Viterbi School of Engineering, is a world leader in...  ...talented and motivated Senior FPGA Design Engineer...  ..., and emerging AI-assisted design approaches...  ...Proficiency with scripting languages such as Python or TCL...  ...Experience applying large language model assisted design to... 
    Senior
    Language
    Work experience placement
    Local area

    Viterbi School of Engineering

    Arlington, VA
    16 hours ago
  • $160k - $200k

     ...options Keep mission-critical AI systems reliable, secure,...  ..., computer vision, natural language processing, data...  ...applications. We are looking for a Senior Site Reliability Engineer to help build, operate, and...  ..., not slideware. Large IT programs run 45% over budget... 
    Senior
    Language
    Remote work
    Flexible hours

    BluJuniper, Inc.

    Arlington, VA
    2 days ago
  • $128.5k - $190k

     ...The Site Reliability Engineering organization at Medallia...  ...SaaS platform. As a Senior Site Reliability Engineer...  ...solutions, and AI-assisted workflows that...  ...operating and supporting large-scale production environments...  ..., Go, Bash, or similar languages. ~ Demonstrated... 
    Senior
    Language
    Temporary work
    Work experience placement
    Local area

    Medallia

    McLean, VA
    12 hours ago
  • $125.3k - $178.9k

     ...design control processes and good engineering practices. This job family...  ...We are seeking a Workday AI Solutions Engineer to help HR...  ...business processes, security, data models, reporting, APIs, and...  ...enterprise AI concepts such as large language models, prompt design, tool use... 
    Senior
    Language
    Full time
    Temporary work
    Local area
    Immediate start
    Flexible hours

    Cardinal Health

    Washington DC
    4 days ago
  • $119.8k - $234.7k

     ...Overview Microsoft Security is seeking Senior AI Model Security Researcher s to join a new...  ...reproducible evidence that research engineering product and independent review teams...  ...tests. Experience testing large language models post-training or reinforcement... 
    Senior
    Language
    Ongoing contract
    Full time
    Local area

    Microsoft

    Washington DC
    5 days ago
  • $183k - $243k

     ...technology, and business model of the 21st century’s...  ...powered by Lattice OS, an AI-powered operating...  ...Our systems integration engineers internalize the nuances...  ...are comfortable leading large, focused projects. They...  ...Experience in software languages such as Go, Python, Rust... 
    Senior
    Language
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Washington DC
    17 hours ago
  • $99k - $225k

     ...Scientist and Automation Engineer, SeniorThe Opportunity:...  ...? We are seeking a Senior Data Scientist and Automation...  ...solutions that enable large‑scale records...  ...solutions using scripting languages such as Python or PowerShellExperience...  ...with Python, R, ML, or AI analytics workflows... 
    Senior
    Language
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Washington DC
    3 days ago
  •  ...AI Engineer We are seeking an experienced AI Engineer to join our AI-driven Digital...  ...solutions that leverage Generative AI, Large Language Models (LLMs), Machine Learning, Natural Language...  ...~ Evaluate and improve LLM performance through prompt tuning and... 
    Senior
    Language

    mroads

    Bethesda, MD
    2 days ago
  •  ...bottlenecks in the UFS Weather Model with the newly...  ...-time profiling for large parallel applications...  ...use of Generative AI (GenAI)/Large Language Models (LLMs) to improve...  ...science, software engineering, scientific computing...  ...with leveraging GenAI/LLM tools to optimize and... 
    Language
    For contractors

    Axiom Consultants

    College Park, MD
    2 days ago
  • $162.5k - $260.4k

     ...worldwide. As part of our AI‑First Innovation team,...  ...driven Sr. Consultant Engineer who thrives at the...  ...distributed systems, and large‑scale customer impact....  ...new technologies, model types, LLM‑based features, and platform...  ...familiarity with languages and frameworks such as... 
    Senior
    Language
    Full time
    Work experience placement
    Work at office
    Local area
    Worldwide

    VISA

    Washington DC
    a month ago
  • $197.3k - $225.1k

    AI Engineer 4 (Vision model (VLM) customization experience) At Capital One, we are...  ...foundation model training, large language model inference, agents and...  ...met Mentor Principal and Senior Associates on scalable...  ...algorithms or technologies (e.g. LLM Inference, Similarity... 
    Language
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    4 days ago
  • $145k - $185k

    OverviewWe are looking for an experienced Senior LLMOps Engineer to design, implement, and maintain production-grade large language model (LLM) pipelines, deployment architectures, and...  ...role in operationalizing generative AI capabilities, ensuring that LLM-based applications... 
    Senior
    Language

    Steampunk

    McLean, VA
    3 days ago
  • $99k - $225k

     ...Data Scientist, Senior The Opportunity: As...  ...science programming languages, such as Python or R...  ...analysis, predictive modeling, and machine learning...  ...with Deep Learning and AI frameworks, including...  ...Generation (RAG) and Large Language Models (LLM) Experience with distributed... 
    Senior
    Language
    Full time
    Contract work
    Part time
    Local area
    Remote work

    BOOZ, ALLEN & HAMILTON, INC.

    Kensington, MD
    4 days ago
  • $157k - $224k

     ...Job Description STR is hiring a Lead Model-Based Systems Engineer (MBSE)  in our Arlington, VA office...  ...open architectures and integrating with large scale software-intensive systems and...  ..., or object-oriented programming languages ~ Agile software development experience... 
    Language
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours
    Night shift

    STR

    Arlington, VA
    1 day ago
  • $50 per hour

     ...Rotary Mission Systems (RMS) AI Hub team, within Lockheed...  ...including computer vision, natural language processing, and generative...  ...pipelines, integrate large-language-model (LLM) capabilities, and drive...  ...Description For AI Machine Learning Engineering SeniorResponsible for... 
    Senior
    Language
    Full time
    Temporary work
    Work experience placement
    Casual work
    Flexible hours

    Lockheed Martin

    Bethesda, MD
    3 days ago
  •  ...Job Description Senior AI Security Engineer / Technical SETA SME...  ...systems, machine learning models, and supporting...  ...pipelines supporting large scale analytics and intelligence...  ...use of large language models, AI agents, and...  ...learning frameworks, LLM infrastructure, and cybersecurity... 
    Senior
    Language
    Full time
    For contractors
    Work experience placement

    TRIAEM, LLC

    Bethesda, MD
    14 days ago
  •  ...’s industry, data, and AI expertise with Palantir...  ...integrating consulting, engineering, and global delivery...  ...build applications on large structured and unstructured...  ...within Palantir (AIP, model deployment, feature engineering...  ...solutions with large language modelsDemonstrated... 
    Senior
    Language
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Arlington, VA
    3 days ago
  •  ...Apple is building the next generation of AI data center infrastructure to power large language model (LLM) services at scale. We are looking for a senior engineer to own the correctness consistency and stability of LLM inference in production. You will design and build... 
    Senior
    Language
    Full time

    Apple

    Washington DC
    4 days ago
  • $209k - $238.5k

     ...Overview Senior Manager, Data Science - Model Risk Office Data is at...  ...associated with Generative AI (GenAI). Leveraging...  ..., software engineering, and business, we strive...  ...comfortable with open-source languages and are passionate...  ...languages for large scale data analysis... 
    Senior
    Language
    Full time
    Part time
    Work at office
    Local area
    Flexible hours

    Capital One

    McLean, VA
    22 hours ago
  • $200k - $220k

     ...Position Overview AI/ML Engineer to join this role you...  ...evaluating machine learning models preparing datasets...  ...Technical Performance - Senior Skills: Supervised...  ...Experience with LLM engineering such as prompt...  ...Experience working with large language models and prompt... 
    Senior
    Language
    Full time
    Flexible hours

    Halvik

    McLean, VA
    5 days ago
  • $126k - $190k

     ...Position Overview: The Model Audit team in Internal...  ...and machine learning (AI/ML) models while influencing...  ...insights to senior stakeholders. This role...  ...algorithms. Programming languages may include—but are not...  ...Java, etc.Experience with large, complex financial institutions... 
    Senior
    Language
    Work experience placement
    Local area

    Freddie Mac

    McLean, VA
    1 day ago
  • $135k - $216k

     ...ResponsibilitiesPeraton is seeking Senior Information Systems Security Engineers to provide advanced security engineering...  ...Open Security Controls Assessment Language (OSCAL) based compliance automation...  ....Use of artificial intelligence (AI) tools of any kind during Peraton... 
    Senior
    Language
    Contract work
    Temporary work
    Shift work

    Peraton Corporation

    Washington DC
    4 hours ago
  •  ...high-caliber Site Reliability Engineer (SRE) to join our Forward...  ...that our complex, data-driven AI platforms remain resilient, scalable...  ...—bridging the gap between model development and production-...  ...-efficient performance for Large Language Models (LLMs). Pipeline Resilience... 
    Senior
    Language
    Local area

    Tiger Analytics Inc.

    Washington DC
    15 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI and Large Language Model (LLM) Engineer. Be the first to apply!