Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Engineer, Medical Vision Language Models

Full-time

US Radiology Specialists

Lumexa Imaging is one of the country's largest providers of outpatient medical imaging. With over 5,000 team members and more than 185 outpatient imaging centers across 13 states, our team conducts more than 4 million outpatient studies annually. We are the partner of choice for health systems and radiologists, delivering best-in-class clinical excellence, operations, and state-of-the-art technology across our platform.

Lumexa Imaging is hiring an early-career AI Engineer to help build, adapt, and deploy vision language models (VLMs) and imaging foundation models for clinical radiology. You will work hands-on using agentic coding tools (Claude Code, OpenAI Codex) to transition ideas from radiologists into validated, deployed models. This is a build-focused role centered on model development and deployment.

Initial priorities include building clinical LLM pipelines (prior report summarization, scanned document summarization, and relevant prior selection) on infrastructure shared with our VLM work.

Why this role is a rare opportunity: You will have access to a large, growing repository of clinical imaging and reporting data. A central part of this job is leveraging this real-world, domain-specific data, consistent with applicable privacy, security, and governance requirements, to develop, adapt, and evaluate AI models beyond what is possible using public data alone.

You will work closely with the Chief Clinical AI Officer, the Clinical Applications team, and Infrastructure and Information Security.

Essential Duties and Responsibilities:

-VLM Development and Adaptation: Fine-tune and adapt open VLMs (e.g., Qwen-VL, LLaVA-Med, MedGemma, InternVL) and imaging foundation models for report drafting, impression generation, finding detection, and prior comparison. Apply parameter-efficient methods (LoRA, QLoRA) and full fine-tuning under senior guidance.
- Vision Encoders and Representation Learning: Work with vision encoders, contrastive image-text models (CLIP, SigLIP), and self-supervised approaches (JEPA). Build and maintain embedding pipelines for retrieval, cohort discovery, case similarity search, and drift detection
- Data Curation: Curate and version datasets from our internal PACS and reporting systems, including DICOM header, burned-in pixel, and paired-report de-identification
- Agentic Engineering: Use Claude Code and OpenAI Codex daily to build, test, and maintain code. Maintain project context (CLAUDE.md, AGENTS.md), and help build and run MCP servers for internal system access
- Deployment and MLOps: Deploy models via containerized inference and GPU serving (vLLM, Triton), support CI/CD pipelines, and monitor production models for drift and performance
- Evaluation: Build automated evaluation harnesses for clinical accuracy, negation, laterality, and hallucination scoring against radiologist ground truth

- Workflow Automation: Build agentic and LLM driven tools for operational workflows, such as converting unstructured requests into RIS scheduling actions and supporting intelligent operations dashboards

Required Qualifications:

- Hands-on experience fine-tuning transformer models in PyTorch (vision, multimodal, or language) using Hugging Face, MONAI, or similar (via internships, research, open-source work, or projects)
- Working knowledge of embeddings and vector search
- Experience with open VLMs such as Qwen-VL or LLaVA
- Daily use of agentic coding tools (Claude Code, OpenAI Codex)
- Familiarity with Docker and GPU-based model serving
- Comfort working with real-world data and a reproducible approach to experiments

Preferred Qualifications:
- Hands-on experience with vision encoders and contrastive models (CLIP, SigLIP, JEPA)
- Exposure to medical VLMs, imaging foundation models, or self-supervised methods (DINOv2, MAE)
- Experience building MCP servers in Python or TypeScript
- Familiarity with medical imaging formats (DICOM, HL7, FHIR) and HIPAA/PHI handling
- Awareness of MLOps tooling (MLflow, Weights & Biases, model registries)
- Awareness of FDA considerations for clinical AI (510(k), PCCP)

Education/Licensing/Certification:

Degree in Computer Science, Biomedical Engineering, or a related field (or equivalent practical experience)

Experience (years and type):

Experience 0 to 3 years (internships, research, or projects count)

Travel Required (% of time): Minimal, up to 10%

Physical Requirements & Work Environment: Standard remote office work

Lumexa Imaging provides a competitive compensation program to attract, retain, and motivate a high-performance workforce.

Lumexa Imaging is an equal opportunity employer.

Vacancy posted 17 days ago
Similar jobs that could be interesting for youBased on the AI Engineer, Medical Vision Language Models in San Francisco, CA vacancy
  •  ...We are seeking an Founding Computer Vision Engineer – Multimodal AI & VLMs to join an early-stage technology...  ...layer, building and deploying vision-language systems that reason over images and...  ...computer vision techniques. Own model orchestration and production deployment... 
    Language
    Work at office
    Visa sponsorship

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    8 days ago
  •  ...Epsilon Health is transforming medical imaging and diagnostics by bringing frontier AI into clinical practice. We're...  ...Scientist to push the frontier of vision-language models for medical imaging. You'll...  ...small team of researchers and engineers, with the freedom to pursue... 
    Medical
    Language
    Full time

    epsilon-health

    San Francisco, CA
    9 days ago
  • $165.6k - $221k

     ...building the future of physical AI. Powered by a proprietary...  ...the living geospatial world model and the centimeter-level...  ...Role We're hiring an AI Engineer, Computer Vision, to contribute to the deep learning...  ...benefits package including medical, dental, and vision coverage... 
    Medical
    Internship
    Work at office
    Local area
    3 days per week

    Niantic Spatial, Inc.

    San Francisco, CA
    3 days ago
  •  ..., California. The Role: As a AI Engineer , you will be a core contributor to Zyphra...  ...document search and retrieval, and language/vision model integration. You’ll Work Across:...  ...Benefits and Perks: Comprehensive medical, dental, vision, and FSA plans Competitive... 
    Medical
    Language
    Work at office
    Relocation package

    Zyphra Technologies Inc

    San Francisco, CA
    2 days ago
  • $91k - $321.5k

     ...SummaryThe OpportunityAs a CTIO - AI Engineer- Senior Manager, you will...  ...analysis, statistical modeling, and creating data...  ...frameworks- Utilizing programming languages and machine learning...  ...range of benefits, including medical, dental, vision, 401k, holiday pay, vacation... 
    Medical
    Language
    Full time
    H1b

    PwC

    San Francisco, CA
    1 day ago
  •  ...business—until generative AI. Today, AI is the...  ...Advanced AI Engineer, you will design, build...  ...clients, combining custom models with cloud and third-...  ...Generative AI, and Large Language Models), designing...  ...of benefits including medical, dental, vision, life, and long-term... 
    Medical
    Language
    Work experience placement
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    San Francisco, CA
    4 days ago
  • $124k - $280k

     ...Senior Manager, Agentic Engineering Lead, you will guide...  ...and generative AI solutions for clients...  ...engineering, analytical modeling, prompt engineering,...  ...vector databases, natural language processing, and data...  ...benefits, including medical, dental, vision, 401k, holiday pay,... 
    Medical
    Language
    Full time
    H1b

    PwC

    San Francisco, CA
    5 days ago
  • $251k - $278k

     ...the TeamOpenAI’s Applied AI Engineering team helps organizations turn...  ...guide decisions involving model behavior, reliability,...  ...TypeScript, or another relevant language is valuable.Understand how...  ...the following benefits.Medical, dental, and vision insurance for you and your... 
    Medical
    Language
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  • $251k - $278k

     ...industries, OpenAI’s Applied AI Engineering (AIE) team helps...  ...and guide decisions about model behavior, reliability, latency...  ...TypeScript, or another relevant language is valuable.Know how to...  ...and the following benefits.Medical, dental, and vision insurance for you and your... 
    Medical
    Language
    Work at office
    Local area
    Remote work
    Relocation package
    Flexible hours
    3 days per week

    OpenAI

    San Francisco, CA
    1 day ago
  • $197k - $278k

     ...the teamThe Partner Applied AI Engineer team ensures the safe and...  ...our newest, most exciting models.About the roleWe are...  ...experience in programming languages like Python or Javascript....  ...and the following benefits.Medical, dental, and vision insurance for you and your... 
    Medical
    Language
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    2 days ago
  • $302k - $335k

    About the TeamThe Applied AI Engineering team is responsible for helping...  .... We use a hybrid work model of 3 days in the office...  ...fluency with programming languages such as Python or JavaScript...  ...and the following benefits.Medical, dental, and vision insurance for you and your... 
    Medical
    Language
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...unleashing the power of AI to create value at...  ...Song, Supply Chain and Engineering, and Talent, with...  ...AI-native operating model. Through partnerships...  ...solutions that ground Large Language Models using...  ...of benefits including medical, dental, vision, life, and long-term... 
    Medical
    Language
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    3 days ago
  •  ...building the leading AI-native platform for family...  ...a Senior Applied AI Engineer to design and build...  ...cases by combining models, retrieval, rules, state...  ...-on experience with language models, retrieval...  ...Choose from high-quality medical dental and vision options, including a... 
    Medical
    Language
    Full time
    Work experience placement
    Relocation

    Abby Care

    San Francisco, CA
    3 days ago
  • $215.25k - $287.91k

     ...SalesforceSalesforce is the #1 AI CRM, where humans...  ...agentic business models. Each has distinctive...  ...combining software engineering, applied AI, solution...  ...JavaScript, or comparable languages, with the ability to...  ...: time off programs, medical, dental, vision, mental health... 
    Medical
    Language
    Full time

    Salesforce

    San Francisco, CA
    2 days ago
  • $136.13k - $226.88k

     ...It is an ambitious vision that will require...  ...the cutting edge of AI and Machine...  ...Machine Learning Engineer to help make this...  ...machine learning models to elucidate the molecular...  ...Python (Programming Language), Test...  ...caregiver/parental and medical leave. If salary ranges... 
    Medical
    Language
    Work experience placement
    Internship
    Local area

    GSK LLP

    San Francisco, CA
    3 days ago
  • $94.4k - $293.8k

     ...with human-centered AI solutions and services...  ...Full Stack Agentic AI Engineer leader who focuses on...  ...working with AI / ML models in production at...  ...Experience working with language models like LLM's APIs...  ...of benefits including medical, dental, vision, life, and long-term... 
    Medical
    Language
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    2 days ago
  • $302k - $335k

    About the TeamThe Applied AI Engineering team partners closely with...  ...the strategy and operating model for the team, coach and...  ...fluency with programming languages such as Python or JavaScript...  ...and the following benefits.Medical, dental, and vision insurance for you and your... 
    Medical
    Language
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  • $119k - $299.93k

     ...Opportunity As part of the AI Engineering team within the Digital...  ...and optimizing algorithms, models, and systems to enable intelligent...  ...- Utilizing programming languages and data modeling for...  ...range of benefits, including medical, dental, vision, 401k, holiday pay,... 
    Medical
    Language
    Full time
    H1b

    PwC

    San Francisco, CA
    1 day ago
  • $148.19k - $231.98k

     ...SalesforceSalesforce is the #1 AI CRM, where humans...  ..., a clear operating model, and an adoption path...  ...close to Product, Engineering, Support, and...  ...automation.Programming languages such as Python, common...  ...: time off programs, medical, dental, vision, mental health support... 
    Medical
    Language
    Full time
    Work experience placement
    Immediate start
    Remote work

    Salesforce

    San Francisco, CA
    2 days ago
  • $77k - $202k

     ...a Senior Associate - Azure AI Engineer you will design and develop...  ...architectures from analytical modeling and prompt engineering...  ...Azure AI Services, and large language model APIs, you will build...  ...range of benefits, including medical, dental, vision, 401k, holiday pay,... 
    Medical
    Language
    Full time
    H1b

    PwC

    San Francisco, CA
    5 days ago
  • $160.05k - $266.75k

     ...offers a remote or hybrid working model, empowering you to find the...  ...approach to R&D](#) Senior AI/ML Engineer, Human Physiology Modeling...  ...Modeling, Python (Programming Language), Test Documentation ~ If you...  ...paid caregiver/parental and medical leave. If salary ranges are not... 
    Medical
    Language
    Full time
    Work at office
    Local area
    Remote work

    GSK

    San Francisco, CA
    3 days ago
  •  ...interactions into an engine for growth, moving...  ...end: we shape the vision and strategy for the...  ...customers.Service AI & Data puts AI at the...  ...building a value model, facilitating a stakeholder...  ...tradeoffs in plain language to client leaders...  ...benefits including medical, dental, vision,... 
    Medical
    Language
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    3 days ago
  • $251k - $278k

    About the teamThe Applied AI Engineering team is responsible for ensuring...  ...teams to turn frontier model capabilities into new...  ...JavaScript, TypeScript, or similar languages and are comfortable...  ...and the following benefits.Medical, dental, and vision insurance for you and your... 
    Medical
    Language
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  •  ...interactions into an engine for growth, moving...  ...end: we shape the vision and strategy for the...  ...customers.Service AI & Data puts AI at the...  ...foundation models, RAG pipelines, agents...  ...service data in plain language.Hold your FDEs to production...  ...benefits including medical, dental, vision,... 
    Medical
    Language
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    San Francisco, CA
    1 day ago
  •  ...interactions into an engine for growth, moving...  ...end: we shape the vision and strategy for the...  ...customers.Service AI & Data puts AI at the...  ...foundation models, RAG pipelines, agents...  ...technical choices in plain language to engineers and...  ...benefits including medical, dental, vision,... 
    Medical
    Language
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    San Francisco, CA
    3 days ago
  •  ...Health is transforming medical imaging and...  ...by bringing frontier AI into clinical practice...  ...exceptional Research Engineer or Research Scientist...  ...push the frontier of vision foundation models for medical imaging....  ...Knowledge of vision-language models, multimodal learning... 
    Medical
    Language
    Full time

    epsilon-health

    San Francisco, CA
    9 days ago
  • $127.2k - $201.3k

     ...currently seeking a Manager, AI Security Engineering Specialist to join our...  ...develop and execute AI models and agentsDesign...  ..., C#, Java, or similar languages, including production-grade...  ...includes 401(k) and medical and may include dental, vision, disability and life insurance... 
    Medical
    Language
    H1b
    Local area

    KPMG

    San Francisco, CA
    22 hours ago
  •  ...Description The Role: As a Research Engineer - Vision & Vision-Language Models , you will be a core contributor on Zyphra’...  ...We all enjoy what we do and love discussing AI Benefits and Perks: Comprehensive medical, dental, vision, and FSA plans Competitive... 
    Medical
    Language
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    9 days ago
  • $350k

     ...OpenAI Foundation AI is already changing how...  ...extraordinary benefits-faster medical breakthroughs,...  ...our mission. Advanced AI models will also present new challenges...  ...an AI Deployment Engineer to advise Foundation...  ...proficiency in programming languages such as Python, Java,... 
    Medical
    Language
    Work at office
    Flexible hours

    OpenAI Foundation

    San Francisco, CA
    2 days ago
  • $197.3k - $313.7k

     ...SalesforceSalesforce is the #1 AI CRM, where humans...  ...of Agentforce Voice Models, you will own the...  ...modeling, and the language-coverage roadmap that...  ...appropriateness of voice personas.Engineering Leadership & Team...  ...: time off programs, medical, dental, vision, mental health... 
    Medical
    Language
    Full time
    Worldwide
    Shift work

    Salesforce

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Engineer, Medical Vision Language Models. Be the first to apply!