Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Multimodal AI Researcher

Ova Technologies

Job Description

Job Description

Multimodal AI Researcher Job Title

Multimodal AI Researcher

Job Summary

We are looking for a highly motivated Multimodal AI Researcher to advance the development of AI systems capable of understanding and reasoning across multiple data modalities, including text, images, audio, video, and structured data. The ideal candidate will have a strong research background in machine learning, deep learning, computer vision, natural language processing, and multimodal foundation models. You will collaborate with research scientists and engineering teams to build innovative AI solutions and translate cutting-edge research into production-ready applications.

Key Responsibilities
  • Conduct research on multimodal AI models integrating text, images, audio, video, and other data modalities.

  • Design, implement, and evaluate state-of-the-art multimodal architectures, including vision-language models (VLMs), multimodal large language models (MLLMs), and cross-modal retrieval systems.

  • Develop and optimize models for tasks such as image captioning, visual question answering (VQA), document understanding, speech-text understanding, video understanding, and multimodal reasoning.

  • Fine-tune, evaluate, and benchmark foundation models using domain-specific datasets.

  • Design scalable training and inference pipelines for multimodal AI applications.

  • Collaborate with machine learning engineers, data scientists, software engineers, and product teams to deploy research into production.

  • Conduct experiments, analyze results, and publish technical reports or research papers where applicable.

  • Stay current with the latest advancements in multimodal AI, foundation models, and generative AI.

Required Qualifications
  • Master's or Ph.D. in Computer Science, Artificial Intelligence, Machine Learning, Computer Vision, Natural Language Processing, or a related field.

  • 3 years of experience in AI/ML research or applied machine learning.

  • Strong understanding of:

    • Deep Learning

    • Transformer architectures

    • Vision Transformers (ViTs)

    • Contrastive Learning

    • Representation Learning

    • Cross-modal Attention

    • Self-Supervised Learning

    • Foundation Models

  • Proficiency in Python.

  • Experience with PyTorch or TensorFlow.

  • Hands-on experience with Hugging Face Transformers and multimodal model development.

  • Strong knowledge of computer vision, natural language processing, and machine learning fundamentals.

  • Experience with distributed training and GPU optimization.

  • Familiarity with Git, Docker, Linux, and cloud platforms (AWS, Azure, or Google Cloud).

Preferred Qualifications
  • Experience with vision-language models such as CLIP, BLIP, LLaVA, Florence, or Qwen-VL.

  • Experience with multimodal large language models (MLLMs) and retrieval-augmented generation (RAG).

  • Familiarity with speech and audio models, including Whisper or similar architectures.

  • Experience working with image, video, document, or medical imaging datasets.

  • Publications in top AI conferences such as NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV, ACL, EMNLP, or NAACL.

  • Experience contributing to open-source AI projects.

Technical Skills
  • Python

  • PyTorch / TensorFlow

  • Hugging Face Transformers

  • OpenCV

  • CUDA

  • DeepSpeed

  • Ray

  • NumPy

  • Pandas

  • Git

  • Docker

  • Kubernetes (preferred)

  • Linux

  • SQL

  • AWS / Azure / Google Cloud

Soft Skills
  • Strong research, analytical, and problem-solving skills.

  • Excellent communication and technical writing abilities.

  • Ability to collaborate across multidisciplinary teams.

  • Curiosity and passion for advancing AI research.

  • Strong experimentation and debugging skills.

Nice to Have
  • Experience with multimodal RAG systems.

  • Knowledge of AI agents and agentic workflows.

  • Familiarity with vector databases such as Pinecone, Milvus, Weaviate, or FAISS.

  • Experience with MLOps, model serving, and CI/CD pipelines.

  • Knowledge of reinforcement learning and reinforcement learning from human feedback (RLHF).

  • Experience with synthetic data generation and evaluation frameworks.

Benefits
  • Competitive salary and performance-based incentives.

  • Flexible work arrangements.

  • Comprehensive health and wellness benefits.

  • Learning and conference sponsorship opportunities.

  • Access to high-performance GPU infrastructure.

  • Opportunity to work on cutting-edge AI research with a collaborative team.

Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Multimodal AI Researcher in New York, NY vacancy
  • $218.7k - $249.6k

    Applied Researcher 4 (AI Foundations: Multimodal Guardrails and VLM‘s) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent... 
    Suggested
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    New York, NY
    3 days ago
  • $155k - $185k

     .... Reality Defender is an award-winning AI company that develops models to help enterprises...  ...before adversaries do. As a Red Team Researcher, you'll get your hands on the newest...  ...-time face swaps, injection attacks, multimodal impersonations — use them the way real attackers... 
    Suggested
    Full time
    Temporary work
    Work at office
    Local area
    Remote work

    Reality Defender

    New York, NY
    23 days ago
  • Mecka AI in New York seeks an experienced Research Scientist to advance large-scale vision-language and multimodal foundation models. You will work on model training, post-training, reinforcement learning, and multimodal reasoning, translating research breakthroughs into... 
    Suggested

    Mecka

    New York, NY
    1 day ago
  • $218.7k - $249.6k

    Applied Researcher 4 (AI Foundations - LLM, Optimization and Finetuning) Overview: At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create... 
    Suggested
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    New York, NY
    3 days ago
  • $262.5k - $299.6k

    Applied Researcher 5 (AI Foundations, LLM Core and Agentic AI) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent... 
    Suggested
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    New York, NY
    3 days ago
  • $262.5k - $299.6k

    Applied Researcher 5 (AI Foundations: Evaluation and Agentic Workflows) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent... 
    Full time
    Part time
    Work at office
    Local area
    Flexible hours

    Capital One

    New York, NY
    3 days ago
  • $218.7k - $249.6k

    Applied Researcher 4 (AI Foundations, LLM Core and Agentic AI) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent... 
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    New York, NY
    3 days ago
  • $135k - $170k

     ...Principal Researcher - AI/ML Market Intelligence Fractal Analytics is a strategic analytics partner to the most admired Fortune 500 companies globally and helps them power every human decision in the enterprise by bringing analytics & AI to the decision-making process... 
    Hourly pay
    Full time
    Local area
    Remote work
    Shift work

    Fractal

    New York, NY
    26 days ago
  • $300k

     ...AI Researcher - Reinforcement Learning & Post-Training $300,000–$500,000 base + meaningful equity New York, San Francisco or Seattle | Hybrid, three days in office We’re partnering with a well-funded, early-stage AI research company working directly with leading... 
    Full time
    Work at office
    Visa sponsorship

    Surge Group

    New York, NY
    1 day ago
  • $30 per hour

    Prolific seeks Advanced Italian Speakers to help train AI models. You will complete tasks involving analyzing and writing in Italian, with pay set at $30/hr for tasks lasting up to one hour. Successful candidates will enjoy flexible hours and can work from home. A skills... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    16 hours ago
  • $216.3k - $280.8k

     ...TeamThe Splunk Agent Resilience team is defining the future of AI resilience. Our team provides scalable, cost-effective evaluation...  ...observability and control.Your ImpactYou will independently own applied research problems that help organizations understand, evaluate, and... 
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours

    CISCO Systems

    New York, NY
    8 hours ago
  • $200k - $300k

    Hudson River Trading (HRT) is seeking an LLM-focused AI Researcher to join the HAIL team. HAIL (HRT AI Labs) is the team at HRT responsible for developing and maintaining our most powerful AI models, which are used by our trading teams to drive a significant fraction of... 
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    2 days ago
  • $200k - $300k

    Hudson River Trading (HRT) is hiring an AI Researcher to join the HAIL team. HAIL (HRT AI Labs) is the team at HRT responsible for developing and maintaining our most powerful models, which are used by our trading teams to drive a significant fraction of our trading. We... 
    Work experience placement
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    2 days ago
  • Truelancer AI is looking for PhD researchers and early-career scientists in Life Sciences to participate in a large-scale AI research, scientific data validation, and quality evaluation project . If you have a strong research background and enjoy working with scientific... 
    Contract work
    Remote work
    Flexible hours

    Truelancer AI

    New York, NY
    2 days ago
  • Aitrainergigs is seeking a Tamil language specialist to help shape the future of AI by evaluating language models with a focus on phonetics, syntax, and semantics. The role involves challenging models on noun declension, verb conjugation, sentence structure, and dialectal... 
    Remote job

    Meridial

    New York, NY
    1 day ago
  • AuraOne is seeking a Domain Researcher, Legal to remotely evaluate AI outputs used in legal review workflows. You will grade citations, assess statutory reasoning, and document corrected analyses for training the modeling team. Responsibilities include verifying authorities... 
    Remote job
    Hourly pay
    For contractors

    Auraone

    New York, NY
    2 days ago
  • Trace is seeking a researcher to tackle core problems in robot learning, focusing on how to structure real-world data for training and how to train and evaluate models on that data. You will report to the Chief Scientist and conduct frontier research on data quality with... 

    Trace

    New York, NY
    3 days ago
  •  ...banking professional to design Excel-based financial models for AI evaluation projects. The role is fully remote with a flexible schedule...  ...position emphasizes independence, data integrity, and timely delivery in a fast-moving AI research context. #J-18808-Ljbffr Jobgether
    Remote job
    Flexible hours

    Jobgether

    New York, NY
    2 days ago
  • AuraOne is seeking a Bilingual Dutch (Belgium) STEM Expert (PhD) to work remotely as a contractor on AI Safety red-teaming. You will craft adversarial prompts, document failures, and pair each jailbreak with the violated rubric clause so the safety team can patch gaps.... 
    Remote job
    Hourly pay
    For contractors

    Auraone

    New York, NY
    16 hours ago
  • Aptura is an applied AI and data company that trains frontier AI systems using real professional work through evaluation and training environments. We are seeking a candidate with 3+ years in accounting, audit, or financial reporting under IFRS or US GAAP and deep Excel... 

    Optura

    New York, NY
    1 day ago
  • Responsibilities Design expert-level financial research and analysis tasks inspired by real-world finance workflows Create complex modeling...  ...analysis and capital allocation Identify weaknesses in advanced AI models by evaluating their calculations and financial... 

    Julius Research

    New York, NY
    2 days ago
  • Prime Intellect, Inc. is building open frontier AI infrastructure and a full-stack platform for post-training at frontier scale, from...  ..., evaluating long-horizon tasks, and deploying measurable research into production. You will work externally with customers and partners... 

    Prime Intellect, Inc.

    New York, NY
    1 day ago
  • $27.5 per hour

    DigiNo is seeking a freelance AI training contributor for remote coding tasks. The role pays $27.50 per hour and is open to candidates in the United States, United Kingdom, and two more countries. Work is fully remote; applicants must reside in Australia, Canada, the United... 
    Remote job
    Hourly pay
    Freelance

    Meridial

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking a Domain Researcher, Legal to evaluate AI outputs in legal review workflows. You will assess citations, jurisdictional reasoning, and policy adherence, flag risks, and document corrected analyses for training. This remote, contractor role requires... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  • Truelancer AI is seeking PhD researchers and early-career scientists in Life Sciences to join a large-scale AI research, scientific data validation, and quality evaluation project. This remote, project-based role offers flexible hours (25-35 hrs/week) and collaboration... 
    Remote job
    Flexible hours

    Truelancer AI

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking a Domain Researcher, Finance to remotely evaluate AI outputs across finance and risk workflows. The contractor reviews calculations, citations, and policy adherence, flags issues, and documents corrections to train the modeling team. Responsibilities... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  •  ...summarize, and analyze complex content, then craft scenarios to train large language models. You will validate claims through online research and interact with LLMs to improve analyst capabilities. The role emphasizes multilingual communication (English and Japanese),... 
    For contractors
    Remote work
    Flexible hours

    Turing

    New York, NY
    1 day ago
  • Crossing Hurdles is seeking a senior researcher to design challenging microbiome and metagenomics problems with verifiable solutions. You will review AI model outputs for scientific accuracy, develop rubrics grounded in primary literature, and apply expertise in metagenomics... 
    Remote job

    Crossing Hurdles

    New York, NY
    3 days ago
  •  ...compensation models and people analytics in Excel. You will translate real-world experiences into realistic Excel tasks, and you will evaluate AI performance against precise criteria. Candidates should have 3+ years in related roles, deep Excel expertise, and strong written... 
    Remote job

    Aptura

    New York, NY
    3 days ago
  • $60 per hour

     ...Responsibilities Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws. Author questions and...  ..., finance, journalism, or technology/industry history. Advanced research skills with a track record of verifying complex claims against authoritative... 
    Remote job
    Contract work

    Crossing Hurdles

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Multimodal AI Researcher. Be the first to apply!