Senior Multimodal AI Evaluation Engineer
Luma AI
Luma AI is seeking a Research Engineer to design and scale the infrastructure powering model evaluation efforts. You will build pipelines, metrics, and automated systems that connect model output, evaluation, and improvement across research, engineering, and product teams. Ideal candidates have 5+ years in ML evaluation, strong Python skills, and experience with visual data and multimodal models. The role emphasizes scalable systems, CI/CD, and measurement-driven development. #J-18808-Ljbffr Luma AI
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Multimodal AI Evaluation Engineer in San Francisco, CA vacancy
- Gravity Engineering Services Pvt Ltd. is seeking engineers to design and develop multimodal transformer architectures that unify data from various sensors like camera, LiDAR,... ...Candidates should have a strong background in AI and relevant experience of over 4 years in...Senior
$200k - $250k
Fieldguide, a remote-first company based in San Francisco, is seeking a Senior AI Engineer to lead the evaluation infrastructure for AI agents. This role focuses on enhancing the reliability and performance of AI systems to support top accounting and consulting firms. The...SeniorRemote jobFlexible hours- ...company in San Francisco, CA, seeks an Applied AI Scientist to convert structured and unstructured multimodal clinical trial data into decision-grade intelligence... ..., or advanced predictive systems) and operates with strong engineering rigor. #J-18808-Ljbffr Panoptic BioSenior
- Cohere is seeking a technical staff member focused on multimodal AI. You will design and develop systems integrating text, speech, and vision... ...representation learning. The role emphasizes hands‑on engineering, scalable systems, and potential publications; remote‑friendly...SeniorRemote workWorldwide
$240k - $280k
A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably...Senior- ...has developed an artificial intelligence (AI) powered technology stack purpose-built... ...developing GigaFusionNet - a large-scale multimodal transformer that learns rich, joint representations... ...-based fusion. We are looking for engineers to push the boundaries of how transformer...Senior
$80 per hour
Prolific is seeking an AI & Machine Learning Engineer in San Francisco to evaluate and refine AI models. The role involves auditing ML code, providing human feedback on AI frameworks, and analyzing model reasoning. Candidates should have a relevant degree and experience...SeniorRemote jobHourly payWork from homeFlexible hours$176k - $253k
Harper is seeking a Senior Member of Technical Staff, AI Quality, in San Francisco. Your main goal will be... ...ensuring high standards through robust evaluation processes. You'll build capability... ...systems, and work directly with engineers to ensure our AI systems excel. Ideal...Senior- Skyrocket Ventures is looking for engineers who are proficient in Python and willing to learn new technologies. The role focuses on building and improving simulation and evaluation platforms for AI agents in San Francisco. Successful candidates will have 5-10 years of experience...Senior
- Applied Intelligence Consulting (Singapore) is building a next-generation AI Native Assistant focused on multimodal interaction and contextual intelligence. We seek software engineers to develop scalable systems and distributed architectures that enhance personalized AI...Senior
- Tavus is building AI Humans and seeks a Senior Software Engineer to drive the Conversational Video Interface. You will work at the intersection of live conversations between people and PALs, writing robust, real-time code in a hands-on role. Own end-to-end features, collaborate...Senior
- Luma AI is seeking a Research Scientist/Engineer to advance multimodal agent models across research and product integrations. You will explore modeling, data, systems and evaluation to push state-of-the-art capabilities. Join a team driving large-scale training with PyTorch...
$200k - $250k
...Senior AI Product Engineer Location: San Francisco, CA Company Stage of Funding: Series A AI Creator... ...through natural language. Design evaluation frameworks for non-deterministic AI... ...the latest foundation models, multimodal AI systems, and generative media technologies...SeniorWork at office3 days per weekRecruiting from Scratch
San Francisco, CA4 days ago- ...forefront of integrating modern AI and LLMs into the Oura... ...reasoning systems, and robust evaluation — not as “chatbots with vibes... ...months and years. As a Senior AI Engineer, you will design, build, and... ...on reasoning, planning, and multimodal use cases. Build robust, observable...SeniorTemporary workWork at officeLocal areaRemote workFlexible hours
- ...company is hiring builders to join our Multimodal AI group, an industry-leading team defining... ...we have yet to invent. As an engineer on the Multimodal AI team, you will work... ...immersive UIs, realtime audio processing, evaluation systems, backend infrastructure, and supporting...
- Sail is the foundation of useful, agentic AI. We are here to take a big swing at the most ambitious engineering challenge of our careers. Everyone working at Sail will become an expert; nothing less will do in our immensely competitive market. Inference is just one piece...SeniorWork at officeImmediate start
$159.2k - $301.6k
...exploring the next generation of AI-native creative systems that... ...looking for forward-thinking engineers who are excited to explore... ...approaches in agentic systems, multimodal AI, reusable creative... ...and user experience. Develop evaluation and quality frameworks for AI...SeniorTemporary workLocal areaWorldwide$115.4k - $173k
...Unity content into other game engines and 3D environments — in-... ...and orchestration by future AI-driven tools and systems. You... ...model training, data collection, evaluation loops, agents, tool use, or... ...tool interfaces, LLM agents, multimodal models, inference pipelines,...SeniorWork at officeWorldwideRelocation package$150k - $250k
Distyl is seeking an AI Evaluation Engineer to design evaluation systems for AI-driven solutions. Located in San Francisco, this position requires strong Python skills and a commitment to utilizing AI tools to enhance evaluation processes. The role offers a competitive...Work at office3 days per week- ...responsible and reliable AI systems, changing... ...class applied science and engineering teams to deliver our... ...agentic workflows: you will evaluate agentic frameworks... ...agent memory, multimodal guardrails, multimodal... ...Staff, Principal and Senior engineers, authoring technical...SeniorFull timePart timeWork at officeLocal area
- Mason AI is looking for a Founding AI/ML Engineer to expand solutions from California residential projects nationwide. This role emphasizes designing experiments for multimodal AI agents, with an immediate impact on building compliance. The ideal candidate thrives in ambiguity...Immediate start
$150k - $250k
About Distyl Distyl is an applied AI technology company partnering with the world’s most... ...For At Distyl, we build AI systems using Evaluation‑Driven Development—a process where... ...AI behavior in production. AI Evaluation Engineers design and implement the evaluation systems...Work at office3 days per week- A leading AI research organization in San Francisco is seeking a Research Engineer focused on pushing the boundaries of frontier models and AGI/ASI measurement. Candidates... ...to shape innovative AI measurements and build evaluation environments that drive progress. #J-18808-...
$350k
Mirendil is a tech-first company located in San Francisco, California, seeking a Research Engineer to develop evaluation infrastructure for AI models. You'll design frameworks that measure model capabilities, implement automated pipelines, and create workflows for inspecting...$225k - $280k
...’re partnering with a startup building AI powered systems to modernize a complex... ...driven outcomes. We are looking for a Senior AI Engineer open to working 3-4 days/week in San... ...retrieval pipelines, memory/context systems, evaluation layers, and workflow automation...SeniorLocal area3 days per weekJobot
San Francisco, CA1 day ago$314.8k - $359.3k
...Senior Distinguished AI Engineer At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital... ...model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Leverage...SeniorFull timePart timeLocal areaCapital One
San Francisco, CA4 days ago- United States Digital Space LLC is looking for a talented engineer to join its Multimodal AI team. In this role, you'll lead projects from conception to launch, working on innovative systems that redefine human-AI interactions. The position requires strong problem-solving...
- Ouraring Inc in San Francisco seeks a Senior AI Engineer to design and operate LLM-backed systems. Ideal candidates have strong AI engineering... ...components into user-facing features and ensuring workflow evaluation and quality. This position offers competitive salary...Senior
- Salesforce, Inc. is seeking a Senior / Lead Software Engineer focused on Database and Distributed Storage Engineering... ...modern engineering practices and AI. You will be responsible for system design and implementation, code evaluation, and using AI tools in development...Senior
- B Capital seeks a talented individual for an AI Evaluation role in San Francisco. This position involves conducting critical comparative analysis, refining evaluation systems, and collaborating with various teams to enhance model capabilities. The ideal candidate will have...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Multimodal AI Evaluation Engineer. Be the first to apply!
Related searches
- ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai research engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- senior trade analyst San Francisco, CA
- senior app developer San Francisco, CA