ML Evaluation Scientist: Foundation & Multimodal Models
Apple Inc.
Apple Inc. is seeking an expert in evaluating machine learning and deep learning models, including foundation models and multimodal systems. You will craft robust evaluation frameworks, using traditional statistics and LLMs as judges to assess tasks like summarization and multimodal generation. The role requires strong Python expertise and a deep understanding of statistical methods, data quality, and model robustness, collaborating with ML engineers, data scientists, and ML infrastructure teams #J-18808-Ljbffr Apple Inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the ML Evaluation Scientist: Foundation & Multimodal Models in Sunnyvale, CA vacancy
- Institute of Foundation Models, operating the AllWorld Team at MBZUAI, seeks researchers to develop the PAN world... ...engineering and research to push state-of-the-art multimodal AI. Candidate requirements include MSc/PhD in ML or CS, hands-on experience with video generative...Foundation
$184k - $287.5k
...are seeking passionate researchers to advance longitudinal multimodal foundation models for healthcare. Recent progress in medical AI has improved... ..., healthcare organizations, and industry partners to evaluate new ideas and translate successful research into software,...FoundationFull time$184.7k - $324.8k
Research Scientist / Engineer, Foundation Model Evaluation Cupertino, California, United States Software and Services We build frontier foundation models that... ...analysis Proficiency in Python and experience with ML frameworks (PyTorch, JAX, or equivalent) Demonstrated...FoundationRelocation$192k - $304.75k
We are now looking for a Senior Research Scientist focused on Multimodal Foundation Models and Robotics! NVIDIA is searching for an outstanding research scientist to build humanoid robot foundation models and systems in the Generalist Embodied Agent Research (GEAR) group...FoundationFull time- Apple Inc. is seeking a Research Scientist/Engineer to design evaluation systems for foundation models powering Apple products. You will work hands‑on across evaluation design, experimentation, and cross‑team collaboration to drive model improvement and product quality....Foundation
$160.36k - $240.54k
...experience and a flexible, partner-led business model, Nuro is working toward a future where... ...generation.Build generative models with foundation models. Leverage large language models... ...and develop solutions to solve them, evaluate your solution by deploying the models on...FoundationImmediate startFlexible hours$192k - $304.75k
...seeking an outstanding Research Scientist or Research Engineer with a... ...training autonomous driving models of tomorrow. As part of... ...data to improve the training, evaluation, and generalization of end-to... ..., vision-language models, foundation models, or reasoning for embodied...FoundationFull time$184k - $287.5k
...Senior Deep Learning Scientists to advance our... ...streaming and agentic multimodal AI. You will demonstrate foundational expertise in deep... ...to help develop models capable of reasoning... ...high-quality evaluation of model accuracy,... ...Strong knowledge of ML/DL techniques and...FoundationFull timeWork experience placement$192.2k - $260k
...for a Senior Applied Scientist to help drive the research... ...of real-time multimodal conversational AI. You... ...focus areas: advancing foundation models for speech and audio,... ...generation - Design evaluation frameworks that capture... ...-source speech/audio ML systems or widely...FoundationLocal areaFlexible hours$170.7k - $300.2k
...directions in the field of multimodal foundation models that will inspire the future... ...and deeply technical scientists and engineers to develop state... ...data curation to modeling, evaluation, and deployment. This is a... ...design and deliver complex ML solutions. Proven ability...FoundationRelocation$165k - $195k
...and wireless, as well as advanced MEMS design.As a part of the global research, our AI research in Silicon Valley focuses on Foundation Models, Natural Language Processing, Computer Vision & Mixed Reality, Cloud Robotics, Big Data Visual Analytics, Explainable AI (XAI)...FoundationFull timeWork experience placementLocal areaWorldwide$192.2k - $260k
...at Amazon's Delivery Foundation Model team, where you'll work... ...world-class scientists and engineers to pioneer... ...extensive training and evaluation infrastructure- Guide... ...model development, from multimodal training using images... ...production ML deployments- Experience...FoundationLocal areaWorldwideFlexible hours$190k - $250k
...scale generative world models that learn to predict... ...capability serves as the foundation for scalable closed-... ...for a research scientist to lead the design and... ...approachesBuild methods for joint multimodal generation that... ...and radar outputsDesign evaluation frameworks that...FoundationTemporary workWork at officeVisa sponsorship- A leading technology company in Santa Clara seeks a Machine Learning Researcher for its AIML Multimodal Foundation Model Team. You will develop advanced multimodal foundation models and agent capabilities for Apple's products. Ideal candidates possess a PhD or MS in a relevant...Foundation
- ...state-of-the-art research in data-centric machine learning for multimodal foundation models. You will build data curation and annotation frameworks and... ...-on research with Python, PyTorch or Jax, and a strong background in CV, NLP, and ML. #J-18808-Ljbffr shefsolutionsllcFoundation
- Pika is seeking a Research Scientist to lead the development of large-scale multimodal foundation models, focusing on pre-training and mid-training. You will design novel algorithms, curate data, and drive production-ready implementations in collaboration with engineering...Foundation
- About the Institute of Foundation Models We are a dedicated research lab for building, understanding... ...‑scale clusters. Develop metrics and evaluation benchmarks to better assess model... ...optimize infrastructure for training multimodal LLMs and video diffusion models at massive...FoundationVisa sponsorship
$185k - $215k
...research in Silicon Valley focuses on Foundation Models, Big Data Visual Analytics, Explainable... ...Job Description As a Senior Research Scientist - Vision‑Language‑Action (VLA) Models,... ...Hands‑on experience building and applying multimodal transformer‑based sequence‑to‑sequence...FoundationWork experience placementLocal areaWorldwide- About the Institute of Foundation Models We are a dedicated... ...class researchers, data scientists, and engineers,... ...advancing state‑of‑the‑art multimodal foundation models... ...and post‑training, and evaluation benchmarks. The role... ...techniques. Experience with ML infrastructure,...Foundation
- ...looking for a Research Scientist to join the Multi-... ...member. MEGA is building foundation models for general-purpose... ...pipelines, designing evaluations and deploying... ...world and action models, multimodal and omni models, video... ...research scientists, ML engineers, roboticists...FoundationFull timeWork from home
$151.8k - $218.21k
...identify key technologies, develop a robust, high quality system, and quantitatively evaluate performance. As part of the team, you will be surrounded and supported by the significant core ML, cloud, software, and hardware expertise at TRI, and be a part of TRI's positive...Foundation$174k - $252k
...outcomes.Design architectures for multimodal AI models and set up tests to deploy... ...datasets and maintaining evaluation systems.Communicate... ...machine learning research, foundation models (e.g. LLMs, VLMs, time... ...types of work. As a Research Scientist, you'll setup large-scale tests...Foundation- ...Content Representation Models team creates a... ...by developing foundation models that understand... ...for a Research Scientist specializing in embeddings... ...-of-the-art AI/ML techniques,... ...offline experiments and evaluations to validate new... ...computer vision or multimodal AIIndustry experience...FoundationHourly payFull timeImmediate startFlexible hours
$192.2k - $260k
...talented, and inventive Applied Scientist with a strong machine... ...technology in generative AI and foundational models.As part of our AI team in... ...Join our dynamic team of AI/ML practitioners and applied scientists... ...and development of agentic evaluation frameworks and evaluation/...FoundationLocal areaWorldwideFlexible hours- STRATOS Search in California is seeking an experienced ML researcher to help build multimodal foundation models that fuse time-series sensor data with language,... ..., experimental design, model development, evaluation, and deployment, working end-to-end on real-world...Foundation
- Apple in Sunnyvale is seeking a Multimodal AI Researcher to push the boundaries of foundation models for real-time multimodal data, including video, audio, and text. You will work on interactive models, audio-to-audio modeling, and streaming multimodal systems, driving...Foundation
- Odyssey is an AI lab pioneering world models that learn to predict and interact with the... ...horizons. We seek a staff-level or senior ML researcher who defines problems, mentors... ...generative modeling, video synthesis, and multimodal learning. You’ll own a long-horizon agenda...
$204k - $259k
...Research Scientist, RL for Autonomous Planning & World Modeling Waymo is an autonomous driving technology... ...of the Waymo AI Foundations team is to develop machine... ...learning, and robust evaluation. In this hybrid role... ...open-source ML projects Experience...FoundationFull timeTemporary workRemote workWaymo
Mountain View, CA1 day ago$182.6k - $216.7k
...environments. As Applied Scientist, you work on the... ..., and into models that run in... ...control, planning, or evaluation ~ Take problems... ...~ Strong foundation in machine learning... ...Python and modern ML frameworks and toolchains... ...in one of: multimodal ML, generative AI,...FoundationLocal areaSiemens
Santa Clara, CA23 hours ago- ...understanding, perception, digital humans, multimodal generative AI, and agents. Our... ...collaborate with world-class experts in AI, ML, Software, and Hardware to tackle fundamental... ...with a strong background in developing foundation models for generative AI and multimodal...Foundation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Evaluation Scientist: Foundation & Multimodal Models. Be the first to apply!
Related searches
- scientist ii Sunnyvale, CA
- scientist 1 Sunnyvale, CA
- image scientist Sunnyvale, CA
- qc scientist Sunnyvale, CA
- research scientist Sunnyvale, CA
- analytical scientist Sunnyvale, CA
- research scientist - biology Sunnyvale, CA
- quality control scientist Sunnyvale, CA
- applied scientist Sunnyvale, CA
- manufacturing scientist Sunnyvale, CA