Machine Learning Engineer - AI Evaluation & LLM Systems
$150.4k - $225.3kApple Inc.
Cupertino, California, United States Machine Learning and AI Join the team building the evaluation systems that enable Apple's next generation of AI experiences. As a Machine Learning Engineer, you will develop scalable infrastructure, intelligent evaluators, and data-driven methodologies that measure and improve the quality of large language models and multimodal AI systems used across Apple products.You’ll partner closely with ML researchers, software engineers, and product teams to design novel evaluation techniques, analyze model behavior, and translate research into production-ready systems. This role requires strong engineering fundamentals, a passion for machine learning, and the curiosity to solve challenging problems at the intersection of AI, data, and software engineering.If you’re excited about building the tools that help define the future of AI quality at Apple, we’d love to hear from you. Description As a Machine Learning Engineer, you will build the systems that measure and improve the quality of AI experiences used by millions of people. You will develop machine learning models, evaluation frameworks, and scalable infrastructure that enable teams to understand model behavior, identify regressions, and accelerate the development of large language models and multimodal AI. Working closely with researchers, software engineers, and product teams, you will transform cutting-edge research into production-ready solutions, analyze large-scale datasets, and develop new approaches for benchmarking and improving AI quality. This is a unique opportunity to solve challenging technical problems at the intersection of machine learning, software engineering, and data, while helping shape the future of AI at Apple. Responsibilities Design, develop, and deploy evaluation systems and scalable software that improve the quality of AI experiences. Build robust infrastructure to support model training, benchmarking, and large-scale evaluation. Analyze model performance, identify quality issues, and develop innovative techniques to measure and improve AI behavior. Collaborate with machine learning researchers, software engineers, and product teams to translate research into production-ready solutions. Drive technical excellence by contributing to architecture, code reviews, experimentation, and engineering best practices. Minimum Qualifications MS, or PhD in Computer Science, Machine Learning, Electrical Engineering, or a related technical field, or equivalent practical experience. 1-2 years of industry experience, or equivalent academic or internship experience, developing machine learning or AI solutions. Proficiency in Python and familiarity with C++ or another object-oriented programming language. Experience with one or more machine learning frameworks such as PyTorch, TensorFlow, or JAX. Understanding of machine learning fundamentals, including supervised learning, model evaluation, and statistical analysis. Experience working with data processing, model training, or experimentation through coursework, research, internships, or industry projects. Strong analytical, problem-solving, and communication skills with the ability to collaborate effectively in a team environment. Preferred Qualifications Experience with large language models (LLMs), multimodal AI, or generative AI through internships, research, or personal projects. Experience building software or machine learning projects using modern engineering practices (Git, testing, CI/CD). Familiarity with distributed computing, cloud platforms, or large-scale data processing. Publications, open-source contributions, or participation in machine learning competitions. MS or PhD specializing in Machine Learning, Artificial Intelligence, or a related field. At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $225,300, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. Comprehensive medical and dental coverage. Retirement benefits. A range of discounted products and free services. Reimbursement for certain educational expenses - including tuition. Discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant By welcoming as many perspectives as possible, we help you build a career where you feel like you belong. Learn about accessibility in Apple's workplace Learn about reasonable accommodations for job applicants Apple accepts applications to this posting on an ongoing basis. #J-18808-Ljbffr Apple Inc.
$237.6k - $401.7k
AIML - Sr Machine Learning Engineering Manager, Evaluation Cupertino, California, United States Machine Learning and AI Apple's AIML Evaluation team builds the systems and methodologies that measure and improve... ...agents, including benchmarks, LLM‑based evaluators,...SuggestedRelocation$224k - $356.5k
...boundaries of multimodal AI, simulation, and... ...building agentic systems that can reason about, build, evaluate, and improve AI... ...for exceptional engineers who are passionate... ...to accelerate how machine learning gets done. What you... ...Strong agency in LLM-based systems, such...Suggested$142.32k - $213.48k
...skilled and motivated Machine Learning Engineer to join our technology... ...that leverage Generative AI and Large Language... ...implementation of new AI-driven systems and programs that will... ...(POC) projects to evaluate and demonstrate the... ...Large Language Model (LLM) Fine-Tuning, ML...SuggestedFull time$128k - $316.8k
...26 TikTok Technology Machine Learning Engineer Graduate (E-Commerce... ...TikTok. We are building AI-native capabilities... ...context engineering, agent evaluation, and workflow... ...learning, retrieval systems, and software engineering... ...methods. Use NLP and LLM algorithms to handle...SuggestedTemporary workLocal area$161.7k - $234.15k
...with ease. The AI Foundations team... ...looking for an engineer to help develop... ...exposure to ML systems, and interest... ...analytics, and evaluation tooling. What... ...ML systems or LLM-based applications... ...willingness to learn from cross‑functional... ...Science, Machine Learning, Data...SuggestedTemporary workLocal areaWorldwide$104k - $156k
...Technologies, Inc. Job Area Engineering Group,... ...seeking an experienced Machine Learning Engineer... ...specializing in Generative AI to join our core... ...agent systems. Key Responsibilities... ...solutions to enhance LLM capabilities with... ...Create robust evaluation frameworks for measuring...Work from home- ...constant iteration. As AI makes execution faster... ...our Glassdoor page! Machine Learning Engineer @ Clay Clay's ambition... ...heart of the product: systems that learn a customer'... ...serving infrastructure. Evaluate new tools for their... ...designing eval frameworks for LLM or ML systems...
$165k - $225k
...you will build and improve machine learning and AI systems that automate customer... ...closely with experienced ML engineers, platform partners, and cross... ...unstructured data using LLM-powered workflows to produce... ...to define requirements, evaluate tradeoffs, and communicate...Work at officeRemote workFlexible hours- Texas About Us: Amira Learning accelerates literacy... ...and neuroscience with AI. As the leader in... ...s Intelligent Growth Engine, driving instructional... ...automated educational evaluation and learning systems leveraging speech recognition... ..., and operation of machine learning-powered...Remote workWorldwideRelocationFlexible hours
- ..., tasks that are not AI-native. Our mission is... ...task completion. The system must handle multi-... ...Role As a Principal Machine Learning Engineer, you are a deep technical... ...training, inference, evaluation, and infrastructure,... ...Experience Experience with LLM inference frameworks...
- ...looking for a Staff GenAI Engineer to join the Machine Learning Team specialised in voice... ...innovation and building AI-powered applications. In... ...reliability in distributed systems. Mentorship &... ...scale audio/voice models and LLM evaluations Strong background in scalable...Remote work
- Apple Inc. in Cupertino, California, is seeking a robotics engineer to design and implement AI/ML systems that address real-world problems, evaluate complex AI solutions, and integrate AI components into our software stack. The role requires a strong software engineering...Relocation package
- ...an experienced Senior Generative AI / Agentic AI Engineer to design, develop, and... ...APIs, data sources, and enterprise systems into production workflows. Evaluate AI solutions for accuracy, performance... ...Generative AI, Agentic AI, RAG, LLM, and automation technologies....
$184.7k - $324.8k
Machine Learning/ Search Engineer - Services Special Projects Cupertino, California... ...of Generative AI and Information Retrieval... ...innovative Search Systems Engineer to help... ...Build offline and online evaluation metrics, A/B testing... ...Runtime, TensorRT/TensorRT-LLM), and serving...Relocation$99k - $225k
Artificial Intelligence and Machine Learning Engineer The Opportunity: As... ...know that agentic AI is transforming how... ...build practical agentic systems that turn manual... ...patterns Knowledge of LLM platforms and providers... ...building agentic evaluation frameworks, test harnesses...Full timeContract workPart timeWork at officeLocal areaRemote workShift work- 10a Labs is seeking a Machine Learning Engineer to design, build, and evaluate advanced ML systems across AI safety and model evaluation applications. You will tackle problems involving reinforcement learning, language models, multimodal systems, and classifiers, turning...Remote job
- Staff Machine Learning Engineer, Agent Memory & Reasoning (University... ...Wand turns AI into labor. It enables... ...Build agent memory systems: not just picking what... ...working directly with LLM provider APIs (OpenAI... ...Experience with agent evaluation and benchmarking tooling...Full timeRemote workShift work
$124k - $195.5k
...784 Job Category Engineering Time Type Full time... ...we are developing AI-based products... ...looking for a talented Machine Learning Engineer to work on... ...inclusivity of our LLM models in a scalable... ...for training and evaluating models and end-to-end systems for Content Safety,...Full timeWork experience placement$150k
...Functions, Analytics Lab (Machine Learning Engineer) CIB Functions,... ...center of excellence in AI/Machine Learning... ...Generative AI and Agentic systems, enabling more... ...and libraries used for LLM / agentic workflows (... ...reranking, grounding, and evaluation approaches for RAG-...Summer workInternshipSummer internship- ...products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth... ..., and productionize high-quality machine learning models, services, and platforms to... ...workflow toolset such as tracing, evaluations, and guardrails; Must have strong...For contractors
$62k - $100k
...innovative ideas, such as AI-enabled insights and... ...the Role As an AI Engineering team member, you will... ...reviews and risk/security evaluations to uphold Crowe’s... ...with version control systems like Git. Strong ability... ...total rewards package. Learn more about what working...Local areaWorldwide- ...advanced analytics, automation, and AI-powered insights. We are seeking a Machine Learning Engineer (MLOps) to support the... ...testing and model performance evaluation in partnership with Data Science... ...translate models into production systems Technical Skills (Must-Have) Data...Full time2 days per week1 day per week
$118k - $176k
...live in the moment, learn about the world,... ...digital services. Snap Engineering teams build fun... ...'re looking for a Machine Learning Engineer... ..., model training, evaluation, and production... ...features Utilize AI tools and high velocity... ...evolving AI systems and tools to remain...Work experience placementLive inWork at officeLocal area$130k - $200k
...layer trusted by frontier AI labs, AI unicorns,... ...adversarial red teaming, model evaluations, and intelligence collection enable engineering, safety, and security... ...threats and deploy AI systems safely. About the Role We are seeking a Machine Learning Engineer to design,...Remote work$162k - $387.6k
...@2026 TikTok Technology Machine Learning Engineer Graduate (E-Commerce Recommendation... ...e-commerce recommendation systems that deliver high-quality,... ...of users. Develop AI-powered merchant operation... ...experimentation, model iteration, evaluation, and deployment....Temporary workWork experience placementInternshipLocal area$95.5k - $138.55k
...assessment, we’re advancing AI to move from insight... ..., including machine learning libraries such as NumPy... ...geographic information systems preferred Excellent written... ...Science, Technology, Engineering, or Mathematics field... ...quality issues Train, evaluate, refine, and deploy...Full time- ...Devices group. We study how AI systems perceive people and their... ...future products. Our work spans machine learning, sensing, and hardware,... ...looking for a machine learning engineer to help shape how future AI... ...Design data, training, and evaluation approaches that improve...Work at officeRelocation package3 days per week
$113k - $202k
...high-uncertainty challenges in AI, machine learning, computer vision, and... ...innovative Machine Learning Engineer to join the team responsible... ...testing pipelines to enhance system safety and performance in challenging... ...tractor initiative. Evaluate and improve model performance...Full timeImmediate startRemote workVisa sponsorship- TikTok USDS Joint Venture LLC is seeking a passionate graduate to join our team as an ML engineer focused on building LLM-based systems that process high‑dimensional unstructured data from diverse sources. You will define semantic understanding frameworks, including intent...
$165k - $225k
..., you’ll build and improve machine learning systems that make real‑time transaction... ...with experienced ML engineers, platform partners, and cross... ...Platform to define requirements, evaluate tradeoffs, and communicate... ...). Proficient in using AI‑powered developer tools (e....Work at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Engineer - AI Evaluation & LLM Systems. Be the first to apply!
- ai ml engineer Brooklyn, NY
- graduate machine learning engineer Brooklyn, NY
- senior ml engineer Brooklyn, NY
- machine learning ai engineer Brooklyn, NY
- computer vision machine learning engineer Brooklyn, NY
- data scientist machine learning engineer Brooklyn, NY
- machine learning engineer Brooklyn, NY
- machine learning software engineer Brooklyn, NY
- senior staff systems engineer Brooklyn, NY
- application system engineer Brooklyn, NY


