Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Engineer - AI Evaluation & LLM Systems

$150.4k - $225.3k

Apple Inc.

Cupertino, California, United States Machine Learning and AI Join the team building the evaluation systems that enable Apple's next generation of AI experiences. As a Machine Learning Engineer, you will develop scalable infrastructure, intelligent evaluators, and data-driven methodologies that measure and improve the quality of large language models and multimodal AI systems used across Apple products.You’ll partner closely with ML researchers, software engineers, and product teams to design novel evaluation techniques, analyze model behavior, and translate research into production-ready systems. This role requires strong engineering fundamentals, a passion for machine learning, and the curiosity to solve challenging problems at the intersection of AI, data, and software engineering.If you’re excited about building the tools that help define the future of AI quality at Apple, we’d love to hear from you. Description As a Machine Learning Engineer, you will build the systems that measure and improve the quality of AI experiences used by millions of people. You will develop machine learning models, evaluation frameworks, and scalable infrastructure that enable teams to understand model behavior, identify regressions, and accelerate the development of large language models and multimodal AI. Working closely with researchers, software engineers, and product teams, you will transform cutting-edge research into production-ready solutions, analyze large-scale datasets, and develop new approaches for benchmarking and improving AI quality. This is a unique opportunity to solve challenging technical problems at the intersection of machine learning, software engineering, and data, while helping shape the future of AI at Apple. Responsibilities Design, develop, and deploy evaluation systems and scalable software that improve the quality of AI experiences. Build robust infrastructure to support model training, benchmarking, and large-scale evaluation. Analyze model performance, identify quality issues, and develop innovative techniques to measure and improve AI behavior. Collaborate with machine learning researchers, software engineers, and product teams to translate research into production-ready solutions. Drive technical excellence by contributing to architecture, code reviews, experimentation, and engineering best practices. Minimum Qualifications MS, or PhD in Computer Science, Machine Learning, Electrical Engineering, or a related technical field, or equivalent practical experience. 1-2 years of industry experience, or equivalent academic or internship experience, developing machine learning or AI solutions. Proficiency in Python and familiarity with C++ or another object-oriented programming language. Experience with one or more machine learning frameworks such as PyTorch, TensorFlow, or JAX. Understanding of machine learning fundamentals, including supervised learning, model evaluation, and statistical analysis. Experience working with data processing, model training, or experimentation through coursework, research, internships, or industry projects. Strong analytical, problem-solving, and communication skills with the ability to collaborate effectively in a team environment. Preferred Qualifications Experience with large language models (LLMs), multimodal AI, or generative AI through internships, research, or personal projects. Experience building software or machine learning projects using modern engineering practices (Git, testing, CI/CD). Familiarity with distributed computing, cloud platforms, or large-scale data processing. Publications, open-source contributions, or participation in machine learning competitions. MS or PhD specializing in Machine Learning, Artificial Intelligence, or a related field. At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $225,300, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. Comprehensive medical and dental coverage. Retirement benefits. A range of discounted products and free services. Reimbursement for certain educational expenses - including tuition. Discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant By welcoming as many perspectives as possible, we help you build a career where you feel like you belong. Learn about accessibility in Apple's workplace Learn about reasonable accommodations for job applicants Apple accepts applications to this posting on an ongoing basis. #J-18808-Ljbffr Apple Inc.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Machine Learning Engineer - AI Evaluation & LLM Systems in Brooklyn, NY vacancy
  • $237.6k - $401.7k

    AIML - Sr Machine Learning Engineering Manager, Evaluation Cupertino, California, United States Machine Learning and AI Apple's AIML Evaluation team builds the systems and methodologies that measure and improve...  ...agents, including benchmarks, LLM‑based evaluators,... 
    Suggested
    Relocation

    Apple Inc.

    Brooklyn, NY
    2 days ago
  • $224k - $356.5k

     ...boundaries of multimodal AI, simulation, and...  ...building agentic systems that can reason about, build, evaluate, and improve AI...  ...for exceptional engineers who are passionate...  ...to accelerate how machine learning gets done. What you...  ...Strong agency in LLM-based systems, such... 
    Suggested

    NVIDIA

    Brooklyn, NY
    4 days ago
  • $142.32k - $213.48k

     ...skilled and motivated Machine Learning Engineer to join our technology...  ...that leverage Generative AI and Large Language...  ...implementation of new AI-driven systems and programs that will...  ...(POC) projects to evaluate and demonstrate the...  ...Large Language Model (LLM) Fine-Tuning, ML... 
    Suggested
    Full time

    Citigroup

    Jersey City, NJ
    3 days ago
  • $128k - $316.8k

     ...26 TikTok Technology Machine Learning Engineer Graduate (E-Commerce...  ...TikTok. We are building AI-native capabilities...  ...context engineering, agent evaluation, and workflow...  ...learning, retrieval systems, and software engineering...  ...methods. Use NLP and LLM algorithms to handle... 
    Suggested
    Temporary work
    Local area

    TikTok

    Brooklyn, NY
    3 days ago
  • $161.7k - $234.15k

     ...with ease. The AI Foundations team...  ...looking for an engineer to help develop...  ...exposure to ML systems, and interest...  ...analytics, and evaluation tooling. What...  ...ML systems or LLM-based applications...  ...willingness to learn from cross‑functional...  ...Science, Machine Learning, Data... 
    Suggested
    Temporary work
    Local area
    Worldwide

    Jobzhr

    Brooklyn, NY
    4 days ago
  • $104k - $156k

     ...Technologies, Inc. Job Area Engineering Group,...  ...seeking an experienced Machine Learning Engineer...  ...specializing in Generative AI to join our core...  ...agent systems. Key Responsibilities...  ...solutions to enhance LLM capabilities with...  ...Create robust evaluation frameworks for measuring... 
    Work from home

    Latitude

    Brooklyn, NY
    5 days ago
  •  ...constant iteration. As AI makes execution faster...  ...our Glassdoor page! Machine Learning Engineer @ Clay Clay's ambition...  ...heart of the product: systems that learn a customer'...  ...serving infrastructure. Evaluate new tools for their...  ...designing eval frameworks for LLM or ML systems... 

    AI Chopping Block

    Brooklyn, NY
    4 days ago
  • $165k - $225k

     ...you will build and improve machine learning and AI systems that automate customer...  ...closely with experienced ML engineers, platform partners, and cross...  ...unstructured data using LLM-powered workflows to produce...  ...to define requirements, evaluate tradeoffs, and communicate... 
    Work at office
    Remote work
    Flexible hours

    Jobzhr

    Brooklyn, NY
    3 days ago
  • Texas About Us: Amira Learning accelerates literacy...  ...and neuroscience with AI. As the leader in...  ...s Intelligent Growth Engine, driving instructional...  ...automated educational evaluation and learning systems leveraging speech recognition...  ..., and operation of machine learning-powered... 
    Remote work
    Worldwide
    Relocation
    Flexible hours

    Amira Learning

    Brooklyn, NY
    4 days ago
  •  ..., tasks that are not AI-native. Our mission is...  ...task completion. The system must handle multi-...  ...Role As a Principal Machine Learning Engineer, you are a deep technical...  ...training, inference, evaluation, and infrastructure,...  ...Experience Experience with LLM inference frameworks... 

    AI Chopping Block

    Brooklyn, NY
    4 days ago
  •  ...looking for a Staff GenAI Engineer to join the Machine Learning Team specialised in voice...  ...innovation and building AI-powered applications. In...  ...reliability in distributed systems. Mentorship &...  ...scale audio/voice models and LLM evaluations Strong background in scalable... 
    Remote work

    Apply

    Brooklyn, NY
    3 days ago
  • Apple Inc. in Cupertino, California, is seeking a robotics engineer to design and implement AI/ML systems that address real-world problems, evaluate complex AI solutions, and integrate AI components into our software stack. The role requires a strong software engineering... 
    Relocation package

    Apple Inc.

    Brooklyn, NY
    1 day ago
  •  ...an experienced Senior Generative AI / Agentic AI Engineer to design, develop, and...  ...APIs, data sources, and enterprise systems into production workflows. Evaluate AI solutions for accuracy, performance...  ...Generative AI, Agentic AI, RAG, LLM, and automation technologies.... 

    Dutech Systems

    Brooklyn, NY
    4 days ago
  • $184.7k - $324.8k

    Machine Learning/ Search Engineer - Services Special Projects Cupertino, California...  ...of Generative AI and Information Retrieval...  ...innovative Search Systems Engineer to help...  ...Build offline and online evaluation metrics, A/B testing...  ...Runtime, TensorRT/TensorRT-LLM), and serving... 
    Relocation

    Apple Inc.

    Brooklyn, NY
    2 days ago
  • $99k - $225k

    Artificial Intelligence and Machine Learning Engineer The Opportunity: As...  ...know that agentic AI is transforming how...  ...build practical agentic systems that turn manual...  ...patterns Knowledge of LLM platforms and providers...  ...building agentic evaluation frameworks, test harnesses... 
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work
    Shift work

    Booz Allen Hamilton

    Brooklyn, NY
    2 days ago
  • 10a Labs is seeking a Machine Learning Engineer to design, build, and evaluate advanced ML systems across AI safety and model evaluation applications. You will tackle problems involving reinforcement learning, language models, multimodal systems, and classifiers, turning... 
    Remote job

    Jobzhr

    Brooklyn, NY
    1 day ago
  • Staff Machine Learning Engineer, Agent Memory & Reasoning (University...  ...Wand turns AI into labor. It enables...  ...Build agent memory systems: not just picking what...  ...working directly with LLM provider APIs (OpenAI...  ...Experience with agent evaluation and benchmarking tooling... 
    Full time
    Remote work
    Shift work

    Wand Inc.

    Brooklyn, NY
    5 days ago
  • $124k - $195.5k

     ...784 Job Category Engineering Time Type Full time...  ...we are developing AI-based products...  ...looking for a talented Machine Learning Engineer to work on...  ...inclusivity of our LLM models in a scalable...  ...for training and evaluating models and end-to-end systems for Content Safety,... 
    Full time
    Work experience placement

    Jobzhr

    Brooklyn, NY
    2 days ago
  • $150k

     ...Functions, Analytics Lab (Machine Learning Engineer) CIB Functions,...  ...center of excellence in AI/Machine Learning...  ...Generative AI and Agentic systems, enabling more...  ...and libraries used for LLM / agentic workflows (...  ...reranking, grounding, and evaluation approaches for RAG-... 
    Summer work
    Internship
    Summer internship

    BNP Paribas

    Jersey City, NJ
    1 day ago
  •  ...products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth...  ..., and productionize high-quality machine learning models, services, and platforms to...  ...workflow toolset such as tracing, evaluations, and guardrails; Must have strong... 
    For contractors

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  • $62k - $100k

     ...innovative ideas, such as AI-enabled insights and...  ...the Role As an AI Engineering team member, you will...  ...reviews and risk/security evaluations to uphold Crowe’s...  ...with version control systems like Git. Strong ability...  ...total rewards package. Learn more about what working... 
    Local area
    Worldwide

    Latitude

    Brooklyn, NY
    4 days ago
  •  ...advanced analytics, automation, and AI-powered insights. We are seeking a Machine Learning Engineer (MLOps) to support the...  ...testing and model performance evaluation in partnership with Data Science...  ...translate models into production systems Technical Skills (Must-Have) Data... 
    Full time
    2 days per week
    1 day per week

    Darwill

    Brooklyn, NY
    2 days ago
  • $118k - $176k

     ...live in the moment, learn about the world,...  ...digital services. Snap Engineering teams build fun...  ...'re looking for a Machine Learning Engineer...  ..., model training, evaluation, and production...  ...features Utilize AI tools and high velocity...  ...evolving AI systems and tools to remain... 
    Work experience placement
    Live in
    Work at office
    Local area

    Relha LLC

    Brooklyn, NY
    2 days ago
  • $130k - $200k

     ...layer trusted by frontier AI labs, AI unicorns,...  ...adversarial red teaming, model evaluations, and intelligence collection enable engineering, safety, and security...  ...threats and deploy AI systems safely. About the Role We are seeking a Machine Learning Engineer to design,... 
    Remote work

    Jobzhr

    Brooklyn, NY
    1 day ago
  • $162k - $387.6k

     ...@2026 TikTok Technology Machine Learning Engineer Graduate (E-Commerce Recommendation...  ...e-commerce recommendation systems that deliver high-quality,...  ...of users. Develop AI-powered merchant operation...  ...experimentation, model iteration, evaluation, and deployment.... 
    Temporary work
    Work experience placement
    Internship
    Local area

    TikTok

    Brooklyn, NY
    3 days ago
  • $95.5k - $138.55k

     ...assessment, we’re advancing AI to move from insight...  ..., including machine learning libraries such as NumPy...  ...geographic information systems preferred Excellent written...  ...Science, Technology, Engineering, or Mathematics field...  ...quality issues Train, evaluate, refine, and deploy... 
    Full time

    Moody's Investors Service

    Brooklyn, NY
    2 days ago
  •  ...Devices group. We study how AI systems perceive people and their...  ...future products. Our work spans machine learning, sensing, and hardware,...  ...looking for a machine learning engineer to help shape how future AI...  ...Design data, training, and evaluation approaches that improve... 
    Work at office
    Relocation package
    3 days per week

    Triwill Group

    Brooklyn, NY
    4 days ago
  • $113k - $202k

     ...high-uncertainty challenges in AI, machine learning, computer vision, and...  ...innovative Machine Learning Engineer to join the team responsible...  ...testing pipelines to enhance system safety and performance in challenging...  ...tractor initiative. Evaluate and improve model performance... 
    Full time
    Immediate start
    Remote work
    Visa sponsorship

    Remote Genie

    Brooklyn, NY
    1 day ago
  • TikTok USDS Joint Venture LLC is seeking a passionate graduate to join our team as an ML engineer focused on building LLM-based systems that process high‑dimensional unstructured data from diverse sources. You will define semantic understanding frameworks, including intent... 

    Latitude

    Brooklyn, NY
    5 days ago
  • $165k - $225k

     ..., you’ll build and improve machine learning systems that make real‑time transaction...  ...with experienced ML engineers, platform partners, and cross...  ...Platform to define requirements, evaluate tradeoffs, and communicate...  ...). Proficient in using AI‑powered developer tools (e.... 
    Work at office
    Remote work
    Flexible hours

    Affirm, Inc.

    Brooklyn, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Engineer - AI Evaluation & LLM Systems. Be the first to apply!