Machine Learning Engineer, Foundation Model Services

The Machine Learning Engineer for Foundation Model Services will help Apple build production-grade capabilities to serve large foundation models in real time. This role focuses on optimizing and deploying large language, vision, and speech models across multiple product experiences at Apple scale. Responsibilities Collaborate with product teams to create production-grade solutions that enable model-serving capabilities for customers in real time. Work with foundation model researchers to prototype and develop inference for advanced model architectures. Build tools to identify, measure, and remove performance bottlenecks across different hardware environments and use cases. Develop high-quality code and adapt quickly in a fast-moving field while taking on progressively larger system ownership areas. Requirements 2+ years of industry experience building and shipping production software and/or machine learning systems. Proficiency in a modern programming language such as Go or Python . Experience deploying and operating services on a cloud platform such as AWS , Azure , GCP , or an equivalent provider, using containers and Kubernetes / Docker . 5+ years of industry experience in machine learning technologies including LLMs , Machine Learning , NLP , Information Retrieval , and Statistics . Experience building or operating high-throughput, low-latency services. Strong communication and collaboration skills, including partnering across research and product teams. Bachelor’s degree or higher in Computer Science or a related technical field. Technologies Go, Python, AWS, Azure, GCP, containers, Kubernetes, Docker, Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server Preferred Qualifications Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, and Nvidia Triton Server. Benefits Comprehensive medical and dental coverage Retirement benefits Discounted products and free services Reimbursement for certain educational expenses, including tuition Discretionary employee stock programs, with the opportunity to become an Apple shareholder Eligibility for discretionary restricted stock unit awards Ability to purchase Apple stock at a discount through voluntary participation in the Employee Stock Purchase Plan Role may be eligible for discretionary bonuses or commission payments Relocation may be available Location and Employment Details Santa Clara, CA (onsite). Salary range: USD 175,000 - 308,500 per year. Minimum experience: 2 years . Education: Bachelor’s degree or higher in Computer Science or a related technical field. #J-18808-Ljbffr Apple