Senior Staff Machine Learning Engineer

Responsibilities

• Design, build, and optimize scalable machine learning infrastructure for training, evaluating, and deploying large language models.
• Build abstractions that automate steps across different machine learning workflows.
• Build and productionize infrastructure for state-of-the-art models and optimize ML system scalability, algorithms, and latency.
• Collaborate with engineering, data infrastructure, data analytics, machine learning, and product teams to develop new features.
• Drive best practices in machine learning and data engineering.

Requirements

• US citizenship or permanent resident status is required.
• 12+ years of industry experience in machine learning, infrastructure, or related fields is required.
• Experience with PyTorch, Hugging Face, or LLM-serving frameworks such as vLLM or TensorRT-LLM is required.
• Experience building and scaling end-to-end machine learning systems is required.
• Experience building scalable microservices and ETL pipelines is required.
• Expertise in Python and experience with a performant language such as C++ or Go is required.
• A bachelor’s degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field is required.
• Interest in machine learning and software engineering research publications is expected.
• Effective communication and cross-functional collaboration experience are required.

Benefits

• Regular employee position.
• Required to work in the office under the assigned work persona.
• The role is located in the AMS - North America and Canada region.
• ServiceNow offers flexible, remote, or required-in-office work personas depending on the role and location.