Principal ML Engineer
$200k - $250kZeroDrift
ZeroDrift is building the AI-native compliance enforcement infrastructure for enterprise communication. We are the first platform that enforces compliance before an AI message is ever sent, fixing violations in real time across every channel where AI speaks for the business. Everything goes out clean. Nothing dangerous comes in. As AI starts to communicate on behalf of entire organizations, the gap between what compliance requires and what companies can actually enforce is widening fast. Every existing solution monitors after send, once the risk is already out the door. ZeroDrift enforces compliance before send. Compliance enforcement did not exist as a category. We created it. We are backed by Andreessen Horowitz (a16z) and other world-class VCs, and built by a team from Microsoft, Google, and Goldman Sachs, led by a repeat AI founder. The Role Compliance enforcement runs on specialized language models. They decide in real time whether a communication is safe to send, and they have to be accurate, fast, and reliable, because they sit in the path of live traffic. Our AI research team owns the science: model behavior, training objectives, data strategy, and the quality bar. You own the systems that make the science real. You will build the pipelines that train models reproducibly, the evaluation infrastructure that proves they work, and the serving stack that runs them in production. This is a hands‑on principal individual contributor role on a small, senior team. It is a systems role, not a research role. The right candidate loves making ML industrial‑grade. What you'll do Build and own the training pipelines: data preparation, reproducible fine‑tuning runs, experiment tracking, and release automation. Build the evaluation infrastructure: automated eval runs, regression gates, dashboards, and dataset versioning. Research defines what good means. You build the machinery that measures it. Own model serving in production: low‑latency inference, batching, optimization, autoscaling, and cost. Ship model updates safely with versioning, canarying, rollback, and drift monitoring. Build repeatable workflows for adapting models to new domains and customer needs. Turn expert labels and reviewer feedback into clean training and evaluation data. Set the bar for ML infrastructure as the team grows. What we're looking for 8+ years of software engineering experience, including 4+ years building infrastructure for ML or LLM systems in production. Hands‑on depth with the modern LLM stack: PyTorch, distributed training, fine‑tuning at scale (LoRA, SFT), and inference engines such as vLLM or TensorRT‑LLM. You have built eval harnesses, regression gates, or dataset pipelines, and you understand precision, recall, and calibration well enough to build the right measurement around them. Production mindset. You have owned model serving with real latency, reliability, and cost constraints, not just notebooks. Strong fundamentals: Python, containers, CI/CD, cloud infrastructure, observability. High ownership on a small team: scope your own work, ship weekly, make pragmatic build‑vs‑buy calls. You enjoy being the engineering counterpart to a research partner. Tight collaboration, clear interfaces, no turf wars. Nice to have Experience productionizing small or specialized language models. Experience with structured‑output serving or constrained decoding in production. Prior work in a regulated or high‑stakes domain such as fintech, healthcare, legal, or trust and safety. Experience deploying models into customer‑controlled environments. Compensation and benefits $200,000 to $250,000 base salary, depending on experience. Performance bonus and meaningful early‑stage equity. Health, dental, and vision coverage. Hybrid work from our New York office. ZeroDrift is an equal opportunity employer. We evaluate candidates without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability, or any other protected characteristic. #J-18808-Ljbffr ZeroDrift
$280k - $325k
SoundCloud is looking for a Senior Principal Machine Learning Engineer to lead the development of its ML systems. This role involves a significant focus on large-scale modeling techniques and the opportunity to drive strategic initiatives. Applicants should have over 10...Suggested- Snap Inc. is seeking a Principal Software Engineer for the ML Inference team in NYC. This role leads technical strategy, architects high‑scale inference services, and drives scalable deployments across product lines. You will collaborate with multiple teams to translate...Suggested
- ...AI startup recognized as a Top 10 GenAI company by GTM Capital, founded by MIT CSAIL researchers. We are seeking a Staff / Principal ML Ops Engineer to lead the design, implementation, and scaling of the company’s ML infrastructure and production AI systems. This is a...SuggestedLocal areaImmediate startRemote workRelocation package
- ...compliance enforcement infra for enterprises, aiming to enforce compliance before send. The role is a hands-on principal IC on a small senior team, focusing on ML infrastructure and production-grade systems in a dynamic startup environment. You will own end-to-end...Suggested
$227.2k - $417k
Tubi is looking for a Software Engineer in New York City to work on the ML Infrastructure team. This role involves designing scalable systems and collaborating with Machine Learning and Product teams to enhance their inference platforms. Candidates should have experience...SuggestedFlexible hours- ...founded by MIT CSAIL researchers. We are looking for a Senior AI/ML Engineer to join a high-performing AI engineering team building and... ...startup with strong technical ambition Clear path toward Staff/Principal AI Engineer or AI Architect roles Benefits Competitive...Local areaImmediate startRelocation package
$235k - $260k
...and data platforms to power fan intelligence, personalization, and data-driven decisioning across the organization. The Principal AI/ML Engineer, Semantic Data will design and build the semantic intelligence layer that enables consistent understanding of fan data, business...Work at officeLocal areaRemote work1 day per week$280k - $325k
Senior Principal Machine Learning Engineer Location: New York, United States SoundCloud empowers artists and fans to connect and share through music.... ...Lead the technical strategy and execution for SoundCloud’s ML systems (recommendation, ranking, personalization),...Temporary work- Google is seeking a Software Engineering Manager in New York City. The role involves leading a team of engineers in building and maintaining ML models to enhance advertising product optimization. You will provide technical guidance and contribute to product strategy while...
$197k - $257k
Etsy is looking for an Engineer Manager to lead the Ads engineering group, focusing on machine learning solutions for enhancing seller ad... ...solving complex engineering challenges. The ideal candidate has ML product experience and strong leadership skills. Salary ranges from...Full time$292k - $417.2k
...shape the future of streaming. The Machine Learning team is seeking a Director of Machine Learning Engineering and Infrastructure to lead a hybrid team bridging advanced ML engineering with world-class infrastructure design. You will own the strategic direction and...Full timeTemporary workLocal areaFlexible hours- Goldman Sachs is seeking a Machine Learning Engineer in New York City. The ideal candidate will have over 10 years of experience building scalable machine learning systems and a strong foundation in computer science. Responsibilities include developing and maintaining...
$229.9k - $262.4k
...Senior Manager, Machine Learning Engineering As a Capital One Machine Learning Engineer (MLE), you’ll be part of an Agile team dedicated... ...Engineering. In this role, you’ll be expected to perform many ML engineering activities, including one or more of the following:...Full timePart timeInternshipLocal area$207k - $301k
Google Inc. seeks a Software Engineering Manager II for their AI/ML team, primarily focusing on the Google Cloud Compute division. This role requires extensive experience in ML infrastructure and team leadership, along with a Bachelor's degree or equivalent experience....- ...religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.**Job Description:****ML Engineer****3M Health Care is now Solventum****At Solventum, we enable better, smarter, safer healthcare to improve lives. As a new...H1bRemote work
$200k - $240k
...Overview ML Engineer — New York City or Remote. Base salary $200,000 to $240,000 plus equity and benefits. This is a rare opportunity to join a very early stage AI startup and take full ownership of building a critical machine learning system from the ground up. You will...Immediate startRemote work$207k - $300k
Google Inc. is seeking a Software Engineering Manager II to lead teams in AI and ML projects within Google Workspace. The ideal candidate will have at least 5 years experience in machine learning and a strong background in leadership. Responsibilities include setting team...- The Goldman Sachs Group is seeking an experienced Machine Learning Engineer in New York to develop and deploy advanced ML models in a dynamic environment. Candidates should have over 10 years of experience in scalable ML systems and strong coding skills. This role involves...
$101.49k - $147k
...Twitter and Instagram . Position Summary: We have an exciting opportunity to join our team as a Sr. Engineer I - AI. As a Senior ML Engineer, you will support the implementation of diverse Generative AI and Machine Learning initiatives across the...Work at office- ...A leading AI solutions provider in New York is seeking a talented ML Engineer to design, build, and deploy innovative ML systems. The role involves collaborating with cross-functional teams and engaging directly with customers to deliver impactful AI solutions. Candidates...
$234k - $250k
...employees – and aim to leave a positive mark on culture. Principal Machine Learning Engineer, Presentation & Visual Optimization Role Overview:... ...for visual personalization, bridging the gap between ML science and UI/UX design. Artwork & Marquee Personalization...Shift work- A prominent delivery logistics company seeks an Engineering Manager to lead the AI/ML team in New York. The manager will be responsible for driving the design and deployment of AI solutions that enhance merchant experiences. Candidates should have 7+ years in machine learning...
- Gravity Engineering Services Pvt Ltd. in New York is seeking an accomplished AI/ML leader to build and scale high-performing teams. You will shape our ML strategy, guiding the development of innovative models that enhance our ad serving platform. The ideal candidate has...
- Gravity Engineering Services Pvt Ltd. is seeking a skilled Machine Learning Engineer based in New York, NY. The role focuses on designing... ...candidate has strong programming skills in Python, experience with ML frameworks like TensorFlow or PyTorch, and a solid...
- ...portfolio manager is scaling their desk and will be hiring an elite Machine Learning Engineer. This role will sit within a systematic equities team in New York that is building and deploying ML-driven trading signals for intraday strategies. The role focuses on developing...
- A prominent dating application is inviting applications for a Senior Machine Learning Engineer to shape the future of their AI-driven solutions. This position involves building recommendation systems that enhance user connections. Candidates should have at least 4 years...
$176.5k - $201.4k
Capital One is seeking a Senior Machine Learning Engineer in New York, NY, to join their Agile team focused on productionizing machine learning... ...solutions, collaborate across teams, and ensure robust ML applications. With a focus on design, delivery, and maintenance...- Plaid is seeking an experienced Machine Learning Engineer to join their Data team in New York. You will focus on building and deploying scalable ML solutions that empower users to manage their financial lives. The ideal candidate has over 6 years of experience in machine...
- EvolutionIQ in New York is seeking a Senior Applied Machine Learning Engineer to revolutionize the insurance industry. This role involves working closely with the machine learning product manager and leading complex projects from inception to production launch. The ideal...
$180k - $220k
Canoe Intelligence is seeking a Senior Machine Learning Engineer to design and deploy advanced models that enhance the analysis of unstructured... ...0,000, applicants should have significant experience in applied ML engineering. The position offers flexible hybrid work...Remote jobFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal ML Engineer. Be the first to apply!
- principal cloud engineer New York, NY
- senior principal engineer New York, NY
- assistant chief engineer New York, NY
- principal infrastructure engineer New York, NY
- general engineer New York, NY
- principal quality engineer New York, NY
- director of electrical engineering New York, NY
- principal application developer New York, NY
- principal engineer New York, NY
- director of product engineering New York, NY

