Lead Machine Learning Engineer - Infrastructure
$210k - $260kLayer Health
Lead Machine Learning Engineer - Infrastructure
Boston or NYC
Layer Health was founded in 2023 by leading machine learning researchers from MIT and Harvard Medical School. We are building an AI layer that can accurately and scalably synthesize information from medical records, with the mission to reduce friction everywhere in healthcare. Our LLM-powered platform is solving chart review once and for all, across use cases. For health systems, our first product dramatically accelerates clinical registry abstraction in areas ranging from surgery and cardiology, to oncology. Our long term vision is for our AI layer to safely transform patient care and minimize unnecessary heartbreak. Layer Health's diverse founding team brings expertise across machine learning, UI/UX, large language models, and medicine.
We're seeking outstanding hires to join our team as early members. This is an opportunity to contribute to a high-impact, collaborative, mission-driven team, and help define the next stage of growth for Layer Health. Together, we will create the AI layer that will redefine healthcare for the better.
We're hiring an exceptional ML Infra Engineer to join our team (Boston or NYC office). You will work closely with our software engineers, research scientists, and product teams to build ML-native enterprise platforms, ensuring scalability, efficiency, and reliability.
Here's a collection of articles about our product, mission, recent funding round, etc.
You can expect to:
- Architect efficient, secure, reliable, and performant ML pipelines and infrastructure.
- Design, develop, and maintain scalable/data-centric backend infrastructure for our product.
- Translate start-of-the-art LLM research (both internally developed and from the community) into production, delivering value for our customers.
- Work with complex, large-scale, real-world clinical data (both structured and unstructured data) in a cloud-based environment.
- Develop methods and features to ensure high-quality results for our production models (methods to detect drift/performance degradation; develop observability tooling for performance characteristics, etc.).
- Collaborate with the broader product, engineering, and research teams to improve our products and build the next-generation of ML for healthcare.
- Build scalable infrastructure to ensure we can scalably support efficient model development and deployment pipelines, CI/CD, testing/experimentation.
- Ensure robust monitoring, logging, and error handling for deployed systems.
- Stay updated on the latest advancements in machine learning and AI.
- Cultivate a robust ML engineering and product culture that drives the company forward.
We look for:
- 3+ years of experience in building ML-native backend infrastructure.
- 5-7+ years of experience in backend and cloud platform software development, with the ability and flexibility to traverse the stack when necessary.
- Fluency in one or more backend programming languages including Python, Golang, Rust, Java (we use Python).
- Familiarity with modern ML/LLM techniques and frameworks.
- Bachelor's degree in Computer Science, Engineering, Mathematics, or related field.
- Experience in 0-to-1 development of end-to-end ML systems (design, training, inference, deployment, and monitoring; bonus if involving LLMs).
- Experience developing and maintaining performant, scalable, and data-centric enterprise software products.
- Strong problem-solving skills and attention to detail.
- Excellent communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
- An excited and adaptable team player who wants to disrupt the healthcare industry with AI/ML, alongside an awesome team, in a customer-focused and fast-paced environment.
- We expect engineers to meet regularly in-person in either our NYC or Boston office (engineers from Boston, NYC, or east coast are welcome).
Expected compensation range for this role is $210,000-260,000/year, in addition to stock options. Compensation is dependent on experience, overall fit to our role, and candidate location. Expected compensation ranges for this role may change over time. If your compensation requirement is greater than our posted salary ranges, please still consider applying to our role. We will make a determination as to whether an exception can be made.
If you are excited about this role, we encourage you to apply even if you don't feel that you meet every single requirement. We're eager to meet people that believe in our mission and can contribute to our team in a variety of ways. We welcome diverse perspectives, rigorous thinking, and fearlessness in challenging the status quo.
Layer Health is committed to fostering an environment of inclusion that is free from discrimination. We are an Equal Opportunity Employer where employment is decided on the basis of qualifications, merit, and business need. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected Veteran status, or any other characteristic protected by law.
Join us and help us transform healthcare with AI.
$183.5k - $269.1k
...Staff Machine Learning Engineer, ML Infrastructure We're a high-tech home security company that's passionate about protecting the life you've built and... ...Triton, and vLLM — across real-time and batch workloads. Lead deep technical reviews on system design, capacity...SuggestedWork at office- ...software tools for making buildings,machines, and even the latest movies, we influence... .... Autodesk is looking for an ML Engineer, ML Systems and Infrastructure to help build the technical foundation behind large-scale machine learning systems. In this role, you will...SuggestedFor contractorsRemote work
- ...Harvard Medical School affiliate, is seeking an experienced Machine Learning Engineer to join the SMART Health IT team ( In this role, you will... ...and evaluate predictive models and advanced algorithms that lead to optimal value extraction from the data. Generates and tests...SuggestedWorldwideFlexible hours
- Job Title Disabled veteran A veteran who served on active duty in the U.S. military and is entitled to disability compensation (or who but for the receipt of military retired pay would be entitled to disability compensation) under laws administered by the Secretary of...Suggested
$186.07k - $225k
...Team: We are looking for a Senior Machine Learning Platform Engineer to join our Machine Learning... ...and low-latency for our ML inference infrastructure that runs both predictive ML models... ...understanding of distributed systems. ~ You lead by example through high quality...SuggestedLocal area$95k - $245k
Draper is seeking a Senior Network Engineer in Cambridge, MA. This role involves building and implementing network systems across the enterprise, ensuring efficient network performance, troubleshooting issues, and managing network hardware. Required qualifications include...- ...Senior Machine Learning Engineer - Perception R&D Hybrid Contract C2C GC, USC Need Linkedin of 2 Active referrences Python, PyTorch, computer vision, deep learning (ViT/Transformers, self-supervised, vision-language models, zero-shot...Contract work
- ...citizens to apply. Who Should Apply : Recent Computer science/Engineering /Mathematics/Statistics or Science Graduates looking to make... ...written and verbal communication skills For data Science/Machine learning REQUIRED SKILLS Bachelors degree or Masters degree in...
- ...scale. ~ Extensive ML engineering experience, including 5+... ...3+ years deploying NLP/deep learning models in cloud production environments... .... Title: Sr Machine Learning Engineer, GenAI... ...Machine Learning Engineer to lead the development and...Remote work
$161k - $246k
Description Job Description Overview: The ASUS Robotics & AI Center is seeking a Senior Machine Learning Engineer to join our global research and development team. This role centers on leading the design and delivery of advanced computer vision and perception systems for our...Work experience placementWork at officeLocal areaWork from homeShift work$286.2k - $326.7k
...Sr. Distinguished Machine Learning Engineer (Remote-Eligible)OverviewAt Capital One, we are creating... .... Our investments in technology infrastructure and world-class talent — along with... ...engineering teams to deliver our industry leading capabilities with breakthrough...Full timePart timeLocal areaRemote workFlexible hours- ...exceptional accuracy. As an engineer in the Scene Understanding... ...work with state-of-the-art machine learning models that operate in real-... ...sensor data and cutting-edge infrastructure to validate your algorithms... ...solutions for robotaxis Lead end-to-end data strategy, including...Temporary workRelocation package
$118k - $176k
...innovation and creating the best experience for job seekers. (*Comscore, Total Visits, March 2025) Day to Day The Machine Learning Engineer I role partners closely with business partners across various functions to help execute strategic initiatives that increase...Work experience placementLocal area- ...Description Job Description As a Perception Engineer, you will be instrumental in designing... ...ML frameworks Experience deploying learned models into production Excellent... ...Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide...Temporary workRelocation package
$178.88k - $320.65k
...Requisition ID # 26WD94803 Senior Principal Machine Learning Engineer, ML Platform and Systems Architecture... ...standards across teams, and lead major platform initiatives that... ...across Autodesk, including training infrastructure, data platforms, evaluation and experimentation...For contractorsRemote work$123k - $153.7k
...with senior scientists and engineers to prototype, train, evaluate... ...and practices, such as machine learning, deep learning, statistics... ...and knowledge of Big Data infrastructure (Hadoop, Spark, etc.) will... ...and reduces driving risk, leading to fewer crashes and injuries...Temporary workSummer workWork from homeWorldwideFlexible hours$184.05k - $262.93k
...listening experiences. This is a team of about a hundred AI/ML Engineers, Applied Research Scientists, Product Managers, and domain... ...You have 5+ years of experience building and shipping machine learning models end-to-end You have a strong foundation in Python...Work from homeFlexible hours- ...Senior Machine Learning Engineer Boston, Massachusetts, United States About the Job Senior Machine Learning Engineer Our client is a venture... ...options. As a senior ML engineer you'll assume a leading role in an agile team of ML and software engineering practitioners...Internship
$175k - $250k
...Machine Learning Engineer Chicago, United States; Hong Kong, Hong Kong; Sydney, Australia As a Machine Learning Engineer, you will play a... ...models across our global operations. You'll collaborate with leading researchers, hardware experts, and software engineers to...Permanent employmentFull time$143.7k - $194.4k
...The Alexa AI team is looking for a passionate, talented, and inventive Machine Learning Engineer with a strong machine learning background, to build capabilities such as fine tuning, distillation, and LLM Inference. As a ML engineer with the Alexa AI team, you will...InternshipFlexible hours- ...NLP/ML Engineer The NLP/ML will design and implement elements of our technically advanced NLP pipeline under the guidance of product management on a team organized in agile scrum. The position places a premium on creative strongly engineered solutions and teamwork....
$189k - $257k
...navigation in complex environments. As an engineer in the ODIN team, you will develop... ...premium sensor data and cutting-edge infrastructure to validate your algorithms in real-... ...Qualifications MS or PhD in Computer Science, Machine Learning, or related technical field...Temporary workRelocation package$140k - $175k
...Senior Machine Learning Engineer Pickle is on the hunt for a dynamic and driven Senior Machine Learning Engineer to revolutionize the future... ...to solve complex grasping and scene understanding tasks. Lead End-to-End Model Deployment: You will own the transition from...- ...is to deliver the undeliverable. Nanite is a disruptive Machine Learning/AI therapeutics company focused on revolutionizing drug... ...Functions and Duties Design and implement complex data engineering processes to support innovative data science modeling Collaborate...Internship
$162.5k - $286.4k
...Senior Machine Learning Engineer Work Locations (2) Submit Resume Imagine what you could do... ...from amazing technology to industry-leading environmental efforts. At Apple, inclusion... ...and optimize Apple-wide systems & infrastructure. As a member of the fast-paced team,...Work experience placementRelocation- ...generation information extraction product powered by state-of-the-art AI and Deep Learning techniques. Work with an international top-notch engineering team with full commitment on Machine Learning development. Skills Required: Passionate about search and AI...Immediate start
$136.32k - $287.41k
...enterprise. The Red Hat AI Inference Engineering team accelerates AI for the... ...to GenAI deployments. As leading developers, maintainers of the... ...scale LLM deployments. As a Machine Learning Engineer focused on distributed vLLM infrastructure in the llm-d project, you will...Permanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hours- ...building an environment that values curiosity, innovation, and a bit of fun along the way. What We're Looking For As a Machine Learning Engineer working on Remark's core platform, you will be responsible for planning, implementing, and testing features that change...Flexible hours
- ...Sr. Machine Learning Engineer Duration: 12 -24 Months Location: Merrimack, NH/ Smithfield, RI/ Westlake, TX/ Durham, NC/ Covington, KY... ...analytics space ~2+ years of experience in developing ML infrastructure and MLOps in the Cloud using AWS Sagemaker ~ Extensive...Local area
- ...Machine Learning Engineer We're looking for a smart, friendly, and dedicated machine learning engineer to help build new features and products. As a company, we're customer and sales-driven in every technical decision we make. As a machine learning engineer, you will...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Machine Learning Engineer - Infrastructure. Be the first to apply!
- lead quality engineer Boston, MA
- lead network engineer Boston, MA
- lead web developer Boston, MA
- lead industrial engineer Boston, MA
- lead operating engineer Boston, MA
- lead infrastructure engineer Boston, MA
- lead engineer Boston, MA
- machine learning ai engineer Boston, MA
- machine learning engineer Boston, MA
- machine learning software engineer Boston, MA

