Remote ML Engineering Manager: LLM Serving & Infra
Jobgether
New York, NY
- Remote job
A leading company in AI solutions is seeking a Machine Learning Engineering Manager to lead a team in developing high-scale LLM serving infrastructure. The role involves managing projects and collaborating with ML researchers to optimize system performance. Ideal candidates have a strong background in software engineering and experience in managing teams. The position comes with competitive salary and comprehensive benefits, including flexible working options. #J-18808-Ljbffr Jobgether
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote ML Engineering Manager: LLM Serving & Infra in New York, NY vacancy
$275.8k - $340.5k
...Overview The Principal AI/ML Engineer will lead a growing... ..., guiding the AV ML Infra team in achieving its... ...teams while proactively managing conflicts. Mentorship... ...Experience with model serving frameworks such as RayServe... ...relocation benefits. Remote/Hybrid This role is...Remote workLocal areaRelocationRelocation packageFlexible hours$275.8k - $340.5k
...About the team The AV ML Infra team at GM builds ML infrastructure... ...productivity of ML engineers, and drive the... ...workloads and managing reliable ML inference... ...Experience with model serving frameworks such as RayServe... ...relocation benefits. Remote/Hybrid This role is based...Remote workLocal areaRelocationRelocation packageFlexible hours- ...response systems and remote patient monitoring... ..., and care managers, our work is powered... ...Learning Engineerto serve as a hands-on technical... ...a principal-level engineer: shaping unclear problems... ...Develop practical ML models that balance... ..., including LLM-powered workflows,...Remote workTemporary work
$150k - $300k
...hybrid team. This role focuses on developing efficient architecture for serving LLMs and optimizing performance using modern infrastructure tools. Ideal candidates will have significant experience with ML systems, ensuring robust performance and scalability. The position...Remote job$272k - $425.5k
...technology firm in Santa Clara seeks a Principal Software Engineer for Large-Scale LLM Memory and Storage Systems. The role involves designing a... ...memory layer for large-scale inference, integrating with LLM serving engines, and mentoring engineers. Candidates should have...Remote job$134.6k - $230.8k
...the flexibility to work remotely from anywhere within... ...Responsibilities Define and own the engineering AI strategy to... ...enablement and change management, helping teams adopt... ...as a force multiplier Serve as a trusted advisor... ...agent‑based or LLM‑driven systems applied...Remote jobMinimum wageFull timeWork experience placementWork at officeLocal area$286.2k - $326.7k
...Director, Machine Learning Engineering (Remote-Eligible) Overview... ...applications of AI & ML are bringing humanity... ...to reimagine how we serve our customers and businesses... ..., by providing well‑managed, self‑service,... ...state‑of‑the‑art AI and LLM optimization techniques...Remote workFull timePart timeLocal areaCapital One
Boise, ID3 days ago- airbnb, Inc. seeks a Senior Staff Machine Learning Engineer to fine-tune state-of-the-art LLMs and develop AI products. The role involves... ...model development. This position offers the flexibility of remote work while being based in San Francisco, California. #J-18808-Ljbffr...Remote job
$165k - $200k
Community Tech Alliance is seeking an Engineering Manager to lead and grow the engineering team for PAD, their flagship data infrastructure platform... ..., ensuring that the team can effectively leverage data to serve progressive organizations. Position includes a significant...Remote job- A leading healthcare AI company is seeking engineers to build foundational ML infrastructure for healthcare applications. The role involves designing... ...strong background in ML systems, experience with model serving frameworks such as TensorFlow Serving, and comfort with...Remote job
$300k - $360k
A leading tech company is seeking an Engineering Manager for Machine Learning to shape ML strategy and lead a high-performing team. This remote-first role involves guiding implementation of LLM-powered features, overseeing infrastructure, and collaborating with cross-functional...Remote job- ...multi-threading , memory management , networking , storage... ...TGI , vLLM , TensorRT-LLM , and Optimum , and comfortable... ...inference systems for serving state-of-the-art AI... ...staying current with ML infrastructure... ...usually requires a large engineering effort dedicated to building...Work at office
$245k - $272k
...reflects the people we serve. All full-time employees... ...data to build AI- and ML-powered systems that improve... ...Machine Learning Engineering, ML Platform, Risk Data... ...ll do day-to-day Lead, manage, and develop a broad AI... ...2,000 in Denver & most remote locations, and $288,000...Remote workFull timeWork at officeLocal area2 days per week3 days per weekI did my part and supported the Regular Toilet
Denver, CO1 day ago- General Motors is seeking a Senior ML Infra Engineer to design and implement scalable platforms for machine learning training and evaluation... ...a strong understanding of machine learning workflows. This position can be fully remote or hybrid. #J-18808-Ljbffr IsraelvcforumRemote work
$200k - $250k
...Build and operate the ML platform that... ...GPU fleets, model serving, autoscaling, and cost... ...reliable multi‑provider LLM access across... ...Docker, dependency management, and CI/CD for AI workloads... ...a significant AI infra footprint.... ...tooling. Location Remote (San Francisco, CA;...Remote workAppFolio
San Francisco, CA1 day ago- Workday, Inc. is seeking a full-time remote Machine Learning Engineer to drive the design and development of the Document Intelligence Platform. You will build scalable ML pipelines and support LLM-based technologies for document processing. The ideal candidate has 3+...Remote jobFull time
$180k - $260k
...platform. The role bridges applied ML engineering and production reliability... .... Chicago, IL or Remote (US) Full-time $180,000 - $26... ...quality. Partner with product and infra teams to productionize new capabilities... ...training and model serving. Practical knowledge of transformer...Remote workFull time$198k - $230k
...that combines both in‑person and remote work to boost collaboration,... ...work styles. Senior MLOps Engineer (Applied AI Focus) As a Senior... ...Product Innovations team, you will serve as the technical lead for... ...model can do the job of a massive LLM. Cloud & Infrastructure...Remote workWork at officeWork from homeWorldwideHome officeFlexible hours$230k - $322k
...Conversion Modeling, Machine Learning Engineering Manager Remote - United States Reddit’s lower funnel... ...recommendation, or conversion modeling. ML Frameworks: Proficiency with mainstream... ...representative of the diverse communities we serve. Reddit is committed to providing...Remote jobWork experience placementWork at officeHome officeFlexible hours$152k - $228k
...Description Job Description Senior ML Engineer About Invoca Invoca is... ...of Invoca's ML stack — model serving, inference optimization, fine... .... Design and Optimize SLM/LLM Deployment: Own the full... ...Location This is a remote-first role. We are currently...Remote workCurrently hiringFlexible hoursInvoca
New York, NY13 days ago- General Motors is seeking a Staff ML Infra Engineer to advance the future of autonomous driving through scalable infrastructure development.... ...a strong background in machine learning algorithms. The position allows for remote or hybrid work. #J-18808-Ljbffr IsraelvcforumRemote work
- General Motors is seeking a Staff ML Infra Engineer to join the Embodied AI team. The role focuses on developing scalable platforms for machine learning model training and evaluation, ultimately aiming to enhance the future of autonomous driving. Ideal candidates will have...Remote jobRelocation package
$180.5k - $220k
...Corporation We are looking for an Engineering Manager who is excited to bring... ...we are dedicated to being a remote‑first company. This role can... ...all of these areas with our LLM‑powered Pulumi Copilot to push... ...more than 350,000 members and serves over 3,250 customers. Despite...Remote workFull timeLocal areaFlexible hoursPulumi Corporation
New York, NY4 days ago$189.3k - $290.7k
General Motors is seeking a Staff ML Infra Engineer to advance autonomous driving technologies. You will be responsible for designing scalable... ...shape the future of transportation. This position allows for remote or hybrid work and offers a competitive salary range between...Remote workRelocation package$134.25k - $196.9k
...decision‑making, change management, leadership, and... ...About The Role The Audio ML Engineer (Research) develops learning... ...Use modern AI tooling (LLM‑based coding assistants... ...allowing for full‑time remote work globally for... ...transformation solutions serve humanity by addressing...Remote workFull timeTemporary workImmediate startFlexible hoursHARMAN
Los Angeles, CA1 day ago$153.76k - $225.51k
...the country.Our Engineering and Analytics... ...add value using ML/AI algorithms and... ...with management and stakeholders... ...enterprise-grade LLM-powered solutions... ...to build such infra* GenAI Skills:... ...Databricks Model Serving for production... ...INDENGLP#zip#LI-Remote**Benefits*** Excellent...Remote workCasual workWork at officeLocal areaWork from home- Remote - United States Reddit is a community... ...Staff Machine Learning Engineer to lead Reddit’s... ...in mainstream ML user modeling approaches... ...tags, attributes, LLM-based user profile)... ...scale learning and serving: storage/retrieval... ...Collaborate with ML/Ranking infra to ensure low-...Remote jobImmediate startShift work
- ...Machine Learning Engineer - Leasing... ...Diego, California | Remote - San Francisco,... ...transforming property management: how properties... ..., and it needs ML engineering... ...business workflows you serve — in this case,... ...turning unclear infra problems into... ...infrastructure or LLM tooling....Remote work
$230k - $322k
Staff Machine Learning Engineer, Consumer Remote - United States... ...marketplace dynamics, our ML engineers tackle some... ...AI-powered discovery & LLM-driven experiences Large... ..., Data Science, Infra, and UX teams to solve... ...processing systems, and model serving infrastructure...Remote workFor contractorsWork experience placement$148.2k - $300.96k
Machine Learning Engineer Graduate (TikTok Trust and Safety-CV/NLP/Multimodal LLM) - 2026 Start (PhD) Location: Seattle Employment... ...model workflow, and implement serving pipelines at scale.3.... ...2. Appropriately handling and managing confidential information including...Temporary workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote ML Engineering Manager: LLM Serving & Infra. Be the first to apply!
Related searches
- entry level machine learning engineer New York, NY
- machine learning ai engineer New York, NY
- junior machine learning research engineer New York, NY
- ai ml engineer New York, NY
- senior ml engineer New York, NY
- machine learning engineer New York, NY
- graduate machine learning engineer New York, NY
- data scientist machine learning engineer New York, NY
- computer vision machine learning engineer New York, NY
- machine learning software engineer New York, NY