Remote ML Engineering Manager: LLM Serving & Infra

Jobgether

Remote job

A leading company in AI solutions is seeking a Machine Learning Engineering Manager to lead a team in developing high-scale LLM serving infrastructure. The role involves managing projects and collaborating with ML researchers to optimize system performance. Ideal candidates have a strong background in software engineering and experience in managing teams. The position comes with competitive salary and comprehensive benefits, including flexible working options. #J-18808-Ljbffr Jobgether

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Remote ML Engineering Manager: LLM Serving & Infra in New York, NY vacancy

Principal AI/ML Engineer, AV ML Infra
$275.8k - $340.5k
...Overview The Principal AI/ML Engineer will lead a growing... ..., guiding the AV ML Infra team in achieving its... ...teams while proactively managing conflicts. Mentorship... ...Experience with model serving frameworks such as RayServe... ...relocation benefits. Remote/Hybrid This role is...
Remote work
Local area
Relocation
Relocation package
Flexible hours
General Motors
Sunnyvale, CA
2 days ago
Principal AI/ML Engineer, AV ML Infra
$275.8k - $340.5k
About the Team The AV ML Infra team at GM builds ML infrastructure... ...productivity of ML engineers, and drive the... ...while proactively managing conflicts. Mentorship... ...Experience with model serving frameworks such as RayServe... ...relocation benefits. Remote/Hybrid This role is...
Remote work
Relocation
Relocation package
Flexible hours
General Motors
Mountain View, CA
3 days ago
AI/ML Engineering Manager
...AI/ML Engineering Manager Caylent is a cloud native services company that helps... ...company and operate fully remote with employees in Canada,... ...engagement. Shape architecture: Serve as the senior technical... ...Evaluation) Multi-provider LLM: Bedrock, Anthropic API,...
Remote work
Immediate start
Caylent
United States
2 days ago
Remote Principal AI/ML Researcher / Engineer Reasoning, Planning, and Decision-making systems
...Distinguished AI/ML Researcher and/or Engineer with deep experience... ...techniques in LLM/LRM post-training... ...platform strategy. Serve as the technical... ...—product, infra, and design—to translate... ...position is US - Remote Eligible. The... ...agreed to with your manager. While the...
Remote work
Temporary work
Casual work
Live in
Work at office
Local area
GrabJobs
United States
1 day ago
Remote ML Engineering Manager — AdTech & ROAS Leadership
$180k - $225k
...Acquisition. Our vision is to build an ML/AI-first network of... ...for everyday shoppers. As our Engineering Manager, Data Science, you will lead... ...science team. This role is fully remote, with occasional travel to... ...stores, and low-latency serving infrastructure such as ONNX,...
Remote job
Work at office
Shift work
Fluent, LLC
New York, NY
2 days ago
AI/ML & Prompt Engineer LLM, RAG & Voice Agent
...reception system, EMMA, serves millions of patients, helping GP surgeries manage demand, reduce phone... ...The Role As our AI/ML & Prompt Engineer, you will own the intelligence... ...behind EMMA — the LLM and RAG systems that... ...Comfortable working remotely and collaborating asynchronously...
Remote work
Flexible hours
latitude
United States
5 days ago
Staff ML Inference Engineer - Scalable LLM Serving (Remote)
$150k - $300k
...hybrid team. This role focuses on developing efficient architecture for serving LLMs and optimizing performance using modern infrastructure tools. Ideal candidates will have significant experience with ML systems, ensuring robust performance and scalability. The position...
Remote job
Prime-Intellect
San Francisco, CA
3 days ago
Principal AI/ML Engineer, AV ML Infra
$275.8k - $340.5k
...About the team: The AV ML Infra team at GM builds ML infrastructure... ...the productivity of ML engineers, and drive the adoption of cutting... ...simulation workloads and managing reliable ML inference pipelines... ...for relocation benefits. Remote/Hybrid: This role is based remotely...
Remote work
Local area
Work from home
Relocation
Relocation package
Flexible hours
General Motors
Sunnyvale, CA
4 days ago
Senior ML Systems Engineer, Frameworks & Tooling
...Senior Engineer We're looking for a... ...full stack of ML systems, this role... ...large-scale LLM training. Design... ..., memory management, checkpointing)... ...Collaborate closely with infra teams to ensure... ...evaluation and serving frameworks (... ...~ Remote-flexible, offices...
Remote work
Full time
Work at office
Flexible hours
Cohere
United States
3 days ago
Director, AI ML Engineering - Remote
$134.6k - $230.8k
...the flexibility to work remotely from anywhere within... ...Responsibilities Define and own the engineering AI strategy to... ...enablement and change management, helping teams adopt... ...as a force multiplier Serve as a trusted advisor... ...agent‑based or LLM‑driven systems applied...
Remote job
Minimum wage
Full time
Work experience placement
Work at office
Local area
UnitedHealth Group
Schaumburg, IL
1 day ago
Principal AI/ML Engineer (Large Language Model) (TS/SCI) {S}
...advanced technologies company serving the U.S. military,... ...The Principal AI/ML Engineer will support the development... ...of applications within remote sensing such as tasking... ...applications with LLM frameworks such as LangChain... ...working with a program manager to define project scope...
Remote work
Temporary work
Work at office
Local area
Visa sponsorship
Relocation package
Flexible hours
ARKA Group
King of Prussia, PA
1 day ago
Principal AI/ML Engineer (Large Language Model) (TS/SCI) {S}
$180k - $210k
...advanced technologies company serving the U.S. military,... ...The Principal AI/ML Engineer will support the development... ...of applications within remote sensing such as tasking... ...applications with LLM frameworks such as LangChain... ...working with a program manager to define project scope...
Remote work
Temporary work
Work at office
Local area
Visa sponsorship
Relocation package
Flexible hours
ARKA Group
Aurora, CO
1 day ago
Principal Engineer, LLM Memory and Storage Remote
$272k - $425.5k
...technology firm in Santa Clara seeks a Principal Software Engineer for Large-Scale LLM Memory and Storage Systems. The role involves designing a... ...memory layer for large-scale inference, integrating with LLM serving engines, and mentoring engineers. Candidates should have...
Remote job
NVIDIA
Santa Clara, CA
1 day ago
Principal Machine Learning Engineer
...response systems and remote patient monitoring solutions... ...providers, and care managers, our work is powered... ...Machine Learning Engineer to serve as a hands-on technical... ...Develop practical ML models that balance predictive... ...solutions, including LLM-powered workflows, RAG...
Remote work
Temporary work
Medical Guardian
Philadelphia, PA
23 days ago
Principal AI/ML Platform Engineer (US)
$179k - $199k
...This team will serve as the product owner... ...closely with other engineering teams across the organization... ...The Principal AI/ML Platform Engineer... ...databases, and LLM evaluation tools.... ...components. - Develop and manage observability,... .... #LI-AV1 #LI-remote $179,000 - $199,0...
Remote work
PointClickCare
United States
3 days ago
Remote Principal Machine Learning Engineer- LLM Fine-tuning and Optimization
...to Marketing we rely on ML to ensure that guests... ...services and tools including LLM fine-tuning, alignment... ...machine learning engineer, you will be responsible... ...will partner with product managers, software engineers,... ...This position is US - Remote Eligible. The role may...
Remote work
Casual work
Live in
Work at office
GrabJobs
United States
1 day ago
Principal Machine Learning Engineer, Agentic AI
$204.4k - $326.6k
...Principal Machine Learning Engineer Zillow is... ...innovation Serve as the focal point... ...been categorized as a Remote position. "Remote"... ...technology (i.e., LLM models, either from... ...research in top AI/ML venues is a big plus... ...judgment, effectively manage stress and work safely...
Remote work
Permanent employment
Live in
Work at office
Local area
Zillow Referrals
United States
2 days ago
Senior Principal Machine Learning Engineer
$280k - $325k
...Senior Principal Engineer, Machine Learning New York... ...technical North Star for ML across engineering,... ...agentic workflows and LLM-assisted systems that will... ...engineering, training and serving infrastructure at scale... ...and lifecycle management ~ Hands-on familiarity...
Remote work
Temporary work
Work at office
Work from home
Flexible hours
SoundCloud
New York, NY
29 days ago
Principal Machine Learning Engineer, Agentic AI
$204.4k - $326.6k
...comprises scientists and engineers working together to... ...innovation Serve as the focal point... ...been categorized as a Remote position. “Remote”... ...technology (i.e., LLM models, either from... ...research in top AI/ML venues is a big... ...judgment, effectively manage stress and work safely...
Remote work
Permanent employment
Live in
Work at office
Local area
Zillow
United States
7 days ago
Principal AI/ML Engineer (Large Language Model) (TS/SCI) {S}
$180k - $210k
...advanced technologies company serving the U.S. military,... ...The Principal AI/ML Engineer will support the development... ...of applications within remote sensing such as tasking... ...applications with LLM frameworks such as LangChain... ...working with a program manager to define project scope...
Remote work
Full time
Temporary work
Work at office
Local area
Visa sponsorship
Relocation package
Flexible hours
TSG
Aurora, CO
4 days ago
Principal Machine Learning Engineer
$204.4k - $326.6k
...looking for a Principal engineer with strong, senior... ...categorized as a Remote position. "Remote"... ...-scale data and ML infrastructure (production... ...stores, and model-serving layers), with 1 to... ...agent-based or LLM-powered systems to... ...judgment, effectively manage stress and work...
Remote work
Permanent employment
Live in
Work at office
Local area
Zillow
United States
4 days ago
Principal Machine Learning Engineer
$162k - $225k
...Principal Machine Learning Engineer Remote - New York City, NY; Remote -... ...cutting edge language-based ML applications that will power... ...access to mental healthcare. Serve as a go-to expert and mentor,... ...learning, reinforcement learning, LLM orchestration, RAG systems....
Remote work
Full time
Work at office
Local area
3 days per week
Headspace
New York, NY
2 days ago
Senior Principal Machine Learning Engineer, vLLM
$206.6k - $351.05k
..., optimize, and scale LLM deployments. As a Senior... ...Machine Learning Engineer focused on model optimization... ...( . Create and manage inference serving deployment pipelines... ...field. A PhD in a ML related domain is considered... .... For positions with Remote-US locations, the...
Remote work
Permanent employment
Full time
Contract work
Work experience placement
Work at office
Flexible hours
Red Hat
Boston, MA
4 days ago
Remote Principal ML Engineer, LLM Fine-Tuning & AI
airbnb, Inc. seeks a Senior Staff Machine Learning Engineer to fine-tune state-of-the-art LLMs and develop AI products. The role involves... ...model development. This position offers the flexibility of remote work while being based in San Francisco, California. #J-18808-Ljbffr...
Remote job
airbnb, Inc.
San Francisco, CA
1 day ago
Principal MLOps Engineer
$150k - $200k
...with cutting-edge AI/ML and data solutions.... ...Principal ML Ops Engineer to support our customers... ..., and lifecycle management across both cloud... ..., model serving systems, CI/CD pipelines... ...speech/audio, and LLM-based systems Build... ...Work Type: Remote in DMV; McLean, VA;...
Remote work
Live in
Flexible hours
Raft Company Website
Colorado Springs, CO
22 days ago
Principal ML Infra Engineer - AI Environments
...Gravity Engineering Services Pvt Ltd. is looking for a backend or infrastructure engineer to join their AI environments team. The role... ...that support AI researchers in configuring their training and serving environments while collaborating with cross-functional teams to...
Gravity Engineering Services Pvt Ltd.
Mountain View, CA
4 days ago
Sr. Director, Machine Learning Engineering (Remote-Eligible)
$286.2k - $326.7k
...Director, Machine Learning Engineering (Remote-Eligible) Overview At... ...applications of AI & ML are bringing humanity... ...to reimagine how we serve our customers and businesses... ..., by providing well‑managed, self‑service,... ...state‑of‑the‑art AI and LLM optimization techniques...
Remote job
Full time
Part time
Local area
Capital One
Albany, NY
3 days ago
Founding ML Infra Engineer Production-Grade LLMs
...innovative AI startup is seeking a Founding ML Infrastructure Engineer to take charge of deploying and optimizing production-grade LLM systems. In this core role, you will be responsible for building and managing a full ML serving stack, working closely with product teams...
Realm Labs LLC
Sunnyvale, CA
4 days ago
Principal Machine Learning Engineer
$189.6k - $312.73k
..., optimize, and scale LLM deployments. As a Principal... ...Machine Learning Engineer focused on model... ...projects. Create and manage inference serving deployment pipelines... ...related field. A PhD in a ML related domain is considered... .... For positions with Remote-US locations, the...
Remote work
Permanent employment
Full time
Contract work
Work experience placement
Work at office
Flexible hours
Red Hat, Inc.
Boston, MA
1 day ago
Staff AI/ML Engineering Manager
$98.5k - $206.8k
...ID324312Job Title: Staff AI/ML Engineering ManagerJob Category: ScienceTime... ...is for an AI/ML Engineering Manager. We are seeking a talented... ...model training infrastructure, serving layers, and MLOps frameworks.... ...Experience working with various Remote Sensing datasets (e.g. EO/...
Remote work
Contract work
Work experience placement
Flexible hours
CACI International Inc.
Aurora, CO
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote ML Engineering Manager: LLM Serving & Infra. Be the first to apply!