Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Founding ML Infra Engineer Production-Grade LLMs

Realm Labs LLC

An innovative AI startup is seeking a Founding ML Infrastructure Engineer to take charge of deploying and optimizing production-grade LLM systems. In this core role, you will be responsible for building and managing a full ML serving stack, working closely with product teams to ensure system performance and reliability. The ideal candidate will have extensive experience in ML infrastructure, particularly with LLMs, and will be proficient in relevant technologies such as PyTorch, TensorFlow, and Kubernetes. This position offers a unique opportunity to shape the future of AI within the company. #J-18808-Ljbffr Realm Labs LLC

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Founding ML Infra Engineer Production-Grade LLMs in Sunnyvale, CA vacancy
  • Latitude is building a foundational ML engineering team to design, train, and ship production-grade models from the ground up in Mountain View, CA. You will bridge...  ...will own end-to-end ML pipelines, implement and tune LLMs and embeddings, and work with data and product... 
    Suggested

    latitude

    Mountain View, CA
    4 days ago
  • Clera in Mountain View, CA is seeking a founding-level ML Engineer to build core machine learning systems from scratch. You’ll bridge research and engineering to design, train, and ship production-grade models that power frontier AI labs. You’ll influence technical culture... 
    Suggested

    Clera

    Mountain View, CA
    3 days ago
  •  ...the next generation of agentic AI. You will design and optimize production infrastructure for large-scale AI workloads, focusing on TPU...  ...distributed serving, and runtime performance. As part of a small founding team, you will work directly with the founders, own... 
    Suggested

    Strativ Group

    Palo Alto, CA
    2 days ago
  •  ...OverviewAs our Staff Software Engineer, ML infra Engineer for Search &...  ...customers search and discover products. If you are passionate about...  ...experience in building production grade MLsystemsPreferred...  ...employment if a candidate is found to have submitted false information... 
    Suggested
    Temporary work

    Coupang

    Mountain View, CA
    4 days ago
  • NVIDIA is seeking a talented Machine Learning Engineer to work on Product Security, Content Safety, ML Fairness and Robustness for LLMs across research and production teams. You will tackle innovative problems in ML with a focus on safety for multi-modal models. Responsibilities... 
    Suggested

    Jobzhr

    Santa Clara, CA
    3 days ago
  • Walmart is seeking a Staff Machine Learning Engineer in Sunnyvale to lead the design and delivery of scalable, production-grade ML solutions. You will oversee data sourcing, model development, deployment, and monitoring while championing MLOps standards. You'll mentor... 

    Walmart

    Sunnyvale, CA
    5 days ago
  • $220k - $300k

     ...Description About the Role This is a founding-level ML engineering role at an early-stage AI data and...  ...to design, train, and ship production-grade models that directly serve frontier...  ...deployment. Implement and fine-tune LLMs, embeddings, and generative models for... 

    Clera

    Mountain View, CA
    8 days ago
  • Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models in production. This remote U.S. role focuses on the systems engineering side of AI deployment,... 
    Remote job

    Bright Vision Technologies

    Mountain View, CA
    2 days ago
  • $133k - $272k

     ...One platform, its Zero Trust Engine, and the powerful NewEdge network...  ...(AI) and machine learning (ML) to protect the modern...  ...cutting-edge AI research into production-grade reality.Note on Leveling: We...  ...understanding of) optimizing LLMs in production. Familiarity with... 

    Netskope

    Santa Clara, CA
    8 days ago
  •  ...world's most advanced LLMs, our proprietary models...  ...with Moveworks’ Reasoning Engine and natural language...  ...both models and agents in production. We are an eval-driven,...  ...build on the latest ML/LLM research and open-source...  ...with production-grade codeStrong appetite for... 
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    6 days ago
  • $170.6k - $261.3k

     ...join us. About the team: The AV ML Infra team at GM builds end-to-end...  ...and developers facing products designed to meet the unique demands...  ...the productivity of ML engineers, and drive the adoption of cutting...  ...building and operating production-grade web applications 1+ years of... 
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    8 days ago
  • $227k - $300k

     ...technology is already in production across more than 8...  ...offerings for production-grade AI on the Edge. We are...  ...great Senior Staff AI Engineer to join our seasoned AI...  ...will own the end-to-end ML pipeline—from data ingestion...  ...store, or lightweight LLMs/SLMs.Experience with... 
    Work at office
    Worldwide
    Flexible hours
    Shift work
    3 days per week

    Sonatus

    Sunnyvale, CA
    4 days ago
  •  ...A growing AI technology startup is seeking an ML Engineer to design and deploy production-grade systems. The role involves using Python and collaborating with teams to optimize customer interactions through advanced AI applications. Candidates should have a degree in Computer... 

    Catalyst Labs, LLC

    Mountain View, CA
    1 day ago
  •  ...and cost-effectively in production. We bridge this exact...  ...and world-renowned ML systems researcher with...  ...Experience: Take research-grade ideas and make them...  ...experience engineering ML systems, OR a PhD...  ...build with a world-class founding team combining serial... 
    Shift work

    Success Matcher Recruitment

    Sunnyvale, CA
    10 days ago
  • Jobtailor in Mountain View, CA is seeking an ML Engineer focused on growth analytics to develop lead...  ..., and collaborate with marketing and product teams to align ML solutions with growth goals. You will experiment with LLMs and recommendation systems to enhance content... 

    Jobtailor

    Mountain View, CA
    2 days ago
  • A tech-driven AI company is seeking an ML Engineer to design and deploy production-grade ML systems with full ownership of the model lifecycle. The ideal candidate will possess a degree in Computer Science and 1-6 years of experience in ML engineering, with robust programming... 

    Catalyst Labs, LLC

    Cupertino, CA
    2 days ago
  • Meyandy LLC in Sunnyvale, CA is seeking a Founding Forward-Deployed ML Engineer to bridge research, deployment, and clinical operations in healthtech imaging. You will work on-site with hospital partners to evaluate and deploy models in clinical workflows, build evaluation... 

    Meyandy LLC

    Sunnyvale, CA
    5 days ago
  •  ...& Co. in Palo Alto seeks a Machine Learning Engineer-Digital Intelligence to advance LLM-based research and scalable production systems. You will work with a high-caliber team...  ..., interpretability, and deploying novel ML ideas at scale, bridging research and engineering... 

    JPMorgan Chase & Co.

    Palo Alto, CA
    2 days ago
  • $150k - $230k

    ### About the RoleThis is a founding-team opportunity at a small, fast-moving healthtech AI company building...  ...imaging AI. As a **Founding Forward-Deployed ML Engineer**, you will sit at the intersection of research, product deployment, and clinical operations — working directly... 
    Remote work

    Meyandy LLC

    Sunnyvale, CA
    5 days ago
  •  ...applications for a Sr. Machine Learning Engineer, Siri Speech to advance multilingual, multimodal LLMs and speech understanding powering...  .... You will design end-to-end ML systems, train models, and deploy research into production, collaborating with research, engineering... 

    Apple

    Cupertino, CA
    2 days ago
  • JPMorganChase in Palo Alto is seeking a Machine Learning Engineer specializing in digital intelligence to advance...  .... You will translate research into scalable production code and collaborate with a team of engineers and ML experts. The role emphasizes building reliable,... 

    JPMorganChase

    Palo Alto, CA
    2 days ago
  • Walmart Sunnyvale is seeking a Principal ML Engineer to lead the design and deployment of scalable, production-grade machine learning systems for personalization. You will own the end-to-end ML lifecycle, partner with data scientists and software engineers, and drive best... 

    Socket.dev

    Sunnyvale, CA
    3 days ago
  • $150k - $350k

     ...generative AI to assist engineers in RTL design,...  ...accelerating chip development. Founded by experts in AI and semiconductor...  ...is deployed in production to companies that have...  ...We are seeking an ML Systems Engineer to optimize...  ...and optimizing LLMs in production: model serving... 

    ChipAgents

    San Jose, CA
    1 day ago
  • JPMorgan Chase & Co. is seeking a Senior Machine Learning Engineer-Digital Intelligence in the Digital Intelligence team. You will specialize...  ..., interpretability, and related algorithms, driving end-to-end ML solutions in a fast-paced environment. Ideal candidates bring a... 

    JPMorgan Chase & Co.

    Palo Alto, CA
    3 days ago
  • $170k - $210k

    ABOUT THIS ROLE CORSAIR is building a production-grade AI/ML capability spanning intelligent...  ...systems, predictive analytics, and data engineering. As AI/ML Engineering Manager, you will...  ...0—$210,000 USDCORSAIR (NASDAQ:CRSR), founded in 1994, is a leading global developer... 
    For contractors
    Work experience placement

    Corsair

    Milpitas, CA
    6 days ago
  • $174.72k - $295.68k

     ..., FP4, and lower-bit techniques.Develop production-quality Python code with strong testing,...  ....Strong Python programming and software engineering skills.Ability to work effectively across...  ...or custom runtimes.Experience deploying LLMs on resource-constrained or heterogeneous... 
    Full time

    XPENG Motors

    Santa Clara, CA
    4 days ago
  • $151.8k - $265.35k

     ..., paired with creative production workflows and a media-intelligence...  ...Machine Learning Engineer to build the pipelines...  ...reliable, enterprise-grade products. You will...  ...pipelines including finetuned LLMs, image and video...  ...latency SLAs. Run production ML operationally - on-call... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    8 days ago
  • $188.5k - $282.7k

     ...Semantic AI Governance Engine, which is the first system...  .../block decisions on production traffic.At its core, SAGE...  ...further.As an Applied ML Engineer on the SAGE...  ...can outperform frontier LLMs at the problems that matter...  ...) for production-grade training and evaluation... 
    Permanent employment
    Local area

    Rubrik

    Palo Alto, CA
    8 days ago
  • $206.4k - $379.1k

     ...IP, paired with creative production workflows and a media-intelligence...  ...Machine Learning Engineer to serve as the technical...  ...model pipelines — LLMs, diffusion and transformer...  ...techniques into production-grade inference architecture. Director, ML Engineering and ML Engineering... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    4 days ago
  • $152k - $277k

     ...offline and online ML platforms to support...  ...easily consumed by engineers and scientists. You...  ...and discover products. If you are passionate...  ...large language models (LLMs), embedding-based...  ...building production grade ML systemsPreferred...  ...if a candidate is found to have submitted false... 
    Temporary work

    Coupang

    Mountain View, CA
    8 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Founding ML Infra Engineer Production-Grade LLMs. Be the first to apply!