Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Founding ML Infra Engineer Production-Grade LLMs

Realm Labs LLC

An innovative AI startup is seeking a Founding ML Infrastructure Engineer to take charge of deploying and optimizing production-grade LLM systems. In this core role, you will be responsible for building and managing a full ML serving stack, working closely with product teams to ensure system performance and reliability. The ideal candidate will have extensive experience in ML infrastructure, particularly with LLMs, and will be proficient in relevant technologies such as PyTorch, TensorFlow, and Kubernetes. This position offers a unique opportunity to shape the future of AI within the company. #J-18808-Ljbffr Realm Labs LLC

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Founding ML Infra Engineer Production-Grade LLMs in Sunnyvale, CA vacancy
  •  ...OverviewAs our Staff Software Engineer, ML infra Engineer for Search &...  ...customers search and discover products. If you are passionate about...  ...experience in building production grade MLsystemsPreferred...  ...employment if a candidate is found to have submitted false information... 
    Suggested
    Temporary work

    Coupang

    Mountain View, CA
    2 days ago
  • Bright Vision Technologies is seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance inference platforms for serving large ML models in production. The role emphasizes systems engineering, including request routing, batching, autoscaling... 
    Suggested
    Remote job

    Bright Vision Technologies

    Santa Clara, CA
    16 hours ago
  • $112k - $293k

    Francisco Partners is seeking a skilled Applied Scientist or ML Engineer in Mountain View, California. You will work on understanding...  ...intent classification, while deploying LLM-powered features into production. The ideal candidate has over 5 years of relevant experience... 
    Suggested
    Local area

    Francisco Partners

    Mountain View, CA
    3 days ago
  •  ...generative AI to assist engineers in RTL design,...  ...accelerating chip development. Founded by experts in AI and semiconductor...  ...is deployed in production to companies that have...  ...We are seeking an ML Systems Engineer to optimize...  ...and optimizing LLMs in production: model serving... 
    Suggested
    Full time

    ScOp Venture Capital

    Santa Clara, CA
    13 days ago
  •  ...alongside evolving ML workloads, and enable...  ...with Silicon with a founding team from Anthropic,...  ...applying that to industry-grade chips going into production at leading foundry...  ...and production engineering for chip designs, implementing...  ...RL and fine‑tuning LLMs and code models for... 
    Suggested

    Architect, Inc.

    Palo Alto, CA
    2 days ago
  • $128k - $260.5k

     ...One platform, its Zero Trust Engine, and the powerful NewEdge network...  ...(AI) and machine learning (ML) to protect the modern...  ...cutting-edge AI research into production-grade reality.Note on Leveling: We...  ...understanding of) optimizing LLMs in production. Familiarity with... 

    Netskope

    Santa Clara, CA
    1 day ago
  • $170.6k - $261.3k

     ...join us. About the team: The AV ML Infra team at GM builds end-to-end...  ...and developers facing products designed to meet the unique demands...  ...the productivity of ML engineers, and drive the adoption of cutting...  ...building and operating production-grade web applications 1+ years of... 
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  •  ...and cost-effectively in production. We bridge this exact...  ...and world-renowned ML systems researcher with...  ...Experience: Take research-grade ideas and make them...  ...experience engineering ML systems, OR a PhD...  ...build with a world-class founding team combining serial... 
    Shift work

    Success Matcher Recruitment

    Sunnyvale, CA
    a month ago
  •  ...world's most advanced LLMs, our proprietary models...  ...with Moveworks’ Reasoning Engine and natural language...  ...both models and agents in production. We are an eval-driven,...  ...build on the latest ML/LLM research and open-source...  ...with production-grade code Strong appetite... 
    Full time
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Mountain View, CA
    10 days ago
  • Jobtailor in Mountain View, CA is seeking an ML Engineer focused on growth analytics to develop lead...  ..., and collaborate with marketing and product teams to align ML solutions with growth goals. You will experiment with LLMs and recommendation systems to enhance content... 

    Jobtailor

    Mountain View, CA
    16 hours ago
  • A growing AI technology startup is seeking an ML Engineer to design and deploy production-grade systems. The role involves using Python and collaborating with teams to optimize customer interactions through advanced AI applications. Candidates should have a degree in Computer... 

    Catalyst Labs, LLC

    Mountain View, CA
    5 days ago
  •  ...& Co. in Palo Alto seeks a Machine Learning Engineer-Digital Intelligence to advance LLM-based research and scalable production systems. You will work with a high-caliber team...  ..., interpretability, and deploying novel ML ideas at scale, bridging research and engineering... 

    JPMorgan Chase & Co.

    Palo Alto, CA
    5 days ago
  • Meyandy LLC in Sunnyvale, CA is seeking a Founding Forward-Deployed ML Engineer to bridge research, deployment, and clinical operations in healthtech imaging. You will work on-site with hospital partners to evaluate and deploy models in clinical workflows, build evaluation... 

    Meyandy LLC

    Sunnyvale, CA
    3 days ago
  • Waymo is seeking a backend-focused engineer to design, scale, and optimize our real-time...  ...support global expansion. You will build production-grade services that process streaming data with...  ...and high reliability. You will develop ML-enabled pipelines in Python with TensorFlow... 

    Waymo

    Mountain View, CA
    2 days ago
  • Build and deploy ML models for lead scoring, conversion prediction...  ...with marketing and product to translate growth objectives...  ...ML solutions. Experiment with LLMs, recommendation systems, and generative...  ...3-10 years of hands‑on ML engineering, data science, or growth analytics... 

    Jobtailor

    Mountain View, CA
    16 hours ago
  • A tech-driven AI company is seeking an ML Engineer to design and deploy production-grade ML systems with full ownership of the model lifecycle. The ideal candidate will possess a degree in Computer Science and 1-6 years of experience in ML engineering, with robust programming... 

    Catalyst Labs, LLC

    Cupertino, CA
    5 days ago
  • $150k - $230k

    ### About the RoleThis is a founding-team opportunity at a small, fast-moving healthtech AI company building...  ...imaging AI. As a **Founding Forward-Deployed ML Engineer**, you will sit at the intersection of research, product deployment, and clinical operations — working directly... 
    Remote work

    Meyandy LLC

    Sunnyvale, CA
    3 days ago
  • Google is seeking software engineers to advance multimodal content generation within the GemFM team. You will build production-grade code for NotebookLM’s Content Studio and collaborate...  ...rapid prototyping, scheme for scalable ML pipelines, and contributing to documentation... 

    Google

    Mountain View, CA
    5 days ago
  • Waymo is seeking a software engineer with strong ML and data infrastructure skills to join the Perception team. This hybrid role reports to a Technical...  ...design scalable ML data infrastructure, collaborate with ML infra and domain teams, and drive improvements for real-world... 

    Neura Market

    Mountain View, CA
    4 days ago
  • $170k - $210k

    ABOUT THIS ROLE CORSAIR is building a production-grade AI/ML capability spanning intelligent...  ...systems, predictive analytics, and data engineering. As AI/ML Engineering Manager, you will...  ...0—$210,000 USDCORSAIR (NASDAQ:CRSR), founded in 1994, is a leading global developer... 
    For contractors
    Work experience placement

    Corsair

    Milpitas, CA
    4 days ago
  • $174.72k - $295.68k

     ..., FP4, and lower-bit techniques.Develop production-quality Python code with strong testing,...  ....Strong Python programming and software engineering skills.Ability to work effectively across...  ...or custom runtimes.Experience deploying LLMs on resource-constrained or heterogeneous... 
    Full time

    XPENG Motors

    Santa Clara, CA
    21 hours ago
  • $188.5k - $282.7k

     ...Semantic AI Governance Engine, which is the first system...  .../block decisions on production traffic.At its core, SAGE...  ...further.As an Applied ML Engineer on the SAGE...  ...can outperform frontier LLMs at the problems that matter...  ...) for production-grade training and evaluation... 
    Permanent employment
    Local area

    Rubrik

    Palo Alto, CA
    1 day ago
  • ServiceNow in Mountain View, CA, is seeking an experienced engineer to shape enterprise AI agents on the agent lab team. You will own end-to-end design and production-grade implementation of scalable AI agent systems, memory, and orchestration, integrating with Moveworks... 

    ServiceNow

    Mountain View, CA
    4 days ago
  • $151.8k - $265.35k

     ..., paired with creative production workflows and a media-intelligence...  ...Machine Learning Engineer to build the pipelines...  ...reliable, enterprise-grade products. You will...  ...pipelines including finetuned LLMs, image and video...  ...latency SLAs. Run production ML operationally - on-call... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    1 day ago
  • JPMorgan Chase & Co. is seeking a Senior Machine Learning Engineer-Digital Intelligence in the Digital Intelligence team. You will specialize...  ..., interpretability, and related algorithms, driving end-to-end ML solutions in a fast-paced environment. Ideal candidates bring a... 

    JPMorgan Chase & Co.

    Palo Alto, CA
    16 hours ago
  •  ...collaborate with experts across product, security, UX, and...  ...Address challenging engineering problems to build and...  ...advances in machine learning, LLMs, and AI agents to...  ...Collaborate with fellow ML engineers to learn,...  ...improvements with production-grade code High motivation... 
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Mountain View, CA
    4 days ago
  • $152k - $277k

     ...offline and online ML platforms to support...  ...easily consumed by engineers and scientists. You...  ...and discover products. If you are passionate...  ...large language models (LLMs), embedding-based...  ...building production grade ML systemsPreferred...  ...if a candidate is found to have submitted false... 
    Temporary work

    Coupang

    Mountain View, CA
    21 hours ago
  • A leading autonomous driving technology company in Mountain View is seeking an experienced professional to enhance ML infrastructure for training workloads. Responsibilities include designing distributed input data pipelines and collaborating with research teams to optimize... 

    Waymo

    Mountain View, CA
    2 days ago
  •  ...Description Job Description Job Description: We are looking for a senior ML infrastructure engineer to build and evolve the systems that support model training, deployment, and production usage. This role sits at the intersection of software engineering,... 

    Maxinsights Corporation

    Santa Clara, CA
    23 days ago
  • $100k

     ...all seniorities.Tenstorrent is seeking an Physical Design Engineer to lead cross-functional efforts to solve complex...  .... The engineer will architect, integrate, and deploy AI/ML-driven solutions into production physical design flows, creating custom CAD tools and partnering... 
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Founding ML Infra Engineer Production-Grade LLMs. Be the first to apply!