Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Inference Infrastructure Engineer for Large-Scale AI

causal

Causal is building a Large Physics foundation Model and seeks infrastructure engineers for high-throughput, low-latency inference at scale in San Francisco. You will work on evaluating physical observations, backtesting, and large-batch workflows, collaborating with researchers to push model performance. We value deep learning expertise, GPU-aware optimization, and production-grade engineering. Proficiency with PyTorch or JAX, Kubernetes-based orchestration, and open‑source inference tooling is #J-18808-Ljbffr causal

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Inference Infrastructure Engineer for Large-Scale AI in San Francisco, CA vacancy
  • Thinking Machines Lab Inc. is seeking a network engineer to own the lowest layers of the network stack for large-scale training and inference. You will ensure interconnect reliability across GPU fabrics, debugging NICs, and building instrumentation for faster troubleshooting... 
    Suggested

    Thinking Machines Lab Inc.

    San Francisco, CA
    2 days ago
  • $250k

     ...Ready to architect AI infrastructure that powers next-generation research...  ...now building a serverless inference platform, beginning with cost...  ...Senior Inference Platform Engineer at an early stage and help...  ...years’ experience building large-scale, fault-tolerant distributed... 
    Suggested
    Full time
    San Francisco, CA
    more than 2 months ago
  •  ...Associates Limited is seeking a Staff-level engineer to architect and evolve the AI infrastructure software stack for large-scale GPU workloads. You’ll drive orchestration,...  ...production environment. You’ll contribute to inference platforms, model serving, and high-... 
    Suggested

    Hamilton Barnes Associates Limited

    San Francisco, CA
    2 days ago
  • $342k

     ...OpenAI is currently looking for an experienced Optical Network Engineer based in San Francisco, California. This role involves leading laser-related efforts in optical interconnect projects for large-scale compute systems, ensuring performance and manufacturability of... 
    Suggested

    OpenAI

    San Francisco, CA
    3 days ago
  •  ...seeking a Machine Learning Engineer to join our Inference Infrastructure team. You will build and...  ...Responsibilities Architect, build, and scale low-latency distributed...  ...experience building large-scale distributed systems...  ...wellness stipends. #J-18808-Ljbffr AI Breaking Wire
    Suggested
    Worldwide
    Flexible hours

    AI Breaking Wire

    San Francisco, CA
    5 days ago
  •  ...fans out into multiple AI inference requests running in...  ...time. Behind that sits a large GPU fleet spread...  ...Today, our inference engineers and researchers build...  ...take ownership of that infrastructure and hide its complexity...  ...managed GPU clusters at scale: NVIDIA hardware, CUDA... 
    Shift work

    Neura Market

    San Francisco, CA
    3 days ago
  • $200k - $400k

     ...Job Description Machine Learning Infrastructure Engineer San Francisco, CA · On-site (5...  ...Our client is a Series A AI research lab building large-scale foundation models for scientific...  ...own the distributed training and inference backbone for a foundation model trained... 
    Full time
    Visa sponsorship
    Relocation package

    David Joseph & Company

    San Francisco, CA
    14 days ago
  • OpenAI is seeking an experienced software engineer to join the GPT Infrastructure team and help build an automated inference optimization platform that scales research prototypes into production‑ready solutions. You will design durable APIs and control‑plane services,... 

    OpenAI

    San Francisco, CA
    4 days ago
  • $350k

     ...Network Engineer The mission of Thinking Machines is to build AI that extends human will and judgment. About the Role We're looking for...  ...lowest layers of the network stack that our large-scale training and inference depend on. A single degraded link or flapping... 
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    2 days ago
  •  ...Senior Network Engineer Houston; New York; San...  ...cloud engineered for AI. We provide cost-...  ...effective, high-performance infrastructure for AI start-ups and large enterprise customers...  ...networks, inference traffic paths, and storage...  ...with large-scale DCI, long-haul optical... 

    Nscale

    San Francisco, CA
    2 days ago
  • $190k - $280k

     ...Senior Network Engineer San Francisco About the Role Together AI is looking for a Senior Network...  ...the global network infrastructure supporting our...  ...boundaries. You will work on large-scale, multi-vendor data...  ...Understanding of AI training and inference traffic patterns and... 
    Full time

    Together AI

    San Francisco, CA
    2 days ago
  • $200k

     ...this by building the financial infrastructure that makes it easier for...  ...investors on AngelList. While our scale is large, our ambition is larger....  ...As a Senior Infrastructure Engineer, you will shape the platform...  ...use artificial intelligence (AI) tools to support parts of... 
    Work at office
    2 days per week

    AngelList

    San Francisco, CA
    24 days ago
  • $179.4k - $224.25k

    Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform...  ...retrieval, inference, evaluation, and more...  ...looking for a strong engineer to join our team and...  ...and scale our core infrastructure in a fast-paced environment...  ...as experience with large-scale distributed... 
    Full time

    Scale AI

    San Francisco, CA
    2 days ago
  •  ...Team We’re hiring software engineers to make OpenAI’s...  ...support OpenAI’s training and inference infrastructure at frontier scale. About the Role We...  ...infrastructure components that support large-scale training and...  ...OpenAI OpenAI is an AI research and deployment company... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  • $350k

     ...AI Infrastructure EngineerThe mission of Thinking Machines is to build...  ...hiring an AI Infrastructure Engineer to keep our post-training and...  ...performance, and uptime of large-scale post-training and RL...  ...generation, and mixed training/inference workloadsExperience with distributed... 
    Permanent employment
    Visa sponsorship
    Work visa
    Relocation package
    Shift work

    Thinking Machines Lab

    San Francisco, CA
    2 days ago
  • $225k

     ...opportunity?  Join a rapidly scaling AI cloud infrastructure provider building next-...  ...GPU platforms designed for large-scale AI training, experimentation, and inference workloads. The company is operating...  ...for a Senior Network Engineer to design, deploy, and support... 
    Full time
    Remote work
    San Francisco, CA
    more than 2 months ago
  •  ...the Team The Core Network Engineering team owns the end-to-end...  ...OpenAI’s compute infrastructure — spanning global WAN/edge...  .../xPU networking used for large-scale training and inference workloads. This team is...  ...the world’s most advanced AI infrastructure. About... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...FriendliAI is looking for a Cloud Infrastructure Engineer to own the architecture and...  ...behind our GPU-accelerated AI inference cloud. As a Software...  ...engineer who has already run large clusters in production and...  ...traffic: queue-driven pod scaling, node autoscaling, scale-to... 
    Permanent employment
    Full time
    Flexible hours

    FriendliAI

    San Francisco, CA
    1 day ago
  • $310k

    A leading AI research organization is looking for a Software Engineer for their Platform Systems team in San Francisco. You will design and build systems for large-scale AI training workloads, focusing on reliability and performance. Ideal candidates should have a deep... 

    OpenAI

    San Francisco, CA
    3 days ago
  •  ...and video. Our team also manages large-scale inference and platform infrastructure that supports these experiences at...  ...unchecked growth. Within Applied Engineering, the Ads Monetization team in...  ...About OpenAI OpenAI is an AI research and deployment company dedicated... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  • $160k - $230k

     ...About the Role Together AI is building the AI Acceleration Cloud...  ..., combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer...  ...demonstrated experience in building large scale, fault tolerant, distributed... 
    Full time
    Remote work

    Together Ai

    San Francisco, CA
    1 day ago
  • $350k

     ...interpretable, and steerable AI systems. We want...  ...researchers, engineers, policy experts,...  ...cheaply and at scale. This work feeds directly...  ...to own the infrastructure behind that research...  ...record of solving large-scale systems and...  ...reliability of large-scale inference and scoring... 
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Jobzhr

    San Francisco, CA
    5 days ago
  •  ...About David AI David AI is the first audio...  ...by a team of former Scale AI engineers and operators. In less...  ...of product engineers, infrastructure specialists, and machine...  ...async processing, or large-scale data pipelines....  ...data. Scaled up inference and train compute for... 
    Full time
    Work at office

    David AI

    San Francisco, CA
    20 hours ago
  • Anthropic is seeking an engineer to own the infrastructure behind safeguards research. You will build the tooling researchers rely on to run experiments...  ...candidates will have a track record of solving large-scale systems and data problems and will grow deep machine learning... 

    Jobzhr

    San Francisco, CA
    5 days ago
  • $245k - $295k

     ...vertically integrated AI infrastructure company built from...  ..., who believe in the scale of our ambition and thrive...  ...Platform Engineering to lead a team building...  ...core systems that turn large-scale compute infrastructure...  ..., AI training, and inference workloads Working... 
    Temporary work
    Immediate start

    Crusoe

    San Francisco, CA
    11 days ago
  • $155.4k - $273.7k

     ...world's leading enterprises orchestrate AI-powered work. Our vision is to expand...  ...performant, and reliable, 24/7. As an Infrastructure engineer, you'll be at the heart of making this...  ...focused on building and operating large-scale, high-availability production systems... 
    Full time
    Work at office
    Local area
    Shift work

    Writer

    San Francisco, CA
    6 days ago
  •  ...We’re looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations...  ...on is probably the largest anime AI training cluster in the world . You’...  ...get to combine your love of anime and large-scale GPU systems. You’re familiar with... 
    Work at office
    Visa sponsorship

    Spellbrush

    San Francisco, CA
    23 days ago
  •  ...worldwide.We’re a team of engineers, clinicians, and...  ...development for robotic motion AI. You will work closely...  ...and maintain software infrastructure for robotic...  ...engineering productivity across large-scale software projects....  ...processing, model inference, and experimentation.... 
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    San Francisco, CA
    2 days ago
  •  ...costly and challenging to scale. Our ambition is to build...  ...by our cutting-edge AI research. As a Data Infrastructure Engineer, you will lead the development...  ...infrastructure for large-scale AI or machine learning...  ...building large scale batch inference system Prior experience in... 

    HeyGen

    San Francisco, CA
    2 days ago
  •  ...they had to do. Powerful AI will be the biggest...  ...deploys frontier compute infrastructure fastest will decide whether...  ...software. Speed and scale are our key...  ...architectures for AI training and inference. Produce topology designs...  ...platform integration. Large‑cluster (100k+... 
    Local area

    Fluidstack

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Inference Infrastructure Engineer for Large-Scale AI. Be the first to apply!