Inference Infrastructure Engineer for Large-Scale AI
causal
Causal is building a Large Physics foundation Model and seeks infrastructure engineers for high-throughput, low-latency inference at scale in San Francisco. You will work on evaluating physical observations, backtesting, and large-batch workflows, collaborating with researchers to push model performance. We value deep learning expertise, GPU-aware optimization, and production-grade engineering. Proficiency with PyTorch or JAX, Kubernetes-based orchestration, and open‑source inference tooling is #J-18808-Ljbffr causal
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Inference Infrastructure Engineer for Large-Scale AI in San Francisco, CA vacancy
- Thinking Machines Lab Inc. is seeking a network engineer to own the lowest layers of the network stack for large-scale training and inference. You will ensure interconnect reliability across GPU fabrics, debugging NICs, and building instrumentation for faster troubleshooting...Suggested
$250k
...Ready to architect AI infrastructure that powers next-generation research... ...now building a serverless inference platform, beginning with cost... ...Senior Inference Platform Engineer at an early stage and help... ...years’ experience building large-scale, fault-tolerant distributed...SuggestedFull timeSan Francisco, CAmore than 2 months ago- ...Associates Limited is seeking a Staff-level engineer to architect and evolve the AI infrastructure software stack for large-scale GPU workloads. You’ll drive orchestration,... ...production environment. You’ll contribute to inference platforms, model serving, and high-...Suggested
$342k
...OpenAI is currently looking for an experienced Optical Network Engineer based in San Francisco, California. This role involves leading laser-related efforts in optical interconnect projects for large-scale compute systems, ensuring performance and manufacturability of...SuggestedOpenAI
San Francisco, CA3 days ago- ...seeking a Machine Learning Engineer to join our Inference Infrastructure team. You will build and... ...Responsibilities Architect, build, and scale low-latency distributed... ...experience building large-scale distributed systems... ...wellness stipends. #J-18808-Ljbffr AI Breaking WireSuggestedWorldwideFlexible hours
- ...fans out into multiple AI inference requests running in... ...time. Behind that sits a large GPU fleet spread... ...Today, our inference engineers and researchers build... ...take ownership of that infrastructure and hide its complexity... ...managed GPU clusters at scale: NVIDIA hardware, CUDA...Shift work
$200k - $400k
...Job Description Machine Learning Infrastructure Engineer San Francisco, CA · On-site (5... ...Our client is a Series A AI research lab building large-scale foundation models for scientific... ...own the distributed training and inference backbone for a foundation model trained...Full timeVisa sponsorshipRelocation packageDavid Joseph & Company
San Francisco, CA14 days ago- OpenAI is seeking an experienced software engineer to join the GPT Infrastructure team and help build an automated inference optimization platform that scales research prototypes into production‑ready solutions. You will design durable APIs and control‑plane services,...
$350k
...Network Engineer The mission of Thinking Machines is to build AI that extends human will and judgment. About the Role We're looking for... ...lowest layers of the network stack that our large-scale training and inference depend on. A single degraded link or flapping...Immediate startVisa sponsorshipWork visaRelocation packageThinking Machines Lab
San Francisco, CA2 days ago- ...Senior Network Engineer Houston; New York; San... ...cloud engineered for AI. We provide cost-... ...effective, high-performance infrastructure for AI start-ups and large enterprise customers... ...networks, inference traffic paths, and storage... ...with large-scale DCI, long-haul optical...
Nscale
San Francisco, CA2 days ago $190k - $280k
...Senior Network Engineer San Francisco About the Role Together AI is looking for a Senior Network... ...the global network infrastructure supporting our... ...boundaries. You will work on large-scale, multi-vendor data... ...Understanding of AI training and inference traffic patterns and...Full timeTogether AI
San Francisco, CA2 days ago$200k
...this by building the financial infrastructure that makes it easier for... ...investors on AngelList. While our scale is large, our ambition is larger.... ...As a Senior Infrastructure Engineer, you will shape the platform... ...use artificial intelligence (AI) tools to support parts of...Work at office2 days per weekAngelList
San Francisco, CA24 days ago$179.4k - $224.25k
Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform... ...retrieval, inference, evaluation, and more... ...looking for a strong engineer to join our team and... ...and scale our core infrastructure in a fast-paced environment... ...as experience with large-scale distributed...Full time- ...Team We’re hiring software engineers to make OpenAI’s... ...support OpenAI’s training and inference infrastructure at frontier scale. About the Role We... ...infrastructure components that support large-scale training and... ...OpenAI OpenAI is an AI research and deployment company...Full time
OpenAI
San Francisco, CA1 day ago $350k
...AI Infrastructure EngineerThe mission of Thinking Machines is to build... ...hiring an AI Infrastructure Engineer to keep our post-training and... ...performance, and uptime of large-scale post-training and RL... ...generation, and mixed training/inference workloadsExperience with distributed...Permanent employmentVisa sponsorshipWork visaRelocation packageShift workThinking Machines Lab
San Francisco, CA2 days ago$225k
...opportunity? Join a rapidly scaling AI cloud infrastructure provider building next-... ...GPU platforms designed for large-scale AI training, experimentation, and inference workloads. The company is operating... ...for a Senior Network Engineer to design, deploy, and support...Full timeRemote workSan Francisco, CAmore than 2 months ago- ...the Team The Core Network Engineering team owns the end-to-end... ...OpenAI’s compute infrastructure — spanning global WAN/edge... .../xPU networking used for large-scale training and inference workloads. This team is... ...the world’s most advanced AI infrastructure. About...Full time
OpenAI
San Francisco, CA1 day ago - ...FriendliAI is looking for a Cloud Infrastructure Engineer to own the architecture and... ...behind our GPU-accelerated AI inference cloud. As a Software... ...engineer who has already run large clusters in production and... ...traffic: queue-driven pod scaling, node autoscaling, scale-to...Permanent employmentFull timeFlexible hours
FriendliAI
San Francisco, CA1 day ago $310k
A leading AI research organization is looking for a Software Engineer for their Platform Systems team in San Francisco. You will design and build systems for large-scale AI training workloads, focusing on reliability and performance. Ideal candidates should have a deep...- ...and video. Our team also manages large-scale inference and platform infrastructure that supports these experiences at... ...unchecked growth. Within Applied Engineering, the Ads Monetization team in... ...About OpenAI OpenAI is an AI research and deployment company dedicated...Full time
OpenAI
San Francisco, CA1 day ago $160k - $230k
...About the Role Together AI is building the AI Acceleration Cloud... ..., combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer... ...demonstrated experience in building large scale, fault tolerant, distributed...Full timeRemote workTogether Ai
San Francisco, CA1 day ago$350k
...interpretable, and steerable AI systems. We want... ...researchers, engineers, policy experts,... ...cheaply and at scale. This work feeds directly... ...to own the infrastructure behind that research... ...record of solving large-scale systems and... ...reliability of large-scale inference and scoring...Work at officeVisa sponsorshipFlexible hoursShift work- ...About David AI David AI is the first audio... ...by a team of former Scale AI engineers and operators. In less... ...of product engineers, infrastructure specialists, and machine... ...async processing, or large-scale data pipelines.... ...data. Scaled up inference and train compute for...Full timeWork at office
David AI
San Francisco, CA20 hours ago - Anthropic is seeking an engineer to own the infrastructure behind safeguards research. You will build the tooling researchers rely on to run experiments... ...candidates will have a track record of solving large-scale systems and data problems and will grow deep machine learning...
$245k - $295k
...vertically integrated AI infrastructure company built from... ..., who believe in the scale of our ambition and thrive... ...Platform Engineering to lead a team building... ...core systems that turn large-scale compute infrastructure... ..., AI training, and inference workloads Working...Temporary workImmediate startCrusoe
San Francisco, CA11 days ago$155.4k - $273.7k
...world's leading enterprises orchestrate AI-powered work. Our vision is to expand... ...performant, and reliable, 24/7. As an Infrastructure engineer, you'll be at the heart of making this... ...focused on building and operating large-scale, high-availability production systems...Full timeWork at officeLocal areaShift work- ...We’re looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations... ...on is probably the largest anime AI training cluster in the world . You ’... ...get to combine your love of anime and large-scale GPU systems. You’re familiar with...Work at officeVisa sponsorship
Spellbrush
San Francisco, CA23 days ago - ...worldwide.We’re a team of engineers, clinicians, and... ...development for robotic motion AI. You will work closely... ...and maintain software infrastructure for robotic... ...engineering productivity across large-scale software projects.... ...processing, model inference, and experimentation....Local areaWorldwideFlexible hours
- ...costly and challenging to scale. Our ambition is to build... ...by our cutting-edge AI research. As a Data Infrastructure Engineer, you will lead the development... ...infrastructure for large-scale AI or machine learning... ...building large scale batch inference system Prior experience in...
- ...they had to do. Powerful AI will be the biggest... ...deploys frontier compute infrastructure fastest will decide whether... ...software. Speed and scale are our key... ...architectures for AI training and inference. Produce topology designs... ...platform integration. Large‑cluster (100k+...Local area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference Infrastructure Engineer for Large-Scale AI. Be the first to apply!
Related searches
- senior infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- infrastructure developer San Francisco, CA
- entry level infrastructure engineer San Francisco, CA
- security infrastructure engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- infrastructure engineer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA
- infrastructure engineering manager San Francisco, CA