Senior ML Infra Engineer — Real-Time, Low-Latency (San Francisco)
Full-time
LMArena
A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal applicants have over five years of experience in software engineering with a strong background in distributed systems and a passion for building reliable infrastructure. This role offers competitive compensation and a chance to work with cutting-edge AI technologies in a collaborative environment.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior ML Infra Engineer — Real-Time, Low-Latency (San Francisco) in San Francisco, CA vacancy
$200k - $280k
...voice AI startup is seeking a Founding Senior Machine Learning Engineer to fine-tune and deploy human-like voice agents, handling millions of real-time calls. This role offers a salary range... ...real-world experience in deploying ML models and work well in a fast-paced environment...SeniorFull timeRetell AI
San Francisco, CA1 hour ago- ...A technology company in San Francisco is seeking a Senior Software Engineer to design and build APIs for delivering real-time data to customers. The role involves hands-on collaboration with engineering teams and utility partners, requiring expertise in API development...SeniorFull time
Gridware Technologies Inc.
San Francisco, CA1 hour ago - Senior ML Systems Engineer, Frameworks & Tooling at Cohere Our mission... ...closely with infra teams to ensure Slurm... ...engineering, profiling, or low-level systems. Why... ...your needs. Full‑Time Employees At Cohere... ...in Toronto, New York, San Francisco, London and Paris, as...SeniorFull timeWork at officeRemote workFlexible hours
Cohere
San Francisco, CA1 hour ago - ...Senior Staff Machine Learning Engineer, Community Support Engineering Airbnb... ...three guests to their San Francisco home, and has since... ...we rely on ML to ensure that guests... ...including both batch and real-time use cases.... ...model development, low-latency serving and ease of...SeniorFull timeWork experience placementCasual workLive inWork at officeRemote work
airbnb, Inc.
San Francisco, CA1 hour ago $200k - $250k
...A leading public transit innovator in San Francisco is seeking an Embedded Software Engineer to design and develop firmware for autonomous vehicles. This role... ...of communication protocols, and experience with real-time operating systems. The candidate will collaborate with...SeniorFull timeGlydways
San Francisco, CA1 hour ago- ...fast-growing AI startup is seeking a Senior Infrastructure Engineer in San Francisco. In this role, you will architect... ...You will contribute to optimizing ML infrastructure and integrating... ...knowledge of Kubernetes, AWS, and real-time processing. This position offers a...SeniorFull time
Open Select
San Francisco, CA1 hour ago $162k - $216k
...A cutting-edge technology firm in San Francisco is seeking a Software Engineer - Infrastructure to design and maintain a robust data streaming architecture. You will lead the near real-time data streaming platform while collaborating closely with stakeholders to simplify...Full timeBaton (A Ryder Technology Lab)
San Francisco, CA1 hour ago$160k - $300k
A pioneering AI company in San Francisco seeks a Senior / Staff Backend Engineer to design and build core systems for its intelligence platform. The role involves ensuring low-latency services and APIs with a focus on performance and security. Candidates should have 3-...SeniorFull timeApiphany Corporation
San Francisco, CA1 hour ago- ...A pioneering AI company in San Francisco is seeking a Senior / Staff Backend Engineer to design and scale backend services that handle massive engineering data... ...streams. You will be responsible for building low-latency services and APIs, mentoring team members, and ensuring...SeniorFull time
Apiphany
San Francisco, CA1 hour ago $180k - $195k
A technology firm focused on grid management is seeking a Senior Data Engineer to design and scale data infrastructure for real-time monitoring of the electrical grid. You will develop data pipelines that transform sensor data into actionable insights, ensuring high data...SeniorFull timeGridware
San Francisco, CA1 hour ago- ...A leading audio data research company in San Francisco is looking for a Senior Backend Engineer to design and maintain scalable backend services. You will work with APIs and distributed systems, ensuring high performance under heavy data loads. Ideal candidates should...SeniorFull timeFlexible hours
David AI
San Francisco, CA1 hour ago $180k - $270k
...Delaware-incorporated, San Francisco-based company pushing... ...-throughput, ultra-low-latency inference engines for large language models... ..., throughput, and Time-To-First-Token (or... ...Time-To-First-Audio) in real-time streaming... ...intersection between the core ML training team and the...Full timeWork at officeWorldwidePlaud
San Francisco, CA7 hours ago- A cutting-edge technology company in San Francisco is looking for a Founding ML Research Engineer to develop the infrastructure for training large speech models. This... ...experience with large models. Competitive salary range is offered for this full-time role. #J-18808-LjbffrFull time
Kalpa Labs (YC F25)
San Francisco, CA1 hour ago $140k - $240k
...Job Title: Senior Machine Learning Engineer Salary: $140,000 – $240,000 +... ...Benefits Job Type: Full-time About the Role: We’re... ...AI startup based in San Francisco , focused on transforming... ...focus on building real relationships and... ...building real-time AI and ML solutions that are...SeniorFull timeWilling Care Recruitment
San Francisco, CA1 hour ago$150k - $200k
...Senior Infrastructure Engineer Location: On-site, San Francisco, CA (3 days/week in office) Salary... ...power millions of real-time, AI-driven phone... ...platform reliability, ML inference... ...high-throughput, low-latency workloads and integrating... ...of cloud infra ~ Experience at...SeniorFull timeWork at office3 days per weekOpen Select
San Francisco, CA1 hour ago$160k - $300k
...technical data into real-time, actionable... ...how engineering decisions are... ...Role As a Senior / Staff Infrastructure... ...requirements for latency, availability,... ...to meet low-latency and high... ...Exposure to ML infra Personality... ...work: 3 days in San Francisco office ~401(...SeniorFull timeWork at officeVisa sponsorshipFlexible hoursApiphany
San Francisco, CA1 hour ago- A leading design technology company in San Francisco is seeking a Senior Software Engineer for Backend (Systems / Infrastructure). You will architect and deliver backend systems to maintain scalability as demand grows. This role involves optimizing APIs, managing GPU workloads...SeniorFull time
Vizcom
San Francisco, CA1 hour ago $164k - $312k
A leading technology company in San Francisco seeks a Senior ML Engineer to drive advanced prediction models for ad ranking systems. You will design and implement efficient systems that optimize engagement predictions. The ideal candidate holds an advanced degree and has...SeniorFull timeUnity
San Francisco, CA1 hour ago- A leading social media platform in San Francisco seeks a Machine Learning Engineer to develop personalized experiences using innovative ML techniques. The role demands expertise in recommendation systems and data processing, providing a unique opportunity to impact a user...SeniorFull time
Pinterest
San Francisco, CA1 hour ago - ...A leading educational technology company in San Francisco is seeking a Machine Learning Engineer to drive AI initiatives. This role requires extensive experience in Python, ML libraries, and a solid understanding of NLP. The successful candidate will collaborate with various...SeniorFull timeRemote workFlexible hours
Quizlet
San Francisco, CA1 hour ago - ...A leading technology firm is seeking a Senior Machine Learning Engineer to join their team in San Francisco. This hybrid role requires expertise in the entire machine... ...engineering skills in Python, and familiarity with modern ML tools. Join to make an impact on how users...SeniorFull time
TaskRabbit
San Francisco, CA1 hour ago - ...A growing healthtech startup in San Francisco is seeking a Member of Technical Staff – Machine Learning to build and scale machine learning... ...AI-powered platform. You will have 5+ years of experience with ML systems in production and strong skills in Python. This role involves...SeniorFull time
Quantix Search
San Francisco, CA1 hour ago - An innovative AI infrastructure startup in San Francisco is looking for a Senior ML Engineer to lead the development and operation of LLMs in production. The position requires extensive experience in software engineering and machine learning, particularly in deploying models...SeniorFull timeWork at officeFlexible hours2 days per week3 days per week
Sailplane
San Francisco, CA1 hour ago $200k - $400k
...corporation headquartered in San Francisco with a team of the... ...researchers and engineers from organizations like... ...years of experience in ML infra, research engineering,... ...reliable and useful in the real world. Preferred... ...have a small amount of time to do something incredibly...Full timeGoodfire
San Francisco, CA1 hour ago- ...Boston, MA; Chicago, IL; San Francisco Bay Area, CA; and... ...are looking for a Senior Staff Software Engineer to architect and lead... ...with varying latencies and SLAs. Provide... ...represents the anticipated low and high end of the... ...savings plan, paid time off, health savings...SeniorFull timeRemote workFlexible hours
WEX
San Francisco, CA1 hour ago - ML/AI Research Engineer — Agentic AI Lab (Founding Team) Location: San Francisco Bay Area Type: Full-Time Compensation: Competitive salary + meaningful equity... ...Optimize inference latency and GPU resource utilization... ...pipelines integrated with real‑time or contextual data...Full time
Fabrion
San Francisco, CA1 hour ago $200k - $280k
Founding Senior Machine Learning Engineer Join to apply for the Founding Senior... ...‑ownership role for ML engineers who want to... ...and perform under real‑world constraints. As... ...handle millions of real‑time phone conversations.... ...and deploy them into latency‑sensitive, high‑...SeniorFull timeH1bWork at officeRetell AI
San Francisco, CA1 hour ago- ...Valley, a small team of engineers is working on what... ...wear many hats (building ML platforms, MLOps tools,... ...paced environment. As a Senior ML Engineer, you will lead... ...work from our downtown San Francisco office 2 to 3 days per... ...software that creates real value for users Excellent...SeniorFull timeWork at officeFlexible hours2 days per week3 days per week
Sailplane
San Francisco, CA1 hour ago $250k - $375k
...Senior Software Engineer, Agent Orchestration Decagon is a leading... ...language at any time. Since emerging... ...behave reliably in real customer environments... ...Experience with real-time or low latency systems... ...by 2x. Location: San Francisco, CA #J-18808-LjbffrSeniorFull timeWork at officeDecagon
San Francisco, CA1 hour ago$100k - $400k
...Machine Learning Engineer for their... ...Opportunity: As a Staff ML Engineer, you... ...algorithms for real-time neural signal... ...with strict latency requirements Strong... ...For senior ML engineers seeking... ...00 2 weeks ago San Jose, CA $137,5... ...Safety Response San Francisco Bay Area $140,0...Full timeImmediate startMetric Bio
San Francisco, CA1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Infra Engineer — Real-Time, Low-Latency (San Francisco). Be the first to apply!
Related searches
- senior ml engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- senior vice president communications San Francisco, CA
- senior manager quality engineering San Francisco, CA
- senior device engineer San Francisco, CA
- sr operations manager San Francisco, CA