Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Inference Systems Engineer for Scalable AI

United States Digital Space LLC

United States Digital Space LLC in San Francisco seeks a skilled engineer to design and maintain distributed systems, ensuring AI functionality for millions globally. The role involves load balancing, request routing, and maximizing compute efficiency in a hybrid work environment. Ideal candidates have strong software engineering backgrounds, ideally with distributed systems and machine learning. A Bachelor’s degree is required, along with proficiency in tools like Kubernetes and Python. #J-18808-Ljbffr United States Digital Space LLC

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Inference Systems Engineer for Scalable AI in San Francisco, CA vacancy
  • A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving...  ...candidates should have strong software engineering skills and experience with ML inference... 
    Senior

    Gimlet Labs

    San Francisco, CA
    2 days ago
  • MakerMaker.AI is looking for a Senior Machine Learning Systems Engineer in San Francisco. In this role, you will build and operate production inference systems, optimizing for performance and reliability. The ideal candidate will have 3+ years of experience in production... 
    Senior

    MakerMaker.AI

    San Francisco, CA
    1 day ago
  • $300k

    United States Digital Space LLC is seeking a skilled software engineer to join the Inference team in San Francisco. You will be responsible for building and maintaining systems that serve Claude to millions of users. The role emphasizes maximizing compute efficiency and... 
    Senior
    Work at office

    United States Digital Space LLC

    San Francisco, CA
    2 days ago
  • A growing technology company in San Francisco is seeking a Senior Machine Learning Engineer to design and implement advanced ML systems. Responsibilities include optimizing data pipelines and collaborating with product teams. The ideal candidate has strong experience in... 
    Senior
    Flexible hours

    EvenUp Inc.

    San Francisco, CA
    3 days ago
  • $300k

    A leading AI startup is seeking exceptional Backend Software Engineers to help architect, build, and scale the infrastructure behind their innovative AI systems. Candidates should have over 5 years of backend...  ...role focuses on designing scalable backend systems and... 
    Senior
    Remote job

    Stealth AI Startup

    San Francisco, CA
    3 days ago
  •  ...of experience in backend systems or infrastructure engineering Strong software engineering...  ...Experience designing scalable APIs, backend systems and...  ...context formatting, batch inference, prompt-tuning workflows)...  ...critical in enabling our AI engineers, analysts, and data... 
    Senior
    Flexible hours

    Trust Lab

    San Francisco, CA
    2 days ago
  • United States Digital Space LLC is seeking a Senior Software Engineer to lead system design and technical architecture for our business product platform. You will drive architecture for scalable systems, incorporate AI into products, and work collaboratively with cross-... 
    Senior
    Work at office
    3 days per week

    United States Digital Space LLC

    San Francisco, CA
    3 days ago
  • TRM Labs, based in San Francisco, is seeking a Senior Infrastructure Engineer to design and build scalable infrastructure for AI-powered intelligence solutions. You will work...  ...engineers to enhance security and automate systems. This role requires a minimum of 3 years of experience... 
    Senior

    Trm-Labs

    San Francisco, CA
    5 days ago
  • A tech-driven company focused on blockchain solutions is seeking a Senior ML Systems Engineer. In this role, you will build reusable workflows, automate model versioning, and deploy scalable AI systems. Candidates should have strong programming skills, experience with... 
    Senior

    TRM Labs

    San Francisco, CA
    4 days ago
  • A leading AI technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation...  ...models. You will design distributed training systems and optimize GPU utilization while... 
    Senior

    Baseten

    San Francisco, CA
    4 days ago
  • Scribe is seeking a Sr. Software Engineer, Backend to aid in building backend systems for their product. The role focuses on large-scale data ingestion, workflow processing, and AI capabilities using Python, Typescript, and Go. Candidates should have 8+ years of experience... 
    Senior
    Flexible hours

    scribehow.com

    San Francisco, CA
    5 days ago
  • United States Digital Space LLC is hiring for a role in AI Reliability Engineering in San Francisco, CA. This position requires expertise in reliability-focused roles with experience in distributed systems and communication skills. The responsibilities include developing... 
    Senior

    United States Digital Space LLC

    San Francisco, CA
    3 days ago
  •  ...technology company is seeking a skilled Software Engineer with a backend focus to develop and...  ...-services for its cutting-edge data and AI platform. This role requires extensive...  ...alongside a strong grasp of distributed systems and cloud technologies. As part of a diverse... 
    Senior

    Databricks

    San Francisco, CA
    2 days ago
  • OutSystems, Inc. is looking for a Site Reliability Engineer to join their team in San Francisco, CA. The ideal candidate will lead the onboarding of services and teams to reliability tenets while establishing SLOs and SLAs. Proficiency in Python and experience with Kubernetes... 
    Senior
    Flexible hours

    OutSystems, Inc.

    San Francisco, CA
    2 days ago
  •  ...of a traditional space mission. As a Senior Product Systems Engineer at Loft, you will own the...  ...Help ensure solutions are reusable, scalable, and understandable rather than tailored...  ...observation, IoT connectivity, on‑orbit AI, national security missions, and more... 
    Senior
    Temporary work
    Work at office
    Relocation package
    Flexible hours

    jobr.pro

    San Francisco, CA
    4 days ago
  • A leading financial services company is seeking a Sr. Lead AI Engineer in San Francisco. This role involves building AI systems, collaborating with engineers and scientists, and driving innovation in financial services. The ideal candidate should have extensive experience... 
    Senior

    Capital One National Association

    San Francisco, CA
    3 days ago
  • $200k - $240k

     ...blockchain analytics and AI solutions to help law enforcement...  ...financial crime. Our AI engineering team focuses on next‑...  ...language models and agentic systems, building robust pipelines...  ...for rapid, safe, and scalable AI deployments. Senior or Staff ML Systems Engineer... 
    Senior

    Dormont Manufacturing Co

    San Francisco, CA
    3 days ago
  • Salesforce is seeking a Senior Member of Technical Staff (SMTS) - AI Software Engineer to join the team driving the development of Agentforce in San Francisco. In this critical role, you will maintain core execution engines and tackle complex challenges with a focus on... 
    Senior

    Salesforce

    San Francisco, CA
    2 days ago
  • $166.9k - $225.9k

     ...operates as both a central engineering function and an...  ...software engineering and systems engineering. The best...  ...building and maintaining scalable, resilient services...  ...Experience with AIOps - using AI/ML-based tooling for...  ...services (e.g., LLM inference latency, non-... 
    Senior
    Work at office
    Immediate start
    Worldwide
    Monday to Friday
    Flexible hours

    Drata Inc

    San Francisco, CA
    3 days ago
  • $102k - $182.71k

     ...20 Position Overview We’re seeking a Senior Search Systems Engineer to build the intelligence and automation...  ...sits on top of our marketing and AI visibility data. This role focuses on...  ...engineers, and BI teams to operationalize scalable datasets, transformation logic,... 
    Senior
    Shift work

    Autodesk

    San Francisco, CA
    4 days ago
  • $279.2k - $390.9k

     ...recommendations. We design and maintain systems for ML data ingestion, low-...  ...performance, reliability, and scalability, we enable real-time access to...  ...ML Indexing & Retrieval engine, integrating capabilities...  ...summarized by artificial intelligence (AI). You will have the... 
    Senior
    For contractors
    Work experience placement
    Flexible hours

    Tensec

    San Francisco, CA
    4 days ago
  • $174k - $215k

     ...they love. With proprietary AI built on over a decade of real...  ...Hover wants you Hover's GTM Systems team owns the full technical...  ...This is a net new role for a senior engineer who wants breadth and ownership...  ...priorities and translate them into scalable, maintainable system designs.... 
    Senior
    Full time
    For contractors
    Work at office
    Local area
    Flexible hours

    Menlo Ventures

    San Francisco, CA
    2 days ago
  •  ...Francisco is looking for its first Finance Systems Engineer to implement and improve financial...  ...business. This role focuses on creating scalable and reliable finance processes in Order...  ...and partner with various teams, driving AI-forward automation and efficiency. #J-1... 

    Neura Market

    San Francisco, CA
    3 days ago
  • $195k - $225k

    The Role As the Senior Software Engineer - Backend (Systems / Infrastructure) you’ll architect...  ...Vizcom fast, reliable, and scalable as our workload and...  ...collaborating with frontend and AI teams to enable magical...  ...to integrate GPU inference pipelines into user workflows... 
    Senior

    Vizcom Technologies, Inc.

    San Francisco, CA
    2 days ago
  • $166.9k - $225.9k

     ...operates as both a central engineering function and an...  ...software engineering and systems engineering. The best...  ...building and maintaining scalable, resilient services....  ...with AIOps—using AI/ML‑based tooling for anomaly...  ...services (e.g., LLM inference latency, non‑determinism... 
    Senior
    Flexible hours

    Drata

    San Francisco, CA
    3 days ago
  • Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San Francisco...  ...quietly building the systems, network, and orchestration...  ...routes training and inference jobs across global supply...  ...infrastructure backbone for reliable, scalable AI compute. You’ll... 
    Senior
    Full time
    Remote work

    Cortes 23

    San Francisco, CA
    2 days ago
  • AI Chopping Block, Inc. is seeking a Machine Learning Engineer to design and build scalable machine learning systems. Responsibilities involve developing end-to-end ML pipelines, optimizing AI models for mobile environments, and integrating AI-driven solutions into applications... 

    AI Chopping Block, Inc.

    San Francisco, CA
    2 days ago
  •  ...Member of Technical Staff focused on ML systems and inference in San Francisco. You will design and...  ..., ensuring fast, predictable, and scalable performance. Key responsibilities include...  ...have strong foundations in software engineering, experience with ML inference systems... 

    Gimlet Labs, Inc.

    San Francisco, CA
    4 days ago
  • $150k - $190k

     ...developed an artificial intelligence (AI) powered technology stack purpose-...  ...the U.S. Department of Defense. The Systems and Safety Engineering team at Kodiak is seeking an experienced...  ...to progressing towards achieving a scalable driverless deployment and will work... 
    Senior
    Temporary work
    Work at office
    Visa sponsorship
    Flexible hours

    Kodiak

    San Francisco, CA
    9 hours ago
  •  ...LLC is looking for a Software Engineer to join the Launch Engineering...  ...for continuous and unattended inference deployment. The ideal candidate...  ...of experience in deployment systems, strong software engineering skills...  ...and efficient deployments for AI systems. #J-18808-Ljbffr... 
    Senior

    United States Digital Space LLC

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Inference Systems Engineer for Scalable AI. Be the first to apply!