Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distributed Systems Engineer

Arcade

The Revolution Needs You

Every AI app needs agentic "tools" - special functions that let AI models take real actions. Without tools, AI can only chat. With tools, AI can actually do things. We're building the definitive tools catalog and tool-calling platform that will unlock AI's true potential. Think Zapier for AI Actions. Think Auth0 for AI. Think really big.

Why This Is The Opportunity Of A Lifetime

Founder-Market Fit: Our CEO previously founded Stormpath (acquired by Okta), where he created the first Authentication API for developers. He's done this before - and this time the market is 10x bigger. Our CTO led the vector database team at Redis, shipped 100+ LLM applications, and is a contributor to LangChain and LlamaIndex. He knows this space better than anyone.

Dream Team: We've assembled authentication, integrations, distributed systems, and AI experts from Okta, Redis, Microsoft, Splunk, Ngrok, Google, Airbyte, Disney, and HPE who've built and founded multiple successful developer platforms.

Perfect Timing: We're at the inflection point of AI adoption. The biggest problem isn't better models - it's connecting AI to real-world actions. That's us.

Massive Market: We're building critical infrastructure for the biggest technological shift of our generation. Every AI app will need what we're building.

Backed By The Best: Our investors have backed Databricks, Clickhouse, MongoDB, Perplexity, Cohere, ScaleAI, Confluent, Elastic, and Firebase. They see what we see - this is going to be huge.

The Challenge

We are building the runtime and registry for AI/LLM tools. You will define both how AI interacts with the world, and how humans build and manage those tools. This includes creating production-grade integrations, and the services & toolkits that run them... and the solving the unique problems of AI/LLM usage along the way. We are building a SaaS application first, and then allowing folks to run part of that infrastructure on-site via hybrid deployments.

This role is primarily focused on our back-end services, but as an early member of a startup, you'll be working up-and-down the stack. We build our software with Go, Python, and Typescript, and expect you to be a pro in at least one of those. We are looking for people who constantly ship and don't get stuck - we are looking for folks who are always learning and and able to apply that knowledge to their work and teach it to the team.

What You'll Do
  • Build the infrastructure to manage the backplane for all future AI tools
  • Design, build, test, and deploy high-performance, secure, production-grade software.
  • Develop SDKs and frameworks that make it easy for other developers to build custom tools
  • Help set industry standards for tool calling and authorization (for example, we helped write the MCP authorization spec)
  • Create integrations with major platforms and LLMs (Google Workspace, Microsoft 365, OpenAi, Anthropic, etc.)
  • Shape the roadmap for the team
  • Build leverage (via AI) - projects that take a week today should take a day next time.
  • Share your work with our customers and community, building our (and your) brand.
Required Skills
  • An insatiable desire to ship.
  • 7+ years of software engineering experience comprising of:
    • 5+ years of backend development experience with either Python, Go, Ruby, Typescript, or a similar language and API & Web frameworks.
    • 2+ years of experience with infrastructure and deployment (AWS/GCP, Terraform, Helm, etc)
  • Strong experience building and maintaining production APIs.
  • Track record of writing clean, well-documented, well-tested code.
  • User-centered approach to designing developer-centric products and tools.
Bonus Points
  • Experience building developer tools or SDKs
  • Familiarity with LLMs and AI frameworks (Langchain, LlamaIndex, etc)
  • Open-source contributions
  • Experience with high-scale distributed systems
  • Experience leading teams and mentoring more junior developers
  • Familiarity with Typescript and a relevant frontend framework (e.g. React)
  • You've been a startup founder or early-state startup employee before and love it
Notes
  • This is an in-person role located in our San Francisco (SOMA) office.
Join The Movement

We're not just building a product - we're leading a movement to transform AI from just chatbots to agents that can take actions against real systems. This is your chance to be at the forefront of that revolution.

If you want to look back in 5 years and say, "I helped build that", then we want to talk to you. Ready to make AI actually useful? Apply Now

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer in San Francisco, CA vacancy
  •  ...Dream Team : We've assembled authentication, integrations, distributed systems, and AI experts from Okta, Redis, Microsoft, Splunk, Ngrok,...  ...~ An insatiable desire to ship. ~7+ years of software engineering experience comprising of: ~5+ years of backend development... 
    Suggested
    Work at office
    Shift work

    Arcade AI, Inc

    San Francisco, CA
    15 hours ago
  •  ...Distributed Systems Engineer As a distributed systems engineer, you'll work across the stack to solve problems as they come up and help build Archil volumes. You'll have significant influence over the technical and product direction. We'll expect you to be able... 
    Suggested
    Flexible hours

    Archil

    San Francisco, CA
    4 days ago
  •  ...time putting knowledge into action. We're looking for engineers who want to build the operating system for AI Data Applications and Workflows. About the role We're looking for experienced distributed systems engineers to build the core infrastructure for our... 
    Suggested

    Tensorlake, Inc.

    San Francisco, CA
    3 days ago
  • $180k - $300k

     ...redefine how value is discovered, priced, and distributed in real time. The mission centers on...  ..., transparency, and efficiency to systems where value is currently fragmented and...  ...components and services while establishing engineering best practices and code quality... 
    Suggested
    Full time
    Remote work
    Flexible hours

    MLabs Ltd

    San Francisco, CA
    2 days ago
  • $175k - $240k

    Langchain is hiring a Systems/Database Engineer based in San Francisco. The ideal candidate will have over 5 years of experience in systems/database...  ...query execution, optimizing performance, and deploying distributed database services. Compensation ranges from $175,000 to $2... 
    Suggested
    Flexible hours

    Langchain

    San Francisco, CA
    3 days ago
  • $160k - $180k

    Ultimate.ai is looking for a talented backend engineer to join their Realtime Infrastructure team in the San Francisco Bay Area. You will build and operate large-scale distributed systems that are critical for Discord's functionality. The ideal candidate will have at least... 

    Ultimate.ai

    San Francisco, CA
    2 days ago
  • Motive Partners in San Francisco is looking for an engineer to join its Custody organization. This role involves building resilient distributed systems and collaborating across teams to enhance the user experience. The ideal candidate will have experience with complex... 

    Motive Partners

    San Francisco, CA
    5 days ago
  • $142.6k - $261.5k

     ...data scientists, designers, and software engineers enable our clients to solve their most...  ...testing practices. Knowledgeable in system development lifecycle and technology integration...  ...understanding and interest in cloud and distributed systems architectures Comfortable... 
    Summer holiday
    Flexible hours

    EY

    San Francisco, CA
    1 day ago
  • A leading AI research company in California seeks a distributed systems engineer to design, build, and operate Exascale systems for managing research data. The ideal candidate will have expertise in distributed systems, strong programming skills, and experience in public... 

    OpenAI

    San Francisco, CA
    2 days ago
  • $150k - $190k

     ...is seeking a qualified individual with a PhD in databases or systems, and a passion for database and performance optimization. This...  ...and implementing innovative solutions in query optimization, distributed query execution, and resource management. The compensation for... 

    Menlo Ventures

    San Francisco, CA
    3 days ago
  • MLabs Ltd is seeking a talented engineer to design and implement core systems for a real-time distributed platform. Based in New York, the role demands expertise in Rust and extensive experience in building distributed systems. Candidates will have the opportunity for significant... 
    Remote job

    MLabs Ltd

    San Francisco, CA
    2 days ago
  • $250.8k - $286.2k

     ...Capital One is seeking a Senior Lead Software Engineer specializing in distributed systems. This role involves leading technology projects and developing solutions to enhance financial empowerment for millions of Americans. The candidate should have extensive experience... 

    Information Technology Senior Management Forum

    San Francisco, CA
    3 days ago
  •  ...CloudCruise is seeking a skilled engineer for distributed systems in San Francisco to manage high-scale browser automation tasks. You will be responsible for orchestrating resource management across AWS, ensuring system reliability and efficiency. The ideal candidate... 

    CloudCruise

    San Francisco, CA
    3 days ago
  • A leading AI research company in San Francisco seeks Senior/Staff Engineers skilled in distributed systems and large-scale ML training. Responsibilities include designing systems optimized for low-bandwidth conditions and implementing robust training strategies. Ideal... 
    Remote job

    Pluralis Research

    San Francisco, CA
    3 days ago
  •  ...technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation models. You will design distributed training systems and optimize GPU utilization while collaborating with cross-... 

    Baseten

    San Francisco, CA
    4 days ago
  • $160k - $180k

     ...United States Digital Space LLC is seeking a Backend Engineer in San Francisco, CA to build and operate large-scale distributed systems. Ideal candidates will have over 2 years of experience in backend design and solving complex system challenges. You'll work closely... 

    United States Digital Space LLC

    San Francisco, CA
    1 day ago
  • Acceler8 Talent is looking for a Senior Distributed Systems Engineer with over 7 years of experience in software engineering. This hybrid position in San Francisco focuses on building systems for AI-powered clinical environments, impacting patient care directly. The role... 

    Acceler8 Talent

    San Francisco, CA
    2 days ago
  •  ...B Capital is seeking a skilled software engineer in San Francisco to develop foundational AI systems. You will work on shared services and improve operational...  ...development, experience with APIs, and familiarity with distributed systems. This role offers top-tier compensation,... 

    B Capital

    San Francisco, CA
    4 days ago
  •  ...time Location Type On-site Department Engineering Our Mission Reflection’s mission is to...  ...training, and production environments. These systems form the foundational platform that...  ...environments, multi-tenant isolation. Distributed Systems Architecture: Sharding, replication... 
    Full time
    Relocation package

    B Capital

    San Francisco, CA
    3 days ago
  • $117.2k - $313.7k

     ...duplicating efforts. Job Category Software Engineering Job Details About Salesforce...  ...and exciting components/frameworks in distributed filesystems in an ever-growing and...  ...issues and drive innovations that improve system scalability, robustness, and... 
    Immediate start
    Remote work

    Salesforce

    San Francisco, CA
    2 days ago
  •  ...and Robotics firm in San Francisco seeks a Staff/Principal ML Systems Engineer to enhance training performance for multimodal robotic data....  .... Ideal candidates will have significant experience in distributed training, a strong background in PyTorch, and the ability to... 

    Maxwell Bond

    San Francisco, CA
    1 day ago
  • $255k - $405k

    Slope is seeking a Software Engineer for its team in San Francisco, CA. The role focuses...  ...training. Responsibilities include managing distributed data pipelines and collaborating closely...  ...strong experience in distributed systems and possess excellent organizational skills... 

    Slope

    San Francisco, CA
    4 days ago
  •  ...ParadeDB Cloud Engineer ParadeDB is a Postgres-native alternative to Elasticsearch. We...  ...enjoyable work environment. We're primarily distributed across the United States and Canada,...  ...growth. We're looking for a distributed systems engineer to join our team full-time and... 
    Full time
    Work at office

    ParadeDB

    San Francisco, CA
    4 days ago
  • $293.6k - $335.1k

    COMFORT SYSTEMS is seeking a Distinguished Software Engineer to join our innovative team in San Francisco, CA. You will lead technical contributions and mentor...  ...in software engineering, particularly in distributed systems and cloud technologies. This role offers a... 

    COMFORT SYSTEMS

    San Francisco, CA
    4 days ago
  • A technology firm specializing in distributed computing is seeking engineers to contribute to the Ray backend. Candidates should have experience in building scalable, fault-tolerant systems and a solid understanding of algorithms and data structures. Responsibilities include... 

    Anyscale

    San Francisco, CA
    4 days ago
  • Gravity Engineering Services Pvt Ltd. is looking for a Distributed LLM Inference Engineer to join their team. This critical role focuses on enhancing performance...  ...like PyTorch and knowledge of distributed systems is crucial. #J-18808-Ljbffr Gravity Engineering Services... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    5 days ago
  • deCircle is seeking an engineer to design and implement core systems for its agentic AI platform. This role involves building production systems, ensuring...  ...has over 3 years of experience in backend or distributed systems engineering, strong skills in languages like... 

    deCircle

    San Francisco, CA
    3 days ago
  • $200k - $300k

     ...tech startup in San Francisco seeks a Lead Software Engineer to build and optimize foundational backend systems for a massive AI video dataset. You will lead...  ...years in backend engineering, strong experience with distributed systems, and is proficient in Go, Python, or Node... 

    Troveo Ai

    San Francisco, CA
    3 days ago
  •  ...evolves in real-time. Our vision is AI systems that are flexible, personalized, and accessible...  ...honest about both. Researchers and ML engineers will hand you workloads that barely run;...  ...Models at Scale: Design and operate distributed inference systems for LLMs, optimizing... 
    Flexible hours

    Adaption

    San Francisco, CA
    24 days ago
  • $100k

     ...training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal. About the role: As a distributed systems engineer, you will build the data and coordination systems that enable ultra-long context inference and training on Magic’s GPU... 
    Remote job
    Relocation
    Visa sponsorship

    Magic

    San Francisco, CA
    more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distributed Systems Engineer. Be the first to apply!