Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distributed Systems Engineer

Arcade

The Revolution Needs You

Every AI app needs agentic "tools" - special functions that let AI models take real actions. Without tools, AI can only chat. With tools, AI can actually do things. We're building the definitive tools catalog and tool-calling platform that will unlock AI's true potential. Think Zapier for AI Actions. Think Auth0 for AI. Think really big.

Why This Is The Opportunity Of A Lifetime

Founder-Market Fit: Our CEO previously founded Stormpath (acquired by Okta), where he created the first Authentication API for developers. He's done this before - and this time the market is 10x bigger. Our CTO led the vector database team at Redis, shipped 100+ LLM applications, and is a contributor to LangChain and LlamaIndex. He knows this space better than anyone.

Dream Team: We've assembled authentication, integrations, distributed systems, and AI experts from Okta, Redis, Microsoft, Splunk, Ngrok, Google, Airbyte, Disney, and HPE who've built and founded multiple successful developer platforms.

Perfect Timing: We're at the inflection point of AI adoption. The biggest problem isn't better models - it's connecting AI to real-world actions. That's us.

Massive Market: We're building critical infrastructure for the biggest technological shift of our generation. Every AI app will need what we're building.

Backed By The Best: Our investors have backed Databricks, Clickhouse, MongoDB, Perplexity, Cohere, ScaleAI, Confluent, Elastic, and Firebase. They see what we see - this is going to be huge.

The Challenge

We are building the runtime and registry for AI/LLM tools. You will define both how AI interacts with the world, and how humans build and manage those tools. This includes creating production-grade integrations, and the services & toolkits that run them... and the solving the unique problems of AI/LLM usage along the way. We are building a SaaS application first, and then allowing folks to run part of that infrastructure on-site via hybrid deployments.

This role is primarily focused on our back-end services, but as an early member of a startup, you'll be working up-and-down the stack. We build our software with Go, Python, and Typescript, and expect you to be a pro in at least one of those. We are looking for people who constantly ship and don't get stuck - we are looking for folks who are always learning and and able to apply that knowledge to their work and teach it to the team.

What You'll Do
  • Build the infrastructure to manage the backplane for all future AI tools
  • Design, build, test, and deploy high-performance, secure, production-grade software.
  • Develop SDKs and frameworks that make it easy for other developers to build custom tools
  • Help set industry standards for tool calling and authorization (for example, we helped write the MCP authorization spec)
  • Create integrations with major platforms and LLMs (Google Workspace, Microsoft 365, OpenAi, Anthropic, etc.)
  • Shape the roadmap for the team
  • Build leverage (via AI) - projects that take a week today should take a day next time.
  • Share your work with our customers and community, building our (and your) brand.
Required Skills
  • An insatiable desire to ship.
  • 7+ years of software engineering experience comprising of:
    • 5+ years of backend development experience with either Python, Go, Ruby, Typescript, or a similar language and API & Web frameworks.
    • 2+ years of experience with infrastructure and deployment (AWS/GCP, Terraform, Helm, etc)
  • Strong experience building and maintaining production APIs.
  • Track record of writing clean, well-documented, well-tested code.
  • User-centered approach to designing developer-centric products and tools.
Bonus Points
  • Experience building developer tools or SDKs
  • Familiarity with LLMs and AI frameworks (Langchain, LlamaIndex, etc)
  • Open-source contributions
  • Experience with high-scale distributed systems
  • Experience leading teams and mentoring more junior developers
  • Familiarity with Typescript and a relevant frontend framework (e.g. React)
  • You've been a startup founder or early-state startup employee before and love it
Notes
  • This is an in-person role located in our San Francisco (SOMA) office.
Join The Movement

We're not just building a product - we're leading a movement to transform AI from just chatbots to agents that can take actions against real systems. This is your chance to be at the forefront of that revolution.

If you want to look back in 5 years and say, "I helped build that", then we want to talk to you. Ready to make AI actually useful? Apply Now

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer in San Francisco, CA vacancy
  • StackAI is seeking a Senior Software Engineer, Engine & Distributed Systems to own the core execution engine of their platform. This role involves deep systems work, ensuring the durability and correctness of agents running on the platform. The ideal candidate has over... 
    Suggested

    StackAI

    San Francisco, CA
    3 days ago
  • Paradigm is seeking a Senior Software Engineer in San Francisco, California. This role requires 7+...  ...projects, particularly in managing and deploying distributed services. Candidates should be skilled in debugging complex systems and should possess familiarity with tools... 
    Suggested

    Paradigm

    San Francisco, CA
    20 hours ago
  • $160k - $180k

    Discord is seeking a backend systems engineer to join the Realtime Infrastructure team in San Francisco. In this role, you will build and...  ...candidate will have 2+ years of experience and strong knowledge of distributed systems. The position offers a competitive salary of $160,00... 
    Suggested

    Discord

    San Francisco, CA
    3 days ago
  • A leading AI technology firm in San Francisco is seeking systems-oriented candidates to enhance their infrastructure used for advanced...  ...have a strong background in Python and experience managing distributed systems, particularly within GPU environments. The position offers... 
    Suggested

    krea.ai

    San Francisco, CA
    3 days ago
  • Dedalus Labs, Inc. is seeking a Systems Engineer to build distributed infrastructure for AI applications. This role requires strong skills in Rust, Go, or C/C++ and a deep understanding of operating systems and distributed systems. You will work on innovative projects that... 
    Suggested
    Work at office
    Visa sponsorship
    Relocation package

    Dedalus Labs, Inc.

    San Francisco, CA
    20 hours ago
  • $180k - $275k

    Gamma in San Francisco is looking for a backend engineer to architect the trust infrastructure that keeps over 70 million users safe. This role involves designing distributed systems for real-time content scanning and anomaly detection, ensuring the balance of security... 

    Gamma

    San Francisco, CA
    3 days ago
  • Dormont Manufacturing Co is looking for a Software Engineer for their Pre-training Systems team in San Francisco. Your primary role will be to design and maintain the distributed infrastructure that trains long-context models at scale, tackling challenges related to memory... 

    Dormont Manufacturing Co

    San Francisco, CA
    20 hours ago
  • Genesis AI in San Francisco is seeking a senior ML infrastructure engineer to design and optimize distributed training systems and performance-critical components. You will profile bottlenecks, implement low‑level code (CUDA, Triton) and ensure efficient hardware utilization... 

    Genesis AI

    San Francisco, CA
    1 day ago
  •  ...technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation models. You will design distributed training systems and optimize GPU utilization while collaborating with cross-... 

    Baseten

    San Francisco, CA
    20 hours ago
  • Acceler8 Talent is looking for a Senior Distributed Systems Engineer with over 7 years of experience in software engineering. This hybrid position in San Francisco focuses on building systems for AI-powered clinical environments, impacting patient care directly. The role... 

    Acceler8 Talent

    San Francisco, CA
    3 days ago
  • Harrison Clarke is working with a high-growth startup in San Francisco seeking a Staff Distributed Systems Engineer. This hands-on role involves designing and building core systems for a cutting-edge AI code generation product. The ideal candidate will have excellent coding... 

    Harrison Clarke

    San Francisco, CA
    3 days ago
  •  ...ambitious work on training infrastructure. You will contribute to the distributed training backbone, optimizing performance across GPUs, CPUs, and networks, and shaping RL training and post-training systems. Join a fast-moving team at the intersection of frontier research,... 
    Remote job
    Work at office
    Visa sponsorship

    Prime Intellect

    San Francisco, CA
    3 days ago
  • CloudCruise is seeking a skilled engineer for distributed systems in San Francisco to manage high-scale browser automation tasks. You will be responsible for orchestrating resource management across AWS, ensuring system reliability and efficiency. The ideal candidate has... 

    CloudCruise

    San Francisco, CA
    4 days ago
  • Wasmer Inc is seeking a Rust Engineer to design and maintain core components of their global compute platform. The ideal candidate...  ...experience, expertise in Rust, and a passion for building distributed systems. Responsibilities include developing scheduling logic for WebAssembly... 
    Remote job
    Full time

    Wasmer Inc

    San Francisco, CA
    3 days ago
  • Abridge is seeking an experienced software engineer to scale its distributed systems and cloud-native platform. The role emphasizes performance, reliability, and multi-tenant deployments, with a focus on building tools and improving scalability across teams. You will partner... 

    Abridge

    San Francisco, CA
    3 days ago
  • Salesforce.com, inc. is looking for a Lead Software Engineer to envision and build innovative components in distributed filesystems. Responsibilities include coding...  ...ideal candidate will have a deep understanding of systems design, cloud technologies, and a passion for... 

    salesforce.com, inc.

    San Francisco, CA
    3 days ago
  •  ...operate the infrastructure for Krea's research and inference. Distributed training, 1000+ K8s GPU clusters, petabyte scale data pipelines...  ...scratch — custom distributed datastores, job orchestration systems, and streaming pipelines that replace tools like Kafka and Ray... 

    krea.ai

    San Francisco, CA
    3 days ago
  • Rust Engineer, Distributed Systems at Wasmer (S19) Salary: $1 The Operating System for Edge Computing Remote Full-time Location: Remote, CET ±2h US citizenship/visa not required, 6+ years experience About The Role We are seeking a passionate Rust engineer to help us... 
    Full time
    Remote work
    Worldwide
    Flexible hours

    Wasmer Inc

    San Francisco, CA
    3 days ago
  • Gravity Engineering Services Pvt Ltd. is looking for a Distributed LLM Inference Engineer to join their team. This critical role focuses on enhancing performance...  ...like PyTorch and knowledge of distributed systems is crucial. #J-18808-Ljbffr Gravity Engineering Services... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • Systems Engineers at Inngest build the core of our product: the durable execution layer, queueing system, state stores, and the distributed systems that connect them together. It's extremely fun, rewarding, and technical work that provides interesting challenges and deep... 
    Live in

    Inngest

    San Francisco, CA
    3 days ago
  •  ...scale and most critical services. Those systems are at the core of our text chat...  ...scale. This role reports to the Senior Engineering Manager of Realtime Infrastructure. What...  ...operate large-scale, reliable and performant distributed systems. Collaborate with product... 

    EngineersOfAI

    San Francisco, CA
    3 days ago
  • $160k - $180k

     ...scale and most critical services. Those systems are at the core of our text chat...  ...scale. This role reports to the Senior Engineering Manager of Realtime Infrastructure. What...  ...operate large-scale, reliable and performant distributed systems. Collaborate with product... 
    Full time
    Relocation
    Relocation package

    Discord

    San Francisco, CA
    3 days ago
  •  ...work on AI agents, and at StackAI that work runs on a single engine. Some agents finish in a second. Others run for days, fan...  ...losing a step. We're hiring a Senior Software Engineer, Engine & Distributed Systems to own that engine: the durable runtime at the core of the... 

    StackAI

    San Francisco, CA
    3 days ago
  • $180k - $275k

     ...evolve the core data model and storage systems powering Gamma’s business. You’ll ship backend...  ...rapid shipping velocity. As Software Engineer on the Platform team, you’ll collaborate...  ...do Design and implement scalable APIs, distributed systems, and data infrastructure that... 
    Full time
    Work at office
    Work from home

    Gamma

    San Francisco, CA
    3 days ago
  •  ...Francisco is seeking a Senior Software Engineer to enhance its OLAP engine components, focusing...  ...will own critical parts of a complex system that processes trillions of events,...  ...Java, C++, or Python, and a passion for distributed systems. Amplitude offers excellent benefits... 
    Flexible hours

    Amplitude

    San Francisco, CA
    2 days ago
  • $150k - $200k

    A technology company is seeking early engineers to design and maintain scalable infrastructure...  ...will work on real-time observability systems and collaborate with software engineers...  ...performance. Candidates should have 3+ years of distributed systems experience, hands-on cloud... 
    Remote job

    Sift

    San Francisco, CA
    1 day ago
  • $150k - $350k

     ...Labs, Inc. is seeking a Member of Technical Staff to focus on distributed systems in San Francisco, California. This role involves designing...  ...APIs. The ideal candidate should have strong software engineering fundamentals and experience with distributed systems. The compensation... 

    Gimlet Labs, Inc.

    San Francisco, CA
    3 days ago
  • Blacksmith is seeking an experienced Technical Support Engineer to work closely with customers and resolve complex technical issues...  ...experience. The role requires a strong background in distributed systems and an ability to automate processes. Blacksmith offers a competitive... 

    Blacksmith

    San Francisco, CA
    2 days ago
  •  ...is seeking a Member of Technical Staff to design and build distributed systems for AI workloads. The role involves developing scheduling and...  ...-grade APIs. Ideal candidates should have strong software engineering skills and experience with distributed systems. This role... 

    Gimlet Labs

    San Francisco, CA
    3 days ago
  • Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at...  ...systems. The ideal candidate has a strong background in distributed systems and is eager to engage in complex challenges... 

    Sail Research

    San Francisco, CA
    20 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distributed Systems Engineer. Be the first to apply!