Distributed Systems Engineer
Arcade
The Revolution Needs You
Every AI app needs agentic "tools" - special functions that let AI models take real actions. Without tools, AI can only chat. With tools, AI can actually do things. We're building the definitive tools catalog and tool-calling platform that will unlock AI's true potential. Think Zapier for AI Actions. Think Auth0 for AI. Think really big.
Why This Is The Opportunity Of A Lifetime
Founder-Market Fit: Our CEO previously founded Stormpath (acquired by Okta), where he created the first Authentication API for developers. He's done this before - and this time the market is 10x bigger. Our CTO led the vector database team at Redis, shipped 100+ LLM applications, and is a contributor to LangChain and LlamaIndex. He knows this space better than anyone.
Dream Team: We've assembled authentication, integrations, distributed systems, and AI experts from Okta, Redis, Microsoft, Splunk, Ngrok, Google, Airbyte, Disney, and HPE who've built and founded multiple successful developer platforms.
Perfect Timing: We're at the inflection point of AI adoption. The biggest problem isn't better models - it's connecting AI to real-world actions. That's us.
Massive Market: We're building critical infrastructure for the biggest technological shift of our generation. Every AI app will need what we're building.
Backed By The Best: Our investors have backed Databricks, Clickhouse, MongoDB, Perplexity, Cohere, ScaleAI, Confluent, Elastic, and Firebase. They see what we see - this is going to be huge.
The Challenge
We are building the runtime and registry for AI/LLM tools. You will define both how AI interacts with the world, and how humans build and manage those tools. This includes creating production-grade integrations, and the services & toolkits that run them... and the solving the unique problems of AI/LLM usage along the way. We are building a SaaS application first, and then allowing folks to run part of that infrastructure on-site via hybrid deployments.
This role is primarily focused on our back-end services, but as an early member of a startup, you'll be working up-and-down the stack. We build our software with Go, Python, and Typescript, and expect you to be a pro in at least one of those. We are looking for people who constantly ship and don't get stuck - we are looking for folks who are always learning and and able to apply that knowledge to their work and teach it to the team.
What You'll Do
- Build the infrastructure to manage the backplane for all future AI tools
- Design, build, test, and deploy high-performance, secure, production-grade software.
- Develop SDKs and frameworks that make it easy for other developers to build custom tools
- Help set industry standards for tool calling and authorization (for example, we helped write the MCP authorization spec)
- Create integrations with major platforms and LLMs (Google Workspace, Microsoft 365, OpenAi, Anthropic, etc.)
- Shape the roadmap for the team
- Build leverage (via AI) - projects that take a week today should take a day next time.
- Share your work with our customers and community, building our (and your) brand.
Required Skills
- An insatiable desire to ship.
- 7+ years of software engineering experience comprising of:
- 5+ years of backend development experience with either Python, Go, Ruby, Typescript, or a similar language and API & Web frameworks.
- 2+ years of experience with infrastructure and deployment (AWS/GCP, Terraform, Helm, etc)
- Strong experience building and maintaining production APIs.
- Track record of writing clean, well-documented, well-tested code.
- User-centered approach to designing developer-centric products and tools.
Bonus Points
- Experience building developer tools or SDKs
- Familiarity with LLMs and AI frameworks (Langchain, LlamaIndex, etc)
- Open-source contributions
- Experience with high-scale distributed systems
- Experience leading teams and mentoring more junior developers
- Familiarity with Typescript and a relevant frontend framework (e.g. React)
- You've been a startup founder or early-state startup employee before and love it
Notes
- This is an in-person role located in our San Francisco (SOMA) office.
Join The Movement
We're not just building a product - we're leading a movement to transform AI from just chatbots to agents that can take actions against real systems. This is your chance to be at the forefront of that revolution.
If you want to look back in 5 years and say, "I helped build that", then we want to talk to you. Ready to make AI actually useful? Apply Now
- StackAI is seeking a Senior Software Engineer, Engine & Distributed Systems to own the core execution engine of their platform. This role involves deep systems work, ensuring the durability and correctness of agents running on the platform. The ideal candidate has over...Suggested
- Paradigm is seeking a Senior Software Engineer in San Francisco, California. This role requires 7+... ...projects, particularly in managing and deploying distributed services. Candidates should be skilled in debugging complex systems and should possess familiarity with tools...Suggested
$160k - $180k
Discord is seeking a backend systems engineer to join the Realtime Infrastructure team in San Francisco. In this role, you will build and... ...candidate will have 2+ years of experience and strong knowledge of distributed systems. The position offers a competitive salary of $160,00...Suggested- A leading AI technology firm in San Francisco is seeking systems-oriented candidates to enhance their infrastructure used for advanced... ...have a strong background in Python and experience managing distributed systems, particularly within GPU environments. The position offers...Suggested
- Dedalus Labs, Inc. is seeking a Systems Engineer to build distributed infrastructure for AI applications. This role requires strong skills in Rust, Go, or C/C++ and a deep understanding of operating systems and distributed systems. You will work on innovative projects that...SuggestedWork at officeVisa sponsorshipRelocation package
$180k - $275k
Gamma in San Francisco is looking for a backend engineer to architect the trust infrastructure that keeps over 70 million users safe. This role involves designing distributed systems for real-time content scanning and anomaly detection, ensuring the balance of security...- Dormont Manufacturing Co is looking for a Software Engineer for their Pre-training Systems team in San Francisco. Your primary role will be to design and maintain the distributed infrastructure that trains long-context models at scale, tackling challenges related to memory...
- Genesis AI in San Francisco is seeking a senior ML infrastructure engineer to design and optimize distributed training systems and performance-critical components. You will profile bottlenecks, implement low‑level code (CUDA, Triton) and ensure efficient hardware utilization...
- ...technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation models. You will design distributed training systems and optimize GPU utilization while collaborating with cross-...
- Acceler8 Talent is looking for a Senior Distributed Systems Engineer with over 7 years of experience in software engineering. This hybrid position in San Francisco focuses on building systems for AI-powered clinical environments, impacting patient care directly. The role...
- Harrison Clarke is working with a high-growth startup in San Francisco seeking a Staff Distributed Systems Engineer. This hands-on role involves designing and building core systems for a cutting-edge AI code generation product. The ideal candidate will have excellent coding...
- ...ambitious work on training infrastructure. You will contribute to the distributed training backbone, optimizing performance across GPUs, CPUs, and networks, and shaping RL training and post-training systems. Join a fast-moving team at the intersection of frontier research,...Remote jobWork at officeVisa sponsorship
- CloudCruise is seeking a skilled engineer for distributed systems in San Francisco to manage high-scale browser automation tasks. You will be responsible for orchestrating resource management across AWS, ensuring system reliability and efficiency. The ideal candidate has...
- Wasmer Inc is seeking a Rust Engineer to design and maintain core components of their global compute platform. The ideal candidate... ...experience, expertise in Rust, and a passion for building distributed systems. Responsibilities include developing scheduling logic for WebAssembly...Remote jobFull time
- Abridge is seeking an experienced software engineer to scale its distributed systems and cloud-native platform. The role emphasizes performance, reliability, and multi-tenant deployments, with a focus on building tools and improving scalability across teams. You will partner...
- Salesforce.com, inc. is looking for a Lead Software Engineer to envision and build innovative components in distributed filesystems. Responsibilities include coding... ...ideal candidate will have a deep understanding of systems design, cloud technologies, and a passion for...
- ...operate the infrastructure for Krea's research and inference. Distributed training, 1000+ K8s GPU clusters, petabyte scale data pipelines... ...scratch — custom distributed datastores, job orchestration systems, and streaming pipelines that replace tools like Kafka and Ray...
- Rust Engineer, Distributed Systems at Wasmer (S19) Salary: $1 The Operating System for Edge Computing Remote Full-time Location: Remote, CET ±2h US citizenship/visa not required, 6+ years experience About The Role We are seeking a passionate Rust engineer to help us...Full timeRemote workWorldwideFlexible hours
- Gravity Engineering Services Pvt Ltd. is looking for a Distributed LLM Inference Engineer to join their team. This critical role focuses on enhancing performance... ...like PyTorch and knowledge of distributed systems is crucial. #J-18808-Ljbffr Gravity Engineering Services...
- Systems Engineers at Inngest build the core of our product: the durable execution layer, queueing system, state stores, and the distributed systems that connect them together. It's extremely fun, rewarding, and technical work that provides interesting challenges and deep...Live in
- ...scale and most critical services. Those systems are at the core of our text chat... ...scale. This role reports to the Senior Engineering Manager of Realtime Infrastructure. What... ...operate large-scale, reliable and performant distributed systems. Collaborate with product...
$160k - $180k
...scale and most critical services. Those systems are at the core of our text chat... ...scale. This role reports to the Senior Engineering Manager of Realtime Infrastructure. What... ...operate large-scale, reliable and performant distributed systems. Collaborate with product...Full timeRelocationRelocation package- ...work on AI agents, and at StackAI that work runs on a single engine. Some agents finish in a second. Others run for days, fan... ...losing a step. We're hiring a Senior Software Engineer, Engine & Distributed Systems to own that engine: the durable runtime at the core of the...
$180k - $275k
...evolve the core data model and storage systems powering Gamma’s business. You’ll ship backend... ...rapid shipping velocity. As Software Engineer on the Platform team, you’ll collaborate... ...do Design and implement scalable APIs, distributed systems, and data infrastructure that...Full timeWork at officeWork from home- ...Francisco is seeking a Senior Software Engineer to enhance its OLAP engine components, focusing... ...will own critical parts of a complex system that processes trillions of events,... ...Java, C++, or Python, and a passion for distributed systems. Amplitude offers excellent benefits...Flexible hours
$150k - $200k
A technology company is seeking early engineers to design and maintain scalable infrastructure... ...will work on real-time observability systems and collaborate with software engineers... ...performance. Candidates should have 3+ years of distributed systems experience, hands-on cloud...Remote job$150k - $350k
...Labs, Inc. is seeking a Member of Technical Staff to focus on distributed systems in San Francisco, California. This role involves designing... ...APIs. The ideal candidate should have strong software engineering fundamentals and experience with distributed systems. The compensation...- Blacksmith is seeking an experienced Technical Support Engineer to work closely with customers and resolve complex technical issues... ...experience. The role requires a strong background in distributed systems and an ability to automate processes. Blacksmith offers a competitive...
- ...is seeking a Member of Technical Staff to design and build distributed systems for AI workloads. The role involves developing scheduling and... ...-grade APIs. Ideal candidates should have strong software engineering skills and experience with distributed systems. This role...
- Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at... ...systems. The ideal candidate has a strong background in distributed systems and is eager to engage in complex challenges...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Systems Engineer. Be the first to apply!
- ground systems engineer San Francisco, CA
- advanced systems engineer San Francisco, CA
- active directory systems engineer San Francisco, CA
- distributed systems engineer San Francisco, CA
- computer systems engineer San Francisco, CA
- adas systems engineer San Francisco, CA
- microsoft systems engineer San Francisco, CA
- computer system validation engineer San Francisco, CA
- mission system engineer San Francisco, CA
- electronic systems engineer San Francisco, CA
