Distributed Systems Engineer
Arcade
The Revolution Needs You
Every AI app needs agentic "tools" - special functions that let AI models take real actions. Without tools, AI can only chat. With tools, AI can actually do things. We're building the definitive tools catalog and tool-calling platform that will unlock AI's true potential. Think Zapier for AI Actions. Think Auth0 for AI. Think really big.
Why This Is The Opportunity Of A Lifetime
Founder-Market Fit: Our CEO previously founded Stormpath (acquired by Okta), where he created the first Authentication API for developers. He's done this before - and this time the market is 10x bigger. Our CTO led the vector database team at Redis, shipped 100+ LLM applications, and is a contributor to LangChain and LlamaIndex. He knows this space better than anyone.
Dream Team: We've assembled authentication, integrations, distributed systems, and AI experts from Okta, Redis, Microsoft, Splunk, Ngrok, Google, Airbyte, Disney, and HPE who've built and founded multiple successful developer platforms.
Perfect Timing: We're at the inflection point of AI adoption. The biggest problem isn't better models - it's connecting AI to real-world actions. That's us.
Massive Market: We're building critical infrastructure for the biggest technological shift of our generation. Every AI app will need what we're building.
Backed By The Best: Our investors have backed Databricks, Clickhouse, MongoDB, Perplexity, Cohere, ScaleAI, Confluent, Elastic, and Firebase. They see what we see - this is going to be huge.
The Challenge
We are building the runtime and registry for AI/LLM tools. You will define both how AI interacts with the world, and how humans build and manage those tools. This includes creating production-grade integrations, and the services & toolkits that run them... and the solving the unique problems of AI/LLM usage along the way. We are building a SaaS application first, and then allowing folks to run part of that infrastructure on-site via hybrid deployments.
This role is primarily focused on our back-end services, but as an early member of a startup, you'll be working up-and-down the stack. We build our software with Go, Python, and Typescript, and expect you to be a pro in at least one of those. We are looking for people who constantly ship and don't get stuck - we are looking for folks who are always learning and and able to apply that knowledge to their work and teach it to the team.
What You'll Do
- Build the infrastructure to manage the backplane for all future AI tools
- Design, build, test, and deploy high-performance, secure, production-grade software.
- Develop SDKs and frameworks that make it easy for other developers to build custom tools
- Help set industry standards for tool calling and authorization (for example, we helped write the MCP authorization spec)
- Create integrations with major platforms and LLMs (Google Workspace, Microsoft 365, OpenAi, Anthropic, etc.)
- Shape the roadmap for the team
- Build leverage (via AI) - projects that take a week today should take a day next time.
- Share your work with our customers and community, building our (and your) brand.
Required Skills
- An insatiable desire to ship.
- 7+ years of software engineering experience comprising of:
- 5+ years of backend development experience with either Python, Go, Ruby, Typescript, or a similar language and API & Web frameworks.
- 2+ years of experience with infrastructure and deployment (AWS/GCP, Terraform, Helm, etc)
- Strong experience building and maintaining production APIs.
- Track record of writing clean, well-documented, well-tested code.
- User-centered approach to designing developer-centric products and tools.
Bonus Points
- Experience building developer tools or SDKs
- Familiarity with LLMs and AI frameworks (Langchain, LlamaIndex, etc)
- Open-source contributions
- Experience with high-scale distributed systems
- Experience leading teams and mentoring more junior developers
- Familiarity with Typescript and a relevant frontend framework (e.g. React)
- You've been a startup founder or early-state startup employee before and love it
Notes
- This is an in-person role located in our San Francisco (SOMA) office.
Join The Movement
We're not just building a product - we're leading a movement to transform AI from just chatbots to agents that can take actions against real systems. This is your chance to be at the forefront of that revolution.
If you want to look back in 5 years and say, "I helped build that", then we want to talk to you. Ready to make AI actually useful? Apply Now
- ...Dream Team : We've assembled authentication, integrations, distributed systems, and AI experts from Okta, Redis, Microsoft, Splunk, Ngrok,... ...~ An insatiable desire to ship. ~7+ years of software engineering experience comprising of: ~5+ years of backend development...SuggestedWork at officeShift work
- ...Distributed Systems Engineer As a distributed systems engineer, you'll work across the stack to solve problems as they come up and help build Archil volumes. You'll have significant influence over the technical and product direction. We'll expect you to be able...SuggestedFlexible hours
- ...time putting knowledge into action. We're looking for engineers who want to build the operating system for AI Data Applications and Workflows. About the role We're looking for experienced distributed systems engineers to build the core infrastructure for our...Suggested
$180k - $300k
...redefine how value is discovered, priced, and distributed in real time. The mission centers on... ..., transparency, and efficiency to systems where value is currently fragmented and... ...components and services while establishing engineering best practices and code quality...SuggestedFull timeRemote workFlexible hours$175k - $240k
Langchain is hiring a Systems/Database Engineer based in San Francisco. The ideal candidate will have over 5 years of experience in systems/database... ...query execution, optimizing performance, and deploying distributed database services. Compensation ranges from $175,000 to $2...SuggestedFlexible hours$160k - $180k
Ultimate.ai is looking for a talented backend engineer to join their Realtime Infrastructure team in the San Francisco Bay Area. You will build and operate large-scale distributed systems that are critical for Discord's functionality. The ideal candidate will have at least...- Motive Partners in San Francisco is looking for an engineer to join its Custody organization. This role involves building resilient distributed systems and collaborating across teams to enhance the user experience. The ideal candidate will have experience with complex...
$142.6k - $261.5k
...data scientists, designers, and software engineers enable our clients to solve their most... ...testing practices. Knowledgeable in system development lifecycle and technology integration... ...understanding and interest in cloud and distributed systems architectures Comfortable...Summer holidayFlexible hours- A leading AI research company in California seeks a distributed systems engineer to design, build, and operate Exascale systems for managing research data. The ideal candidate will have expertise in distributed systems, strong programming skills, and experience in public...
$150k - $190k
...is seeking a qualified individual with a PhD in databases or systems, and a passion for database and performance optimization. This... ...and implementing innovative solutions in query optimization, distributed query execution, and resource management. The compensation for...- MLabs Ltd is seeking a talented engineer to design and implement core systems for a real-time distributed platform. Based in New York, the role demands expertise in Rust and extensive experience in building distributed systems. Candidates will have the opportunity for significant...Remote job
$250.8k - $286.2k
...Capital One is seeking a Senior Lead Software Engineer specializing in distributed systems. This role involves leading technology projects and developing solutions to enhance financial empowerment for millions of Americans. The candidate should have extensive experience...- ...CloudCruise is seeking a skilled engineer for distributed systems in San Francisco to manage high-scale browser automation tasks. You will be responsible for orchestrating resource management across AWS, ensuring system reliability and efficiency. The ideal candidate...
- A leading AI research company in San Francisco seeks Senior/Staff Engineers skilled in distributed systems and large-scale ML training. Responsibilities include designing systems optimized for low-bandwidth conditions and implementing robust training strategies. Ideal...Remote job
- ...technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation models. You will design distributed training systems and optimize GPU utilization while collaborating with cross-...
$160k - $180k
...United States Digital Space LLC is seeking a Backend Engineer in San Francisco, CA to build and operate large-scale distributed systems. Ideal candidates will have over 2 years of experience in backend design and solving complex system challenges. You'll work closely...- Acceler8 Talent is looking for a Senior Distributed Systems Engineer with over 7 years of experience in software engineering. This hybrid position in San Francisco focuses on building systems for AI-powered clinical environments, impacting patient care directly. The role...
- ...B Capital is seeking a skilled software engineer in San Francisco to develop foundational AI systems. You will work on shared services and improve operational... ...development, experience with APIs, and familiarity with distributed systems. This role offers top-tier compensation,...
- ...time Location Type On-site Department Engineering Our Mission Reflection’s mission is to... ...training, and production environments. These systems form the foundational platform that... ...environments, multi-tenant isolation. Distributed Systems Architecture: Sharding, replication...Full timeRelocation package
$117.2k - $313.7k
...duplicating efforts. Job Category Software Engineering Job Details About Salesforce... ...and exciting components/frameworks in distributed filesystems in an ever-growing and... ...issues and drive innovations that improve system scalability, robustness, and...Immediate startRemote work- ...and Robotics firm in San Francisco seeks a Staff/Principal ML Systems Engineer to enhance training performance for multimodal robotic data.... .... Ideal candidates will have significant experience in distributed training, a strong background in PyTorch, and the ability to...
$255k - $405k
Slope is seeking a Software Engineer for its team in San Francisco, CA. The role focuses... ...training. Responsibilities include managing distributed data pipelines and collaborating closely... ...strong experience in distributed systems and possess excellent organizational skills...- ...ParadeDB Cloud Engineer ParadeDB is a Postgres-native alternative to Elasticsearch. We... ...enjoyable work environment. We're primarily distributed across the United States and Canada,... ...growth. We're looking for a distributed systems engineer to join our team full-time and...Full timeWork at office
$293.6k - $335.1k
COMFORT SYSTEMS is seeking a Distinguished Software Engineer to join our innovative team in San Francisco, CA. You will lead technical contributions and mentor... ...in software engineering, particularly in distributed systems and cloud technologies. This role offers a...- A technology firm specializing in distributed computing is seeking engineers to contribute to the Ray backend. Candidates should have experience in building scalable, fault-tolerant systems and a solid understanding of algorithms and data structures. Responsibilities include...
- Gravity Engineering Services Pvt Ltd. is looking for a Distributed LLM Inference Engineer to join their team. This critical role focuses on enhancing performance... ...like PyTorch and knowledge of distributed systems is crucial. #J-18808-Ljbffr Gravity Engineering Services...
- deCircle is seeking an engineer to design and implement core systems for its agentic AI platform. This role involves building production systems, ensuring... ...has over 3 years of experience in backend or distributed systems engineering, strong skills in languages like...
$200k - $300k
...tech startup in San Francisco seeks a Lead Software Engineer to build and optimize foundational backend systems for a massive AI video dataset. You will lead... ...years in backend engineering, strong experience with distributed systems, and is proficient in Go, Python, or Node...- ...evolves in real-time. Our vision is AI systems that are flexible, personalized, and accessible... ...honest about both. Researchers and ML engineers will hand you workloads that barely run;... ...Models at Scale: Design and operate distributed inference systems for LLMs, optimizing...Flexible hours
$100k
...training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal. About the role: As a distributed systems engineer, you will build the data and coordination systems that enable ultra-long context inference and training on Magic’s GPU...Remote jobRelocationVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Systems Engineer. Be the first to apply!
- wireless systems engineer San Francisco, CA
- electronic systems engineer San Francisco, CA
- space systems engineer San Francisco, CA
- systems engineer San Francisco, CA
- system design engineer San Francisco, CA
- ground systems engineer San Francisco, CA
- computer systems engineer San Francisco, CA
- senior linux systems engineer San Francisco, CA
- healthcare systems engineer San Francisco, CA
- senior staff systems engineer San Francisco, CA

