Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distributed Systems Engineer

Relace Inc

About Relace

Relace is building a globally distributed inference cloud. Customers send us requests, we run them on our own GPU fleet around the world, and we compete on price, speed and reliability against companies far larger than us. We have customers and revenue today, we're venture backed, and the team is still small, so you'll own whole systems, not slices of them.

We build our own stack, and the fleet runs on Kubernetes across multiple clouds. Performance is the business: ten percent faster is ten percent more revenue. If you like making things fast, this is about as direct as it gets. You can trace a change you shipped this week to what it earned.

Some numbers: we process 800B+ tokens a day, we've grown 3x in the last three months, we're one of the top providers by volume on OpenRouter, and we raised a $23M Series A led by Andreessen Horowitz, with participation from Matrix Partners and Y Combinator.

The role

You would work on how the globally distributed inference runs: the routing layer deciding which machine handles a request, what happens when more work arrives than we have capacity for, and how the fleet grows and shrinks across clouds as demand moves. A lot of it is our own Rust service and the Kubernetes services that manage a multi-cloud fleet.

What we need to see
  • Around five or more years building real production systems where latency and failure behaviour mattered: serving systems, control planes, schedulers, databases, networking, trading systems. Not data pipelines or analytics.
  • A systems language you know well. Rust, C++ or Go is good.
  • Real ownership of something that ran under load, and the ability to talk through a production failure you debugged yourself, in detail.
  • Kubernetes at the level of someone who has extended it, particularly on low-reliability infrastructure.

Nice to have

Experience with a scheduler or load balancer as a real project rather than a side task; work with spot or preemptible capacity; any exposure to AI serving systems, which is genuinely optional. We can teach you our domain, but we can't teach distributed systems instincts.

Working here

San Francisco, in person, five days a week, because the hard problems get solved at a whiteboard. This is a senior role, with competitive compensation plus equity.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer in San Francisco, CA vacancy
  •  ...matters to the world. The Production Engineering Team Examples of key exciting...  ...management, actual state inspection, and distributed command execution. One interface for the...  ...company, not a hundred scripts. Make the system's view of itself always match reality:... 
    Suggested
    Local area

    FluidStack

    San Francisco, CA
    3 days ago
  • $230k

     ...securely take action inside enterprise systems is hard. The moment an agent accesses customer...  ...governance, and trust become the real engineering challenge. Arcade is the MCP runtime...  ...authentication, integrations, distributed systems, and AI experts from Okta, MongoDB... 
    Suggested
    Work at office
    Shift work

    Arcade AI, Inc

    San Francisco, CA
    3 days ago
  •  ...time putting knowledge into action. We're looking for engineers who want to build the operating system for AI Data Applications and Workflows. About the role We're looking for experienced distributed systems engineers to build the core infrastructure for our... 
    Suggested

    Tensorlake, Inc.

    San Francisco, CA
    14 hours ago
  •  ...Distributed Systems Engineer As a distributed systems engineer, you'll work across the stack to solve problems as they come up and help build Archil volumes. You'll have significant influence over the technical and product direction. We'll expect you to be able... 
    Suggested
    Flexible hours

    Archil

    San Francisco, CA
    2 days ago
  •  ...looking to hire someone to help us with Platform Engineering work. We're working on lots of fun problems:Low-level systems development: working with container runtimes,...  ...3-5 years of experience working with a large distributed systemComfortable with KubernetesExperience... 
    Suggested

    BEAM inc.

    San Francisco, CA
    1 day ago
  • $142.6k - $261.5k

     ...of product leaders, data scientists, designers, and software engineers enable our clients to solve their most complex product...  ...quickly Function as part of an agile delivery process Work on distributed systems problems ranging from scheduling, resource management, messaging... 
    Summer holiday
    Flexible hours

    EY

    San Francisco, CA
    3 days ago
  • $227.2k - $324.5k

    About the Role:As a Staff Software Engineer on the ML Infrastructure team, you will collaborate...  ...low-latency ML model serving systems that support Deep Learning, LLM, and Search...  ...scalable, high throughput, and low latency distributed systems using ScalaBuild reusable... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    San Francisco, CA
    8 hours ago
  • $148.5k - $223.9k

     ...exciting components/frameworks in developing distributed filesystems in an ever-growing and...  ...environment, Code review, mentoring junior engineers, and providing technical guidance to the...  ...designing and developing distributed systems at scale. - Proficiency in queues, locks... 
    Full time
    Immediate start

    Salesforce

    San Francisco, CA
    3 days ago
  • $172.5k - $260.1k

     ...seeking a visionary, high-energy backend Java engineer to lead the design, architecture, and...  ...intelligent automation that enable our systems to self-heal and self-optimize in real...  ...get energized by building ultra-resilient distributed systems, driving live-site excellence... 
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $117.2k - $260.1k

     ...unparalleled customer experiences. Join our team of talented engineers and help us advance the integration of Salesforce...  ..., infrastructure security, and the security of distributed and scalable distributed systems. This role requires hands-on experience with security... 
    Full time

    Salesforce

    San Francisco, CA
    8 hours ago
  • $166k - $225k

     ...data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity...  ...Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in... 
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  •  ...The work spans Kubernetes orchestration, distributed resource lifecycles, and our Rust...  .... The central questions are whether the system remains correct under concurrency and failure...  ...reviews and documentation help another engineer understand the guarantees and remaining... 
    Full time
    Work at office
    Visa sponsorship
    Relocation package

    Dedalus Labs

    San Francisco, CA
    1 day ago
  •  ...running autonomous software. Our platform spans virtualization, distributed systems, storage, networking, scheduling, orchestration, and low-...  ...scheduling decision matters. We are looking for systems engineers who want to understand computers all the way down and build... 
    Full time
    Work at office
    Visa sponsorship
    Relocation package

    Dedalus Labs

    San Francisco, CA
    1 day ago
  •  ...RF Systems Engineer Specter's mission is to help automate the physical world. Today, we build video sensors with state-of-the-art AI...  ...systems connecting thousands of edge devices across large, distributed environments. This role sits at the intersection of RF systems... 

    Specter Services LLC

    San Francisco, CA
    1 day ago
  • $180k - $300k

     ...About the job Systems Engineer Systems Engineer Company: Confidential - venture-backed technology company Location: San...  ...in OS and kernel internals, virtualization, file systems or distributed infrastructure. You will work at the lowest layers of the stack... 
    Full time
    H1b
    Immediate start
    Visa sponsorship
    Relocation package

    Transparent Search Group

    San Francisco, CA
    2 days ago
  • We Are:Our Utility Industry, Transmission & Distribution Practice is powering the progress to a safe, connected, and sustainable planet....  ...functional teams to deliver impactful outcomes. Whether supporting a system implementation, business process improvement initiative,... 
    Live in
    Work at office
    Local area
    Flexible hours

    Accenture

    San Francisco, CA
    1 day ago
  •  ...System Engineer At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world's largest...  ...development, building and operating mission-critical, high-scale distributed systems. Programming Languages: Strong proficiency in Go... 
    Temporary work
    Live in
    Local area
    Flexible hours

    Cloudflare Inc

    San Francisco, CA
    3 days ago
  • $152k

     ...roleEvery Chimer’s laptop is a door into our systems, and you’d own the platform that decides...  .... We’re looking for a Senior Systems Engineer to take the reins on our macOS fleet —...  ...documentation that scales understanding across a distributed team. Bonus points if you bring Jamf... 
    Full time
    Work at office
    Local area

    Chime

    San Francisco, CA
    3 days ago
  • $200k

     ...Mesa Software Engineer Mesa is building a new GitHub: not just for code, but for all knowledge work. We're seeking someone...  ...the hardcore software engineering skills required to build distributed systems, optimize performance, and design beautiful developer interfaces... 
    Work at office
    Work from home

    Mesa

    San Francisco, CA
    2 days ago
  • $110 per hour

     ...and Jack Dorsey . Position: MLOps Engineer (JAX, PyTorch, Pallas/Triton) Type:...  ...structured solutions to MLOps and ML systems problems. Evaluate MLOps tasks and...  ...frameworks to assess training pipeline design, distributed systems reasoning, and kernel-level... 
    Remote job
    Contract work
    Summer work
    Weekday work

    Mercor

    San Francisco, CA
    6 days ago
  • $165k - $200k

     ...other, come build with us at Crusoe.About This RoleAs a Senior Systems Engineer, you’ll play a key role in building and optimizing Crusoe’s...  ..., including occasional off-hours syncs to support distributed operationsWhat You’ll Bring to the Team5+ years of experience... 
    Temporary work

    Crusoe

    San Francisco, CA
    4 days ago
  • Platform Engineer Build the platform that makes AI customer conversations accountable Are...  ...engineer who enjoys building scalable backend systems, working with modern cloud...  ...platform. Build APIs, data models, and distributed processing components. Contribute to architectural... 

    SourceIN

    San Francisco, CA
    3 days ago
  •  ...effectively. You’ll join the founding team, which has fewer than six engineers. You will be responsible for core parts of the data platform:...  ...telemetry. You will work on problems at all levels of the system. You design, build, and release your work, and you help operate... 
    Permanent employment
    Full time
    Immediate start

    revel

    San Francisco, CA
    9 days ago
  •  ...of compute, and a lot more work for it. We’re looking for a Systems Engineer who knows how to find bottlenecks and move them somewhere we...  ...where time and resources go, and fix what matters Reliable distributed systems - design how work and data move across machines,... 
    Full time

    mirendil

    San Francisco, CA
    9 days ago
  •  ...generation of autonomous software. Our platform spans distributed storage, virtualization, orchestration, networking,...  .... We’re looking for unusually high-potential engineers who want to learn how reliable systems are designed, built, broken, and improved. About... 
    Full time
    Internship

    Kindredventures

    San Francisco, CA
    2 days ago
  • $117k - $161k

     ...all in on this mission. If you are too, let's talk.The Senior Systems Engineer OpportunityAs a Senior Systems Engineer at Okta, you will be...  ...Experience working in a fast-paced environment supporting a distributed, global company.Governance Mindset: A track record of... 
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    4 days ago
  • $140k - $165k

     ...storing material. We're applying robotics and distributed software to create a new class of...  ...economy. About the Role: Mytra's Systems Integration and Test team is looking for a mechanically oriented Systems Test Engineer to design and execute structural and dynamic... 
    Work experience placement
    Work at office

    Mytra

    Brisbane, CA
    2 days ago
  • $156.1k - $234.5k

     ...Senior Pre-Sales Systems Engineer Everpure (formerly Pure Storage), a leader in the data storage and flash technology space, is seeking...  ...leadership and domain expertise on storage products, distributed storage architectures, file systems, and competitive storage... 
    Local area
    Flexible hours

    Everpure

    San Francisco, CA
    5 days ago
  • $153k - $376k

     ...heart of everything we build. As a Software Engineer on our Infrastructure team, you’ll help design, build, and operate the systems that power our real-time collaborative...  ...scaling fast, and we’re looking for experienced distributed systems engineers across a variety of... 
    Full time
    Remote work
    Work from home
    Worldwide

    Figma

    San Francisco, CA
    3 days ago
  • $180k - $310k

     ...evolve the core data model and storage systems powering Gamma's business. You'll ship backend...  ...rapid shipping velocity. As Software Engineer on the Platform team, you'll collaborate...  ...Design and implement scalable APIs, distributed systems, and data infrastructure that... 
    Full time
    Work at office
    Work from home

    gamma

    San Francisco, CA
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distributed Systems Engineer. Be the first to apply!