Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Distributed Systems

$300k - $400k
Full-time

thinkingmachines

About Thinking Machines

The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.

About the Role

We're hiring a Software Engineer, Distributed Systems to design and build the core distributed systems that everything else at Thinking Machines runs on — orchestration, scheduling, storage, and networking across thousands of machines. Your work underpins both Inkling's training clusters and Tinker's serving platform, and shows up anywhere we need software to coordinate reliably at scale.

This is deep systems work. You'll be reasoning about consensus, fault tolerance, and performance under real-world failure conditions, often on problems that don't have an off-the-shelf solution.

What You'll Do

  • Design and build distributed systems for compute orchestration, scheduling, storage, and networking across large GPU and TPU clusters

  • Develop fault-tolerant systems that keep running correctly as hardware fails, networks partition, and workloads scale

  • Build the distributed storage and data orchestration layers that move and persist large volumes of training and model data

  • Improve the performance and efficiency of collective communication, scheduling, and resource allocation across thousands of machines

  • Partner with research and infrastructure teams to identify systems bottlenecks and design solutions from first principles

  • Write production-quality code and help shape the architecture of systems used company-wide

Skills & Qualifications

Minimum Qualifications

  • 5+ years of experience building large-scale distributed systems

  • Proficiency in Python and Go, C++, or another systems-level language

  • Strong understanding of distributed systems fundamentals: consensus, consistency, replication, and fault tolerance

  • Experience with network programming, load balancing, or distributed storage systems

Preferred Qualifications

  • Experience building distributed compute or orchestration systems for AI or ML workloads

  • Fluent in containerization, orchestration, and distributed compute frameworks

  • Experience with specialized hardware (GPUs, TPUs) and their integration into distributed training or serving systems

  • Background at AI research labs, high-performance computing centers, or similarly demanding environments

  • Published work or open-source contributions related to distributed systems or performance engineering

  • Comfortable operating with high autonomy in a fast-changing, early-stage environment

Logistics

  • Location: This role is based in San Francisco, California or New York, New York.

  • Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $300,000 - $400,000 USD.

  • Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.

  • Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.

Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer, Distributed Systems in San Francisco, CA vacancy
  • $180k - $310k

     ...evolve the core data model and storage systems powering Gamma's business. You'll ship...  ...with rapid shipping velocity. As Software Engineer on the Platform team, you'll collaborate...  ...Design and implement scalable APIs, distributed systems, and data infrastructure that... 
    Suggested
    Full time
    Work at office
    Work from home

    Gamma

    San Francisco, CA
    7 hours ago
  • $148.5k - $223.9k

     ...duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce...  ...components/frameworks in developing distributed filesystems in an ever-growing and...  ...designing and developing distributed systems at scale. Proficiency in queues, locks... 
    Suggested
    Full time
    Immediate start

    Salesforce

    San Francisco, CA
    12 days ago
  • $117.2k - $260.1k

     ...experiences. Join our team of talented engineers and help us advance the...  ...are seeking a proactive and skilled Software Security Engineer to join our GCP...  ...infrastructure security, and the security of distributed and scalable distributed systems. This role requires hands-on... 
    Suggested
    Full time

    Salesforce

    San Francisco, CA
    18 hours ago
  • $166k - $225k

     ...improve their business. Founded by engineers — and customer obsessed — we leap...  ...SQL query engines. As a software engineer on the Runtime team at Databricks...  ...be building the next generation distributed data storage and processing systems that can outperform specialized... 
    Suggested
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $153k - $376k

     ...the heart of everything we build. As a Software Engineer on our Infrastructure team, you’ll help design, build, and operate the systems that power our real-time collaborative design...  ...fast, and we’re looking for experienced distributed systems engineers across a variety of... 
    Suggested
    Full time
    Remote work
    Work from home
    Worldwide

    Figma

    San Francisco, CA
    4 days ago
  •  ...this role: You are an experienced software engineer who is passionate about building large...  ...platforms. You have experience building systems that remain reliable under high...  ...tracking Global file storage, caching and distribution Global IP backbone: private... 
    Full time

    fal-ai

    San Francisco, CA
    4 days ago
  • $150k - $300k

     ...Job Description Job Description Premier Global Links LLC is seeking a talented and highly motivated Software Engineer – AI & Distributed Systems to join an early-stage technology company developing an AI-native supply chain platform. This is an opportunity for... 
    Full time
    Visa sponsorship
    Relocation package

    Premier Global Links

    San Francisco, CA
    12 days ago
  • $180k - $310k

     ...build detection, triage, and response systems that would have required a team five times...  ...Gamma magical. This means designing distributed systems for real-time content scanning,...  ...shipping velocity. You'll collaborate across engineering, product, and design to define how... 
    Full time
    Work at office
    Work from home

    gamma

    San Francisco, CA
    4 days ago
  • $172.5k - $260.1k

     ...seeking a visionary, high-energy backend Java engineer to lead the design, architecture, and...  ...intelligent automation that enable our systems to self-heal and self-optimize in real...  ...get energized by building ultra-resilient distributed systems, driving live-site excellence... 
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $227.2k - $324.5k

    About the Role:As a Staff Software Engineer on the ML Infrastructure team, you will collaborate...  ...low-latency ML model serving systems that support Deep Learning, LLM, and Search...  ...scalable, high throughput, and low latency distributed systems using ScalaBuild reusable... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    San Francisco, CA
    18 hours ago
  • $350k

     ...Thinking Machines Infrastructure And Systems Engineer The mission of Thinking Machines is to build AI that extends human will and judgment...  ...'ll work across the full technical stack, solving complex distributed systems problems and building robust, scalable platforms.... 
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours

    Thinking Machines Lab

    San Francisco, CA
    3 days ago
  •  ...well as the Command & Control software to mobilize swarms of...  ...industry is attempting. That means distributed state under unreliable networks...  ...and ship features in the C2 system that directs swarms of heterogeneous...  ...Game development, game jams, engine work, or simulation -... 
    Permanent employment
    Full time

    Swarmaero

    San Francisco, CA
    21 days ago
  • $80 - $84 per hour

     ...Our users are Applied Scientists and Software Engineers, and our goal is to make going from experiment...  ...latency-sensitive, high-availability system, and its reliability directly affects...  ...experience building and operating distributed, low-latency production services. ~... 
    Temporary work
    Remote work

    Braintrust

    San Francisco, CA
    10 days ago
  •  ...anywhere in their environments. Our systems can automatically detect and reason about...  ...The Role Specter is hiring a Software Systems Engineer to build the real-time device software...  ...throughput and reliability across a distributed sensor network Build resource-efficient... 
    Full time

    specter

    San Francisco, CA
    4 days ago
  •  ...question, anywhere in their environments. Our systems can automatically detect and reason about any...  ...The Role Specter is hiring an Embedded Software Engineer to own the full on-device software stack for our distributed wireless mesh sensor nodes, including integration... 
    Full time

    specter

    San Francisco, CA
    4 days ago
  • $200k

     ...to fundamentally change how software is built on the Internet by...  ...Convex has assembled a team of engineers who have built and designed...  ...of experience running large systems at scale, but as our...  ...If you are passionate about distributed systems and have a strong background... 
    Full time
    Work at office
    Remote work
    Night shift

    convex-dev

    San Francisco, CA
    4 days ago
  • $250k - $300k

     ...fleets in the world. The Infra Agent Systems team builds the software systems that power and automate that...  ...work at the intersection of AI agents, distributed systems, infrastructure, and automation , solving challenging engineering problems with real production impact.... 
    Full time
    Remote work

    Together AI

    San Francisco, CA
    8 days ago
  • $185k - $300k

     ...Job Description About the Role We are looking for Software Engineers – Backend Systems on behalf of our client, an innovative technology company...  ...cutting-edge blockchain execution environments and distributed systems , building the technology behind a high-... 

    AIDA Recruitment

    San Francisco, CA
    6 days ago
  • $320k

     ...interpretable, and steerable AI systems. We want AI to be safe and...  ...of committed researchers, engineers, policy experts, and business...  ...role We are looking for software engineers to help build safety...  ...Proficiency in Python, Distributed Systems, and Infrastructure... 
    Full time
    Contract work
    For contractors
    For subcontractor
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    4 days ago
  •  ...this research into a lasting company. The Role We’re looking for a Senior or Staff Software Engineer with deep experience building and operating distributed production systems. You’ll work on the infrastructure underlying Hedra’s inference platform: systems... 
    Full time
    Work at office

    hedra

    San Francisco, CA
    4 days ago
  • $230k - $288k

     ...adding hardware, installing software, or changing a line of code....  ...About the Dept Cloudflare’s engineers build and operate the...  ...and response times, and make systems failure-resistant and ready-...  ...platform that spans globally distributed key-value storage, progressive... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Cloudflare_

    San Francisco, CA
    4 days ago
  • $185k

    About the RoleThe Engineering Acceleration team builds and operates the foundational systems that engineers use to build, test, and ship ChatGPT, the API...  ...productivity, build systems, distributed infrastructure, and software quality. You will work on the systems... 
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $266k

    About the Team:The Database Systems team specializes in high-performance distributed databases. Our team built Rockset, the real-time search, analytics, and...  ...internal use cases. About the Role:We are looking for engineers passionate about distributed systems, close-to-the... 
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $320k

     ...interpretable, and steerable AI systems. We want AI to be safe and...  ...of committed researchers, engineers, policy experts, and business...  ...builds and operates the distributed systems that train, serve, and...  ...Anthropic depends on. As a Staff+ Software Engineer on our... 
    Internship
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  • $159.8k - $235k

     ...and operates the online stateful systems and abstractions that DoorDash Engineering depends on: reliable, efficient,...  ...easy to use. Within Storage, the Distributed Caching team owns every caching offering...  ...Code, Codex, Cursor) in the full software development lifecycle, including... 
    Hourly pay
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    2 days ago
  •  ...looking for a strong server internals engineer to help develop ClickHouse and maintain...  ...across storage, query processing, distributed execution, authentication, and cloud integration...  ...to assess vulnerabilities in large software systems and dependency chains, reproduce... 
    Full time
    Remote work
    Flexible hours

    Altinity

    San Francisco, CA
    6 days ago
  • $160k - $190k

     ...Job Description Job Description Platform Engineer | AI, Distributed Systems & SaaS New York City or San Francisco Bay Area Python | AWS...  ...customer conversations accountable Are you a hands-on software engineer who enjoys building scalable backend systems,... 
    Visa sponsorship

    SourceIn

    San Francisco, CA
    13 days ago
  • $132.3k - $240.54k

     ...The Robotics Reliability Engineering (RRE) team at Nuro focuses on...  ...footprint grow. We work across software, hardware, infrastructure,...  ...design, build, and operate systems that support our autonomous...  ...Bonus Points Background in distributed systems or real-world deployed... 
    Immediate start
    Flexible hours

    Nuro

    San Francisco, CA
    17 days ago
  •  ...observability data, and run evals that tell them how to improve. About the role We're looking for a software engineer who loves to build high performance data processing systems. Our customers are scaled up companies who send complex, semi-structured data which they need to... 
    Full time
    Flexible hours

    Braintrust

    San Francisco, CA
    8 days ago
  • $52 - $58 per hour

     ...opportunity to thrive. Interns work side-by-side with top engineers in the industry while having autonomy from the get-go. They contribute...  ...) Participate in code reviews to ensure code quality and distribute knowledge Continuous integration and deployment Go home... 
    Full time
    Work experience placement
    Summer work
    Internship
    Summer internship
    Work at office
    Local area
    Immediate start
    Work from home
    3 days per week

    Lyft

    San Francisco, CA
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Distributed Systems. Be the first to apply!