Software Engineer, Distributed Systems
$300k - $400kthinkingmachines
About Thinking Machines
The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.
About the Role
We're hiring a Software Engineer, Distributed Systems to design and build the core distributed systems that everything else at Thinking Machines runs on — orchestration, scheduling, storage, and networking across thousands of machines. Your work underpins both Inkling's training clusters and Tinker's serving platform, and shows up anywhere we need software to coordinate reliably at scale.
This is deep systems work. You'll be reasoning about consensus, fault tolerance, and performance under real-world failure conditions, often on problems that don't have an off-the-shelf solution.
What You'll Do
Design and build distributed systems for compute orchestration, scheduling, storage, and networking across large GPU and TPU clusters
Develop fault-tolerant systems that keep running correctly as hardware fails, networks partition, and workloads scale
Build the distributed storage and data orchestration layers that move and persist large volumes of training and model data
Improve the performance and efficiency of collective communication, scheduling, and resource allocation across thousands of machines
Partner with research and infrastructure teams to identify systems bottlenecks and design solutions from first principles
Write production-quality code and help shape the architecture of systems used company-wide
Skills & Qualifications
Minimum Qualifications
5+ years of experience building large-scale distributed systems
Proficiency in Python and Go, C++, or another systems-level language
Strong understanding of distributed systems fundamentals: consensus, consistency, replication, and fault tolerance
Experience with network programming, load balancing, or distributed storage systems
Preferred Qualifications
Experience building distributed compute or orchestration systems for AI or ML workloads
Fluent in containerization, orchestration, and distributed compute frameworks
Experience with specialized hardware (GPUs, TPUs) and their integration into distributed training or serving systems
Background at AI research labs, high-performance computing centers, or similarly demanding environments
Published work or open-source contributions related to distributed systems or performance engineering
Comfortable operating with high autonomy in a fast-changing, early-stage environment
Logistics
Location: This role is based in San Francisco, California or New York, New York.
Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $300,000 - $400,000 USD.
Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.
$180k - $310k
...evolve the core data model and storage systems powering Gamma's business. You'll ship... ...with rapid shipping velocity. As Software Engineer on the Platform team, you'll collaborate... ...Design and implement scalable APIs, distributed systems, and data infrastructure that...SuggestedFull timeWork at officeWork from home$148.5k - $223.9k
...duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce... ...components/frameworks in developing distributed filesystems in an ever-growing and... ...designing and developing distributed systems at scale. Proficiency in queues, locks...SuggestedFull timeImmediate start$117.2k - $260.1k
...experiences. Join our team of talented engineers and help us advance the... ...are seeking a proactive and skilled Software Security Engineer to join our GCP... ...infrastructure security, and the security of distributed and scalable distributed systems. This role requires hands-on...SuggestedFull time$166k - $225k
...improve their business. Founded by engineers — and customer obsessed — we leap... ...SQL query engines. As a software engineer on the Runtime team at Databricks... ...be building the next generation distributed data storage and processing systems that can outperform specialized...SuggestedLocal areaWorldwide$153k - $376k
...the heart of everything we build. As a Software Engineer on our Infrastructure team, you’ll help design, build, and operate the systems that power our real-time collaborative design... ...fast, and we’re looking for experienced distributed systems engineers across a variety of...SuggestedFull timeRemote workWork from homeWorldwide- ...this role: You are an experienced software engineer who is passionate about building large... ...platforms. You have experience building systems that remain reliable under high... ...tracking Global file storage, caching and distribution Global IP backbone: private...Full time
$150k - $300k
...Job Description Job Description Premier Global Links LLC is seeking a talented and highly motivated Software Engineer – AI & Distributed Systems to join an early-stage technology company developing an AI-native supply chain platform. This is an opportunity for...Full timeVisa sponsorshipRelocation package$180k - $310k
...build detection, triage, and response systems that would have required a team five times... ...Gamma magical. This means designing distributed systems for real-time content scanning,... ...shipping velocity. You'll collaborate across engineering, product, and design to define how...Full timeWork at officeWork from home$172.5k - $260.1k
...seeking a visionary, high-energy backend Java engineer to lead the design, architecture, and... ...intelligent automation that enable our systems to self-heal and self-optimize in real... ...get energized by building ultra-resilient distributed systems, driving live-site excellence...Full time$227.2k - $324.5k
About the Role:As a Staff Software Engineer on the ML Infrastructure team, you will collaborate... ...low-latency ML model serving systems that support Deep Learning, LLM, and Search... ...scalable, high throughput, and low latency distributed systems using ScalaBuild reusable...Full timeTemporary workLocal areaFlexible hours$350k
...Thinking Machines Infrastructure And Systems Engineer The mission of Thinking Machines is to build AI that extends human will and judgment... ...'ll work across the full technical stack, solving complex distributed systems problems and building robust, scalable platforms....Visa sponsorshipWork visaRelocation packageFlexible hours- ...well as the Command & Control software to mobilize swarms of... ...industry is attempting. That means distributed state under unreliable networks... ...and ship features in the C2 system that directs swarms of heterogeneous... ...Game development, game jams, engine work, or simulation -...Permanent employmentFull time
$80 - $84 per hour
...Our users are Applied Scientists and Software Engineers, and our goal is to make going from experiment... ...latency-sensitive, high-availability system, and its reliability directly affects... ...experience building and operating distributed, low-latency production services. ~...Temporary workRemote work- ...anywhere in their environments. Our systems can automatically detect and reason about... ...The Role Specter is hiring a Software Systems Engineer to build the real-time device software... ...throughput and reliability across a distributed sensor network Build resource-efficient...Full time
- ...question, anywhere in their environments. Our systems can automatically detect and reason about any... ...The Role Specter is hiring an Embedded Software Engineer to own the full on-device software stack for our distributed wireless mesh sensor nodes, including integration...Full time
$200k
...to fundamentally change how software is built on the Internet by... ...Convex has assembled a team of engineers who have built and designed... ...of experience running large systems at scale, but as our... ...If you are passionate about distributed systems and have a strong background...Full timeWork at officeRemote workNight shift$250k - $300k
...fleets in the world. The Infra Agent Systems team builds the software systems that power and automate that... ...work at the intersection of AI agents, distributed systems, infrastructure, and automation , solving challenging engineering problems with real production impact....Full timeRemote work$185k - $300k
...Job Description About the Role We are looking for Software Engineers – Backend Systems on behalf of our client, an innovative technology company... ...cutting-edge blockchain execution environments and distributed systems , building the technology behind a high-...$320k
...interpretable, and steerable AI systems. We want AI to be safe and... ...of committed researchers, engineers, policy experts, and business... ...role We are looking for software engineers to help build safety... ...Proficiency in Python, Distributed Systems, and Infrastructure...Full timeContract workFor contractorsFor subcontractorWork at officeVisa sponsorshipFlexible hours- ...this research into a lasting company. The Role We’re looking for a Senior or Staff Software Engineer with deep experience building and operating distributed production systems. You’ll work on the infrastructure underlying Hedra’s inference platform: systems...Full timeWork at office
$230k - $288k
...adding hardware, installing software, or changing a line of code.... ...About the Dept Cloudflare’s engineers build and operate the... ...and response times, and make systems failure-resistant and ready-... ...platform that spans globally distributed key-value storage, progressive...Full timeTemporary workLocal areaFlexible hours$185k
About the RoleThe Engineering Acceleration team builds and operates the foundational systems that engineers use to build, test, and ship ChatGPT, the API... ...productivity, build systems, distributed infrastructure, and software quality. You will work on the systems...Work at officeLocal areaRemote workFlexible hours$266k
About the Team:The Database Systems team specializes in high-performance distributed databases. Our team built Rockset, the real-time search, analytics, and... ...internal use cases. About the Role:We are looking for engineers passionate about distributed systems, close-to-the...Work at officeLocal areaFlexible hours$320k
...interpretable, and steerable AI systems. We want AI to be safe and... ...of committed researchers, engineers, policy experts, and business... ...builds and operates the distributed systems that train, serve, and... ...Anthropic depends on. As a Staff+ Software Engineer on our...InternshipWork at officeLocal areaVisa sponsorshipFlexible hours$159.8k - $235k
...and operates the online stateful systems and abstractions that DoorDash Engineering depends on: reliable, efficient,... ...easy to use. Within Storage, the Distributed Caching team owns every caching offering... ...Code, Codex, Cursor) in the full software development lifecycle, including...Hourly payFull timeWork at officeLocal areaRemote workFlexible hours- ...looking for a strong server internals engineer to help develop ClickHouse and maintain... ...across storage, query processing, distributed execution, authentication, and cloud integration... ...to assess vulnerabilities in large software systems and dependency chains, reproduce...Full timeRemote workFlexible hours
$160k - $190k
...Job Description Job Description Platform Engineer | AI, Distributed Systems & SaaS New York City or San Francisco Bay Area Python | AWS... ...customer conversations accountable Are you a hands-on software engineer who enjoys building scalable backend systems,...Visa sponsorship$132.3k - $240.54k
...The Robotics Reliability Engineering (RRE) team at Nuro focuses on... ...footprint grow. We work across software, hardware, infrastructure,... ...design, build, and operate systems that support our autonomous... ...Bonus Points Background in distributed systems or real-world deployed...Immediate startFlexible hours- ...observability data, and run evals that tell them how to improve. About the role We're looking for a software engineer who loves to build high performance data processing systems. Our customers are scaled up companies who send complex, semi-structured data which they need to...Full timeFlexible hours
$52 - $58 per hour
...opportunity to thrive. Interns work side-by-side with top engineers in the industry while having autonomy from the get-go. They contribute... ...) Participate in code reviews to ensure code quality and distribute knowledge Continuous integration and deployment Go home...Full timeWork experience placementSummer workInternshipSummer internshipWork at officeLocal areaImmediate startWork from home3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Distributed Systems. Be the first to apply!
- junior software developer San Francisco, CA
- senior software design engineer San Francisco, CA
- software web developer San Francisco, CA
- senior software engineer San Francisco, CA
- software developer fintech San Francisco, CA
- software support engineer San Francisco, CA
- security software engineer San Francisco, CA
- software developer night shift San Francisco, CA
- software engineer co-op San Francisco, CA
- integration software engineer San Francisco, CA






