Staff Software Engineer, Data Infrastructure
$275k - $335kCohere
Who are we?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Why this role?
The Data Infrastructure team at Cohere is responsible for the storage and data movement layer underlying every model training run. We're building the unified storage layer that feeds our training workloads at petabyte scale. In this role, you would have the opportunity to architect and lead the design of this system from the ground up, serving petabytes of training data and model checkpoints fast enough to keep thousands of GPUs busy across several training clusters. You'd be a key contributor, leading the effort to solve a problem few teams have tackled at this scale.
In this role, you will:
Design, architect, and operate the distributed storage system that feeds model training and evaluation, driving the technical vision from concept through production.
Lead and own the deployment of this system across multiple Kubernetes clusters at petabyte scale, setting standards and best practices for the organization.
Collaborate with researchers and training-infra teams to define how jobs read and write data, translating those patterns into throughput, latency, and durability requirements that shape the platform's roadmap.
Navigate the networking, I/O, and consistency challenges of moving large datasets and checkpoints across regions and backends, with GPU idle time and time-to-insight as the key metrics of success — and drive the solutions that improve them.
You may be a good fit if you have:
Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management, with demonstrated architecture and design experience.
Strong coding ability in Python and Go, with the ability to lead implementations and mentor others in either language, and the willingness to contribute to the other.
Proven experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets, with the capacity to design and execute operational strategies.
Hands-on experience with cloud object storage such as S3 as well as POSIX-style filesystems.
It’s a bonus if you have:
Experience with parallel or HPC filesystems such as Weka, VAST, or Lustre, and a track record of applying them at scale.
Familiarity with the data-loading and checkpointing patterns used in large-scale model training, with the ability to innovate on them.
An interest in how large models are trained and evaluated, including the trajectory and eval data those runs generate, and a desire to understand the workloads the platform is serving — with the capacity to guide others in that understanding.
Full-Time Employees at Cohere enjoy these Perks:
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.
How and Where We Work:
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.
$295k - $400k
...technology talks by our experts, a beautiful modern office, daily catered lunches, and more. Your Team As a Staff Software Engineer on our Data Infrastructure team, you will contribute to scaling and advancing our entire data infrastructure. This includes building...SuggestedFull timeWork at officeLocal area$221k - $279.5k
...to where we work. Overview As a Staff Software Engineer, you will play a key role in shaping and advancing a robust data platform that addresses strategic challenges... ...multiple facets of Instacart’s data infrastructure. Through this work, you will empower teams...SuggestedPermanent employmentFull timeWork at officeRemote workWork from homeFlexible hours$149.8k - $262.2k
...Description It all started when engineer Fred Luddy wrote code that... ...brings together any AI, any data, and any workflow— helping 8... ...the team: We are seeking a Staff Software Engineer (IC4 Level) to... ...changes the way software and infrastructure are built. ~8+ years of software...SuggestedPermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$191k - $299k
...standards and years of proven deployment data, we're pioneering a new era of... ...fleet-scale humanoid robotics. As a Staff Software Engineer on our Data Platform team, you will play... ...designing, developing, and maintaining the infrastructure that enables efficient ingestion,...SuggestedFull timeTemporary workRemote workRelocation packageFlexible hours$208.59k - $429.45k
...our recruiting process here . The Data Product Platform is mission-critical... ...leverage our vast data assets and capable infrastructure effectively. # Data Governance:... ...all data. We are seeking a Sr. Staff Software Engineer to provide technical leadership and direction...SuggestedWork at officeLocal areaRemote workRelocationRelocation package- ...cyber operators, startup engineers & operators, and formerly... ...connection. What You'll Do The Staff Engineer on the Data Platform team is the... ...8+ years of professional software engineering experience with... ...database systems and data infrastructure - Expert-level PostgreSQL...Full timeContract workRemote work
- ...Responsibilities Build tracking infrastructure for product analytics, experimentation, and... ...with source-enforced schemas. Build data processing infrastructure in Databricks... ...platform or infrastructure adopted by other engineers. Operate production data or ML systems...Full timeContract workLocal areaFlexible hours
$257k - $386k
...invest heavily in building the best creator platform with the best team in the creator economy and are looking for a Staff Software Engineer, Data Infrastructure to support our mission.This role is remote, with optional in-person attendance in either the New York or San...Work at officeLocal areaRemote workWorldwideFlexible hours2 days per week$184k - $284k
...Senior/Staff Backend Software Engineer – Data Platform About Us GridCARE is the pioneer of Power Acceleration — a new category solving... ...to energy has become the defining bottleneck in the AI infrastructure race. While leading tech companies invest billions in...Full timeWork at officeImmediate startRemote work$231k - $378k
...determined by the business needs of the team. LinkedIn’s Data Infrastructure organization builds and operates the foundational... ...applications at global scale.We are looking for a Principal Staff Software Engineer with deep expertise in database internals, relational database...For contractorsWork at officeFlexible hours$175.5k - $230k
...The Team The Data team builds and runs the systems that make... ...systems, and the Kubernetes-based infrastructure they run on. The data that... ...together. You'll be the engineer who connects them and keeps them... ...an engineer who pairs strong software engineering habits with warehouse...Full timeTemporary workLocal areaRemote workFlexible hours$204k - $290k
...no surprises, and no tradeoffs on what matters most. App Infrastructure is the team behind Affirm's shared mobile app infrastructure... ...have mastered gathering and iterating on feedback from your engineering and cross-functional peers. You have strong verbal and written...Full timeWork at officeRemote workFlexible hours$169.6k - $278.25k
...Summary Infrastructure Foundations builds and operates the multi-cloud platform underneath Temporal Cloud, turning the complexity... ...orders of magnitude of growth. We are looking for a Staff Software Engineer to design and build the next version of that platform. You...Full time$115k - $140k
...teams, local government, and live sound engineers. The platform makes it easy to stream... ...of all sizes. About the Role As a Software + Infrastructure Engineer for the BoxCast Internal Systems... ...decisions for the given supporting data and requirements. Achievement: You...Full timeWork at officeLocal areaRemote workFlexible hoursDay shift- ...among Machine Learning Engineers across the company. In this Staff role, you will drive the... ...operating across ML Platform, Infrastructure, Autonomy and Safety... ..., or large-scale data processing pipelines.... ...also involve working with software and technologies subject...Full time
$218.03k - $256.5k
...libraries that let hundreds of engineering teams run reliable, secure, cost-efficient data layers serving millions of... ...requests per second. We are hiring a Staff Software Engineer to help evolve our... ...~ Experience securing data infrastructure in a regulated environment: encryption...Full timeLocal area$246k - $329k
...builders on a mission to make everyone a data person. Our platform solves key pain... ...work at Hex. About the role Hex's infrastructure team owns all of our cloud infrastructure... ...platform and single-tenant environments. Every engineer at Hex depends on what the...Full timeWork at officeRemote workFlexible hours$204k - $255k
...Community You Will Join Airbnb’s Data Infrastructure organization builds the platforms... ...moves data between Airbnb’s storage engines and transforms it along the way.... ...data flows through at scale. As a Staff Software Engineer, you’ll set technical direction...Full timeContract workWork experience placementCasual workLive inWork at officeRemote work$216k - $239k
...critical Earth observation data for a diverse and... ...mission, multi-customer software systems that process,... ...Products team. The engineer will own architecture... ...latency optimization & core infrastructure: Own key aspects of... ...is a hands-on staff-level engineer with a...Permanent employmentFull timeTemporary workWork at officeRemote workFlexible hours3 days per week$240k - $265k
...About the role Muon seeks a Staff Software Engineer to join our Simulation team. An ideal candidate is an expert generalist software engineer... ...operates LEO satellite constellations delivering mission-critical data. Our revolutionary, integrated technology stack enables...Permanent employmentFull timeTemporary workRemote workFlexible hours$158.5k - $277.4k
Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious... ...AI platform brings together any AI, any data, and any workflow— helping 85% of the... ...a highly motivated and experienced Staff Software Engineer in Platform Persistence to solve...Work experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$232k
...time, Level 5BPosted: 2026-11-03Staff Software Engineer - Streaming Data PlatformAbout the role and... ...that operate at global scale. As a Staff Software Engineer on the Streaming... ...architecture and evolution of the critical infrastructure that powers real-time data movement...Full timeTemporary workWork at officeRemote work$250k
...the Future of Agentic AI | Staff/Senior Engineer | Up to $250K + Equity | High... ...and build the core infrastructure powering its agentic AI platform... ...platform. Unlike traditional software engineering roles focused... ...where source attribution, data provenance, and factual...Full timeLocal areaRemote work$215k - $260k
...only vertically integrated AI infrastructure company built from the... ...across energy, manufacturing, data center construction, and... ...Role:Join Crusoe Energy as a Staff Data Engineer, an early and pivotal hire... ...Engineering Teams: Partner with software engineers, data scientists,...Full timeTemporary workWork at officeRemote work$176.1k - $308.2k
...should take what action on what data.Veza's Access Graph platform... ..., and AI agents. For engineers joining Veza today, this means... ...are looking for a passionate Staff Software Engineer to join Veza's Graph... ...safety in high-stakes infrastructure (access/identity data qualifies...Work at officeRemote workFlexible hours- ...Austin, TXCompany: Realtor.comStaff Software Engineer, Data PlatformLocation: Austin, TX, United... ...building confidence through expert guidance.Staff Software Engineer, Data Ingestion... ...engineer who thrives across platform infrastructure and developer-facing tooling, takes...Contract workWork at officeLocal area
$240k - $300k
...bill pay, and travel software, Brex enables founders... ...need to grow your career.Engineering at BrexEngineering at... ...teams span Software, Data, Security, and IT, and... ...data, query, and search infrastructure that powers critical... ...distributed systems.As a Staff Software Engineer, you...Work at officeRemote workWork from home$149.8k - $262.2k
...DescriptionIt all started when engineer Fred Luddy wrote code that... ...brings together any AI, any data, and any workflow— helping 8... ...: We are seeking a Senior Staff Software Engineer (IC5 Level) to join... ...as operators, controllers, infrastructure automation, and platform services...Permanent employmentWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$116k - $209k
...other. Ready to join a mission that matters? The future of cybersecurity starts with you. About the Role: As a Sr. Data Infrastructure Engineer, you will be a key member of the Data Platform Operations team, responsible for building out the AWS GovCloud...Permanent employmentWork experience placementWork at officeLocal areaRemote work$218.03k - $256k
...at Coinbase. Travel Rule engineering operates the TRUST network,... ...securely exchange Travel Rule data with one another, and the... ...Coinbase. We are hiring a Staff Software Engineer to set technical direction... ...Lead SDKs, APIs, and infrastructure-as-code templates with...Full timeTemporary workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, Data Infrastructure. Be the first to apply!



