Software Engineer, Data Infrastructure
Cohere
Who Are We?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We're training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Why This Role?
The Data Infrastructure team at Cohere is responsible for the storage and data movement layer underlying every model training run. We're building the unified storage layer that feeds our training workloads. It needs to serve petabytes of training data and model checkpoints fast enough to keep thousands of GPUs busy across several training clusters. In this role, you'd have an opportunity to build this system from the ground up. You'd be a key contributor, working on a problem few teams have had to solve at this scale.
In This Role, You Will:
Design, build, and operate the distributed storage system that feeds model training and evaluation.
Run this system multiple on Kubernetes clusters at petabyte scale.
Work with researchers and training-infra teams on how jobs actually read and write data, and turn that into throughput, latency, and durability requirements
Work through the networking, I/O, and consistency problems of moving large datasets and checkpoints across regions and backends, with GPU idle time and time-to-insight as the measures of success
You May Be A Good Fit If You Have:
Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management.
Strong coding ability. We work in Python and Go; experience in either is enough, but you should be willing to pick up the other
Experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets.
Hands-on experience with cloud object storage such as S3 as well as POSIX-style filesystems.
It's A Bonus If You Have:
Experience with parallel or HPC filesystems such as Weka, VAST, or Lustre.
Familiarity with the data-loading and checkpointing patterns used in large-scale model training.
An interest in how large models are trained and evaluated, including the trajectory and eval data those runs generate, and a desire to understand the workloads the platform is serving.
Full-Time Employees At Cohere Enjoy These Perks:
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit. Education & learning stipend for conferences, courses, and coaching.
6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.
How And Where We Work:
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn't line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.
- ...About the Team Data Platform at OpenAI owns the foundational data stack powering critical... ...with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is... ...and analytics. We’re not just scaling infrastructure – we’re redefining how people interact...SuggestedWork at officeRelocation package
$153k - $376k
...Software Engineer - Data Infrastructure San Francisco, CA • New York, NY • United States Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma's platform helps teams bring ideas to life—whether you're...SuggestedMinimum wageFull timeLocal areaRemote workFlexible hours- ...Data Infrastructure Engineer Mind Robotics is building Physical AI for real-world industrial deployment, starting with the factory floor. We... ...infrastructure stack. Requirements: ~2+ years of software engineering experience, with some exposure to data pipelines...SuggestedImmediate start
$140k - $200k
...Overview We're looking to hire for our Data side of our AI team at Speechify. This role is... ...and low cost through a tight integration of infrastructure, engineering, and research work. We are looking for a skilled Software Engineer to join us. What You’ll Do Be...SuggestedFull timeShift work$180k - $237.8k
...industrial robotics in the near future – with software and data at the core. Our mission is to... ...developers. We are a dynamic team of engineers, roboticists, designers, and... ...As a Software Engineer on the Data Infrastructure team, you will be responsible for designing...SuggestedFull timeLocal area- ...office culture that radiates excellence, energy, and focus. About the Role Arena Intelligence is seeking a Data Infrastructure Software Engineer to join our team and build the data pipelines and infrastructure that powers real-world AI evaluation. You'll play a...Full timeWork at office
- ...on Lucid’s proprietary technology and software-defined vehicle architecture, our award... ...and sustainability, design and engineering, ambition and integrity. In Lucid Air... ...mobility. About the Team The ADAS Data Infrastructure team builds and operates the foundational...Hourly pay
- ...Job Description About the Role This is a software role focused on data systems at EMA. You'll help build the infrastructure software that stores and organizes... ...our physics solvers, make five decades of engineering reports searchable and useful, and help build...
$162k - $216k
...design and ship category-defining software that enables Ryder and its 50... ...-facing software to the data platform that will power the... ...and creating impact for the engine of the American economy, you'... ...Role: Software Engineer - Infrastructure Department: Data Platform...Full timeWork at officeImmediate startRemote workMonday to Friday$193.93k - $291.15k
...output generalists where ML and systems engineering converge to push autonomy performance forward. As a Senior Perception ML Data Infrastructure Engineer, you will own the critical... ...of.About YouBS/MS in Computer Science, Software Engineering, Robotics, or a related quantitative...Immediate startFlexible hours$202k
...; Seattle, WA, United States; New York City, NY, United StatesSchedule: Full time, Level 5Posted: 2026-11-12Senior Software Engineer - Data Infrastructure, Mobility Simulation and PlanningAbout the role and teamHow can Uber plan pricing and incentives to meet financial...Full timeWork at officeRemote work$243.29k - $295.25k
...shared experiences for everyone.Roblox’s data platform processes petabytes of data... ...’s Spark workloads run, and the software that lets engineers, analysts, and ML practitioners... ...data engineering, ML, analytics, and infrastructure teams to understand their needs, communicate...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday$209k - $313k
..., and other digital services.Snap Engineering teams build fun and technically sophisticated... ...the forefront.We’re looking for a Software Engineer to join the ML Data Team. Our team builds the... ...you’ll do:Design and optimize infrastructure systems for machine learning workloads...Full timeLive inWork at officeLocal area$171k
...experts to turn real-world operations into high-quality data for our autonomous partners. This team is focused on... ...efficiency no one else can match.We are seeking a Software Engineer II to build the data infrastructure for AV Labs: the systems that ingest, store, and...Full timeWork at officeRemote work$146k - $234k
...go, and make mobility more efficient and accessible for all. We are seeking a talented and experienced Software Engineer to join our data engineering and infrastructure team. In this role, you will be a key contributor to the design, development, and maintenance of our...Work at officeLocal area3 days per week$178.89k - $268.33k
..., rewarding, and diverse environment for every OK-er.About the OpportunityWe are looking for a seasoned engineer to build and improve the ML and data infrastructure behind our risk and fraud prevention systems. You will work hands-on to move models from experimentation...$253k - $416k
...Mountain View, CA OR Bellevue, WA.LinkedIn’s Data Infrastructure team builds and operates some of the... ....We are seeking a Distinguished Engineer with deep expertise in Online Infrastructure... ...experience10+ years of experience in software engineering, with a focus on...For contractorsWork at officeFlexible hours$266k
...Platform at OpenAI owns the foundational data stack powering critical product,... ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is... ..., and analytics.We’re not just scaling infrastructure - we’re redefining how people interact...Work at officeLocal areaRelocation packageFlexible hours$155k - $185k
The OpportunityWe are looking for an experienced Software Engineer with a passion for building robust and scalable data infrastructure to join our Data Platform team. In this role, you'll design and develop the foundational systems that power the flow of data across the...Permanent employment$174k - $252k
...cite large private corporate.Engineer for production an intense focus... ...building and operating data pipelines (e.g., one or more... ...qualifications:Experience with infrastructure-as-code (e.g., Terraform) and... ...intelligence of our prototypes. As a Software Engineer, you will be working...Work at office$295k - $400k
...technology talks by our experts, a beautiful modern office, daily catered lunches, and more. Your Team As a Staff Software Engineer on our Data Infrastructure team, you will contribute to scaling and advancing our entire data infrastructure. This includes building data-...Full timeWork at officeLocal area$156k - $166.4k
...Training & development Tuition assistance We are seeking an experienced Senior Software Engineer with a strong background in EVPN VXLAN technologies for data center and service provider environments. The ideal candidate will have hands-on experience working...Full timeWork from homeFlexible hours$162k - $216k
...design and ship category-defining software that enables Ryder and its 50... ...-facing software to the data platform that will power the... ...and creating impact for the engine of the American economy, you’... ..., and maintain the core data infrastructure that powers Baton's near real...Full timeWork at officeImmediate start$206.5k - $258.1k
...outdoors and a desire to protect it for future generations. Role Summary Rivian's Autonomy org needs a Staff Software Engineer, ML Data Infrastructure to own how autonomy data is described, indexed and accessed. This sits in the Platform Services team in the AI...Full timeContract workTemporary workPart timeLocal areaShift work$84k - $132k
...a leading global analytics software company, helping businesses... ...Opportunity The myFICO engineering team builds the web applications... ...-facing business, and data powers everything we do. We... ...SageMaker, NoSQL databases, infrastructure as code, BI tools such as Tableau...Full timeWorldwide$131.8k - $290k
Job Title: Senior Software Engineer - Cloud & Data Services Job Category: Engineering Time Type: Full time Minimum Clearance Required to Start: TS/SCI with Polygraph Employee Type: Regular Percentage of Travel Required: None Type of Travel: None * *...Full timeContract workWork experience placementFlexible hours- ...Software Engineer, Data & Analytics Platform In Brief We’re a rapidly growing startup on a mission to make healthcare proactive by... ...role in shaping key technical decisions, building the data infrastructure our company and clients rely on, and see your work make a...Full timeLocal area
$149k - $198.5k
...Mission Summary: The Data Platform team is the vital link between our company's expansive data and the engineering teams that rely on it. We architect and operate the core services and infrastructure necessary to transform petabytes of raw data each month into actionable...Full timeWork at officeRemote work$122.4k - $176k
...cybercrime. These AI-native, data-intensive SaaS applications... ...build and maintain the core infrastructure that powers Abnormal’s most... ...platforms and services to all of engineering and data science. We also... .... We’re looking for a Software Engineer I who is eager to...Full timeWork experience placement$150k - $180k
...our suite of cloud-based analytics and data management solutions, we help many of... ...across high growth start-ups, global infrastructure and renewable energy, growth equity, and... ...excellent, platform-minded Senior Software Engineer to join our Data Platform team, part of...Full timeImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Data Infrastructure. Be the first to apply!
- junior software developer United States
- senior software design engineer United States
- software web developer United States
- senior software engineer United States
- labview software developer United States
- software sales engineer United States
- software developer fintech United States
- software support engineer United States
- security software engineer United States
- oracle software engineer United States



