Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Data Infrastructure

Cohere

Who Are We?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We're training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

Why This Role?

The Data Infrastructure team at Cohere is responsible for the storage and data movement layer underlying every model training run. We're building the unified storage layer that feeds our training workloads. It needs to serve petabytes of training data and model checkpoints fast enough to keep thousands of GPUs busy across several training clusters. In this role, you'd have an opportunity to build this system from the ground up. You'd be a key contributor, working on a problem few teams have had to solve at this scale.

In This Role, You Will:
  • Design, build, and operate the distributed storage system that feeds model training and evaluation.

  • Run this system multiple on Kubernetes clusters at petabyte scale.

  • Work with researchers and training-infra teams on how jobs actually read and write data, and turn that into throughput, latency, and durability requirements

  • Work through the networking, I/O, and consistency problems of moving large datasets and checkpoints across regions and backends, with GPU idle time and time-to-insight as the measures of success

You May Be A Good Fit If You Have:
  • Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management.

  • Strong coding ability. We work in Python and Go; experience in either is enough, but you should be willing to pick up the other

  • Experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets.

  • Hands-on experience with cloud object storage such as S3 as well as POSIX-style filesystems.

It's A Bonus If You Have:
  • Experience with parallel or HPC filesystems such as Weka, VAST, or Lustre.

  • Familiarity with the data-loading and checkpointing patterns used in large-scale model training.

  • An interest in how large models are trained and evaluated, including the trajectory and eval data those runs generate, and a desire to understand the workloads the platform is serving.

Full-Time Employees At Cohere Enjoy These Perks:
  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

  • Full health and dental benefits, including a separate budget for mental health.

  • RRSP matching, 401K, Pension Scheme.

  • 100% Parental Leave top-up for up to 6 months, for either parent.

  • Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit. Education & learning stipend for conferences, courses, and coaching.

  • 6 weeks of paid vacation (30 working days!)

  • Budget for traveling to other offices if you are remote, plus an annual company offsite.

How And Where We Work:
  • Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.

  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.

  • For those not near an office: a co-working benefit so you can work alongside others in your city.

  • Everyone receives a $500 home office stipend to set up your workspace properly.

If any of the above doesn't line up exactly with your experience, we still encourage you to apply.

We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.

Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, Data Infrastructure in United States vacancy
  •  ...About the Team Data Platform at OpenAI owns the foundational data stack powering critical...  ...with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is...  ...and analytics. We’re not just scaling infrastructure – we’re redefining how people interact... 
    Suggested
    Work at office
    Relocation package

    OpenAI

    New York, NY
    3 days ago
  • $153k - $376k

     ...Software Engineer - Data Infrastructure San Francisco, CA • New York, NY • United States Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma's platform helps teams bring ideas to life—whether you're... 
    Suggested
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    United States
    3 days ago
  •  ...Data Infrastructure Engineer Mind Robotics is building Physical AI for real-world industrial deployment, starting with the factory floor. We...  ...infrastructure stack. Requirements: ~2+ years of software engineering experience, with some exposure to data pipelines... 
    Suggested
    Immediate start

    Mind Robotics

    Palo Alto, CA
    3 days ago
  • $140k - $200k

     ...Overview We're looking to hire for our Data side of our AI team at Speechify. This role is...  ...and low cost through a tight integration of infrastructure, engineering, and research work. We are looking for a skilled Software Engineer to join us. What You’ll Do Be... 
    Suggested
    Full time
    Shift work

    Speechify

    Knoxville, TN
    1 day ago
  • $180k - $237.8k

     ...industrial robotics in the near future – with software and data at the core. Our mission is to...  ...developers. We are a dynamic team of engineers, roboticists, designers, and...  ...As a Software Engineer on the Data Infrastructure team, you will be responsible for designing... 
    Suggested
    Full time
    Local area

    Intrinsic

    Mountain View, CA
    2 days ago
  •  ...office culture that radiates excellence, energy, and focus. About the Role Arena Intelligence is seeking a Data Infrastructure Software Engineer to join our team and build the data pipelines and infrastructure that powers real-world AI evaluation. You'll play a... 
    Full time
    Work at office

    arena

    Bay County, FL
    4 days ago
  •  ...on Lucid’s proprietary technology and software-defined vehicle architecture, our award...  ...and sustainability, design and engineering, ambition and integrity. In Lucid Air...  ...mobility. About the Team The  ADAS Data Infrastructure team builds and operates the foundational... 
    Hourly pay

    Lucid Motors

    Southfield, MI
    8 days ago
  •  ...Job Description About the Role This is a software role focused on data systems at EMA. You'll help build the infrastructure software that stores and organizes...  ...our physics solvers, make five decades of engineering reports searchable and useful, and help build... 

    ELECTRO MAGNETIC APPLICATIONS INC

    Denver, CO
    20 days ago
  • $162k - $216k

     ...design and ship category-defining software that enables Ryder and its 50...  ...-facing software to the data platform that will power the...  ...and creating impact for the engine of the American economy, you'...  ...Role: Software Engineer - Infrastructure Department: Data Platform... 
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton (A Ryder Technology Lab)

    San Francisco, CA
    more than 2 months ago
  • $193.93k - $291.15k

     ...output generalists where ML and systems engineering converge to push autonomy performance forward. As a Senior Perception ML Data Infrastructure Engineer, you will own the critical...  ...of.About YouBS/MS in Computer Science, Software Engineering, Robotics, or a related quantitative... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $202k

     ...; Seattle, WA, United States; New York City, NY, United StatesSchedule: Full time, Level 5Posted: 2026-11-12Senior Software Engineer - Data Infrastructure, Mobility Simulation and PlanningAbout the role and teamHow can Uber plan pricing and incentives to meet financial... 
    Full time
    Work at office
    Remote work

    Uber

    Seattle, WA
    3 days ago
  • $243.29k - $295.25k

     ...shared experiences for everyone.Roblox’s data platform processes petabytes of data...  ...’s Spark workloads run, and the software that lets engineers, analysts, and ML practitioners...  ...data engineering, ML, analytics, and infrastructure teams to understand their needs, communicate... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    2 days ago
  • $209k - $313k

     ..., and other digital services.Snap Engineering teams build fun and technically sophisticated...  ...the forefront.We’re looking for a Software Engineer to join the ML Data Team. Our team builds the...  ...you’ll do:Design and optimize infrastructure systems for machine learning workloads... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    2 days ago
  • $171k

     ...experts to turn real-world operations into high-quality data for our autonomous partners. This team is focused on...  ...efficiency no one else can match.We are seeking a Software Engineer II to build the data infrastructure for AV Labs: the systems that ingest, store, and... 
    Full time
    Work at office
    Remote work

    Uber

    Sunnyvale, CA
    4 days ago
  • $146k - $234k

     ...go, and make mobility more efficient and accessible for all. We are seeking a talented and experienced Software Engineer to join our data engineering and infrastructure team. In this role, you will be a key contributor to the design, development, and maintenance of our... 
    Work at office
    Local area
    3 days per week

    Aurora Innovation

    Pittsburgh, PA
    3 days ago
  • $178.89k - $268.33k

     ..., rewarding, and diverse environment for every OK-er.About the OpportunityWe are looking for a seasoned engineer to build and improve the ML and data infrastructure behind our risk and fraud prevention systems. You will work hands-on to move models from experimentation... 

    OKX

    San Jose, CA
    2 days ago
  • $253k - $416k

     ...Mountain View, CA OR Bellevue, WA.LinkedIn’s Data Infrastructure team builds and operates some of the...  ....We are seeking a Distinguished Engineer with deep expertise in Online Infrastructure...  ...experience10+ years of experience in software engineering, with a focus on... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  • $266k

     ...Platform at OpenAI owns the foundational data stack powering critical product,...  ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is...  ..., and analytics.We’re not just scaling infrastructure - we’re redefining how people interact... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    23 hours ago
  • $155k - $185k

    The OpportunityWe are looking for an experienced Software Engineer with a passion for building robust and scalable data infrastructure to join our Data Platform team. In this role, you'll design and develop the foundational systems that power the flow of data across the... 
    Permanent employment

    Otter.ai

    Mountain View, CA
    1 day ago
  • $174k - $252k

     ...cite large private corporate.Engineer for production an intense focus...  ...building and operating data pipelines (e.g., one or more...  ...qualifications:Experience with infrastructure-as-code (e.g., Terraform) and...  ...intelligence of our prototypes. As a Software Engineer, you will be working... 
    Work at office

    Google

    Mountain View, CA
    15 hours ago
  • $295k - $400k

     ...technology talks by our experts, a beautiful modern office, daily catered lunches, and more. Your Team As a Staff Software Engineer on our Data Infrastructure team, you will contribute to scaling and advancing our entire data infrastructure. This includes building data-... 
    Full time
    Work at office
    Local area

    The Voleon Group

    Remote
    4 days ago
  • $156k - $166.4k

     ...Training & development Tuition assistance We are seeking an experienced Senior Software Engineer with a strong background in EVPN VXLAN technologies for data center and service provider environments. The ideal candidate will have hands-on experience working... 
    Full time
    Work from home
    Flexible hours

    Eitacies Inc

    Remote
    1 day ago
  • $162k - $216k

     ...design and ship category-defining software that enables Ryder and its 50...  ...-facing software to the data platform that will power the...  ...and creating impact for the engine of the American economy, you’...  ..., and maintain the core data infrastructure that powers Baton's near real... 
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    23 hours ago
  • $206.5k - $258.1k

     ...outdoors and a desire to protect it for future generations. Role Summary Rivian's Autonomy org needs a Staff Software Engineer, ML Data Infrastructure to own how autonomy data is described, indexed and accessed. This sits in the Platform Services team in the AI... 
    Full time
    Contract work
    Temporary work
    Part time
    Local area
    Shift work

    Rivian

    Palo Alto, CA
    -10
  • $84k - $132k

     ...a leading global analytics software company, helping businesses...  ...Opportunity The myFICO engineering team builds the web applications...  ...-facing business, and data powers everything we do. We...  ...SageMaker, NoSQL databases, infrastructure as code, BI tools such as Tableau... 
    Full time
    Worldwide

    FICO

    Remote
    14 days ago
  • $131.8k - $290k

    Job Title: Senior Software Engineer - Cloud & Data Services Job Category: Engineering Time Type: Full time Minimum Clearance Required to Start: TS/SCI with Polygraph Employee Type: Regular Percentage of Travel Required: None Type of Travel: None * *... 
    Full time
    Contract work
    Work experience placement
    Flexible hours

    CACI International, Inc.

    Linthicum Heights, MD
    3 days ago
  •  ...Software Engineer, Data & Analytics Platform In Brief We’re a rapidly growing startup on a mission to make healthcare proactive by...  ...role in shaping key technical decisions, building the data infrastructure our company and clients rely on, and see your work make a... 
    Full time
    Local area

    Bayesian Health, Inc.

    Remote
    6 days ago
  • $149k - $198.5k

     ...Mission Summary: The Data Platform team is the vital link between our company's expansive data and the engineering teams that rely on it. We architect and operate the core services and infrastructure necessary to transform petabytes of raw data each month into actionable... 
    Full time
    Work at office
    Remote work

    Motional

    Remote
    20 days ago
  • $122.4k - $176k

     ...cybercrime. These AI-native, data-intensive SaaS applications...  ...build and maintain the core infrastructure that powers Abnormal’s most...  ...platforms and services to all of engineering and data science. We also...  .... We’re looking for a Software Engineer I who is eager to... 
    Full time
    Work experience placement

    Abnormal

    Remote
    4 days ago
  • $150k - $180k

     ...our suite of cloud-based analytics and data management solutions, we help many of...  ...across high growth start-ups, global infrastructure and renewable energy, growth equity, and...  ...excellent, platform-minded Senior Software Engineer to join our Data Platform team, part of... 
    Full time
    Immediate start
    Remote work
    Flexible hours

    Chronograph

    Remote
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Data Infrastructure. Be the first to apply!