Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Data Infrastructure

Cohere

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We're training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany and Paris. Join us!

Why this role?

We're building the data infrastructure behind some of the most demanding AI training workloads in the world, and we want sharp, curious people to help us do it. In this role, you'll build and maintain the high-performance data layer our Modeling teams rely on for training and evaluation jobs.

As a Software Engineer, Data Infrastructure, you will:
  • Work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it.
  • Collaborate daily with researchers and engineers who are some of the best in the world at what they do.
You may be a good fit if you have:
  • 4+ years of experience working on data storage infrastructure
  • Strong command of Python
  • Kubernetes experience, especially on the storage side (Persistent Volumes, CSI drivers, etc.)
  • The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX
  • Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink
  • [Nice-to-have] Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt
  • Genuine excitement about AI. You follow the research, have opinions, and enjoy being in the weeds
  • Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimize what already exists
If some of the above doesn't line up perfectly with your experience, we still encourage you to apply!


We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.


We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.

Full-Time Employees at Cohere Enjoy These Perks:
  • An open and inclusive culture and work environment
  • Work closely with a team on the cutting edge of AI research
  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
  • Full health and dental benefits, including a separate budget for mental health.
  • RRSP matching, 401K, Pension Scheme.
  • 100% Parental Leave top-up for up to 6 months, for either parent.
  • Annual enrichment benefits:
    • Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
    • Education & learning stipend for conferences, courses, and coaching.
  • Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
  • 6 weeks of paid vacation (30 working days!)
  • Budget for traveling to other offices if you are remote, plus an annual company offsite.
How and Where We Work:
  • Cohere is remote-friendly. We have offices in Toronto, San Francisco, New York City, London, Paris, Montreal, and more coming soon.
  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
  • For those not near an office: a co-working benefit so you can work alongside others in your city.
  • Everyone receives a $500 home office stipend to set up your workspace properly.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Data Infrastructure in New York, NY vacancy
  • $200k - $400k

     ...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Block's Cash App and Square, Chime,... 
    Suggested
    Full time
    Work at office
    Local area

    Decagon

    New York, NY
    5 days ago
  •  ...Software Engineer, Data Infrastructure Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design, and engineering. Our organization is very flat, and our... 
    Suggested
    Contract work

    Anysphere

    New York, NY
    2 days ago
  • $200k - $275k

     ...Staff Software Engineer, Data Infrastructure New York, NY Backed by leading Silicon Valley investors, Peregrine helps public safety organizations, state and local and governments, federal agencies, and private-sector institutions address society's challenges with... 
    Suggested
    Work at office
    Local area

    Peregrine Corporation

    New York, NY
    4 days ago
  • $222.22k - $287.5k

     ...NVentures (venture arm of NVIDIA). About the Role Suno is growing fast, and we're hiring Staff and Senior Software Engineers to work on Data Infrastructure at Suno, where you will be responsible for building and scaling the foundational systems that power Suno's... 
    Suggested
    Work at office
    Local area
    Immediate start

    SUNO

    New York, NY
    4 days ago
  •  ...Senior Python Full-Stack Engineer - AI Data & Infrastructure About the Role What if your Python expertise could directly shape the infrastructure behind the world's most advanced AI systems? We're looking for a Senior Python Full-Stack Engineer to build and optimize... 
    Suggested
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    5 days ago
  • $120k - $140k

     ...Senior Data Engineer (API & Platform Integration) Key Responsibilities Platform & Data...  ..., and governance controls. Software Engineering: Writing maintainable, testable...  ...practices. DevOps / DataOps: CI/CD, infrastructure‑as‑code, and automated deployment of... 
    Full time
    Temporary work
    Local area
    Immediate start

    Pearson

    Hoboken, NJ
    3 days ago
  • $110k - $130k

     ...for. About the Role, Mission or Department Overview As a Software Engineer on the Experimentation & Instrumentation team, you will build...  ...behavior and engagement metrics. You will work with Product, Data, and other engineering teams to deliver SDKs and interfaces... 
    Local area
    Flexible hours

    New York Times

    New York, NY
    4 days ago
  •  ...of users. This is a hands-on Senior Engineer role with a data focus. You'll own Pearly's data platform - architecture, infrastructure, and code - building it in production-grade...  ...as we move toward an AI-native software development lifecycle. If you're a tenacious... 
    Flexible hours

    Pearly Technology, Inc

    New York, NY
    2 days ago
  • $158k - $197k

     ...Sr. Software Engineer - Data Platform New York, NY Who We Are Addepar is a global data and AI platform empowering investment professionals...  ...years of experience Experience working with cloud infrastructure directly with infrastructure as code (e.g. Terraform) on... 
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa

    Addepar

    New York, NY
    4 days ago
  •  ...on collaboration, rigorous primary research, and data-driven decision making. A core part of our...  ...Role Overview We are looking for an Agentic Software Engineer to build the data platforms , infrastructure , and data products that enable investment professionals... 
    Work experience placement

    Balyasny Asset Management

    New York, NY
    2 days ago
  • $190k - $220k

     ...guarantee scalable, efficient, and resilient solutions. Data Infrastructure : Architect and maintain reliable, scalable, and...  ...You possess a minimum of 5 years of experience in software engineering, with a specialization in data engineering, data modeling... 
    Work at office

    Adonis Technology, Inc

    New York, NY
    5 days ago
  • $197k - $247k

     ...Senior Software Engineer, Data Platform We are looking for a Senior Software Engineer to architect, build, and maintain the data infrastructure at Gusto. As part of the Data Platform team, you will collaborate closely with Data Science, Business Intelligence, and analysts... 
    Work at office
    Local area
    2 days per week
    3 days per week

    Gusto

    New York, NY
    2 days ago
  • $175k - $225k

     ...Tokenization is the most significant infrastructure upgrade in modern capital markets, enabling...  ...assets. RWA.xyz is the leading data platform for tokenized assets. We are...  ...and Wall Street. Overview Role: Software Engineer Team: Data Platform Type:... 
    Part time
    Weekend work

    RWA Inc

    New York, NY
    5 days ago
  • $130k - $300k

     ...Analytics Data Platform Lakehouse team builds and operates the foundations that power data engineers, applied AI, and product teams-managing millions of tables on their behalf...  ...with data engineers, analysts, and infrastructure teams to define the roadmap for our lakehouse... 
    Work at office

    Datadog

    New York, NY
    4 days ago
  • $165k - $242k

     ...CoreWeave combines superior infrastructure performance with deep technical...  .... We're standing up new data centers at an extraordinary...  ...platform that gives network engineers, fleet engineers, and operations...  ...goal is to build bespoke software to model our infrastructure... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    New York, NY
    more than 2 months ago
  • $135k - $280k

     ...About Assembled Assembled builds the infrastructure that underpins exceptional customer support, empowering...  ...The Role We’re looking for an experienced software engineer to help shape the foundation of Assembled’s data systems. You’ll join our Data Infrastructure team... 

    Assembled

    New York, NY
    more than 2 months ago
  •  ...Senior C# Full-Stack Engineer - AI Data & Infrastructure About the Role What if your C# expertise could directly shape the infrastructure powering next-generation AI? We're looking for a Senior C# Full-Stack Engineer to build and optimize the systems that leading... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    5 days ago
  • $165k - $242k

     ...enterprises, CoreWeave combines superior infrastructure performance with deep technical...  ...Do: The Platform & Infrastructure Engineering team in the Data Infrastructure organization is...  ...expertise in Kubernetes and containerized software services, including cluster design,... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    24 days ago
  • $200k - $250k

     ...and sustainability of critical infrastructure. Gecko's complete and...  ...leading sensors, and an AI-powered data platform to provide customers...  ...the company. As part of the Software Platform team, your mission...  ...’re looking for an ambitious engineer to lead the next evolution of... 
    Work at office
    Local area
    Work from home
    Flexible hours

    Gecko Robotics

    New York, NY
    19 days ago
  • $125.56k - $179.37k

     ...Backend Engineer Spotify is looking for a Backend Engineer to join our Data Infrastructure engineering organization. You will forge new ground in how we help teams at Spotify build analytics for internal and Music industry facing tools. Our platform enables capabilities... 
    Contract work
    Work from home
    Flexible hours

    Spotify

    New York, NY
    3 days ago
  • $160k - $240k

     ...Senior Software Engineer - Real-time Data Location New York Business Area Engineering and CTO Ref # 10051647 Description & Requirements...  ...around the world. From equity prices to FX rates, our infrastructure handles hundreds of billions of messages per day from 3... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    4 days ago
  • $160k - $240k

     ...Senior Software Engineer — Distributed Data and Retrieval Platform Location New York Business Area Engineering and CTO Ref # 100...  ...distributed systems, storage engines, or large-scale data infrastructure. ~ Strong debugging skills across application code,... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    3 days ago
  • $175k - $210k

     ...when in need of help, and corresponding software for caregivers to triage response. Our company...  ...Role This role is a senior backend engineer on the EHR Integrations team who will...  ...for understanding and implementing complex data flows between EHRs (Electronic Health... 
    Apprenticeship
    Work at office
    Local area
    Remote work
    2 days per week

    Sage Group plc

    New York, NY
    4 days ago
  •  ...Software Engineer, Data Interfere turns a product's invisible failures into shared problems the whole team can see and fix. Every app...  ...grows by orders of magnitude The indexing and retrieval infrastructure that lets agents and models find the right context at the... 
    Immediate start
    Visa sponsorship

    Interfere (yc S25)

    New York, NY
    5 days ago
  • $160k - $240k

     ...Senior Software Engineer - Data & Analytics Federation Location New York Business Area Engineering and CTO Ref # 10050103...  .... Our team: We're the backbone of Bloomberg's data infrastructure, connecting applications to every type of content they need... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    3 days ago
  • $320k - $405k

     ...Software Engineer, Human Data Interface San Francisco, CA | New York City, NY About Anthropic Anthropic's mission is to create reliable...  ...for data vendors, tooling, and front-end and back-end infrastructure that enables researchers to gather high-quality data at... 
    Work at office
    Flexible hours
    Shift work

    Anthropic

    New York, NY
    4 days ago
  • $123k - $165k

     ...Job Posting Title: Software Engineer II - Data Transformation Req ID: 10141158 Job Description: Disney Entertainment & ESPN Technology...  ...: DE&E Technologists are designing and building the infrastructure that will power Disney's media, advertising, and... 
    Full time
    Worldwide

    The Walt Disney Company

    New York, NY
    5 days ago
  • $190k - $250k

     ...preventive care for as many people as possible. Atria Health is seeking a Senior Software Engineer for our Data Engineering team to support engineering efforts across our data infrastructure, pipelines, and analytics platforms. This senior individual contributor role is... 
    Work at office
    Flexible hours
    3 days per week

    Atria Physician Practice New York PC

    New York, NY
    5 days ago
  •  ...Chainlink stack provides the essential data, interoperability, compliance, and...  ...also adopted Chainlink’s standards and infrastructure, including Swift, Euroclear, Mastercard...  ...[chain.link]( About the Role As a software engineer on the Data Products team, you’ll collaborate... 
    Remote work

    Chainlink Labs

    New York, NY
    4 days ago
  • $121.4k - $161.8k

     ...Senior Software Engineer, Data Engineering At Rockstar Games, we create world-class entertainment experiences. Become part of a team...  ...Participate in the design and implementation of cloud-native data infrastructure supporting real-time and batch workloads.... 
    Full time
    Work at office

    Rockstar Games

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Data Infrastructure. Be the first to apply!