Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Data Infrastructure

Cohere

Who are we?

Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what's best for our customers.

Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.

Join us on our mission and shape the future!

Why this role?

We're building the data infrastructure behind some of the most demanding AI training workloads in the world, and we want sharp, curious people to help us do it. In this role, you'll build and maintain the high-performance data layer our Modeling teams rely on for training and evaluation jobs.

As a Software Engineer, Data Infrastructure, you will:
  • Work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it.
  • Collaborate daily with researchers and engineers who are some of the best in the world at what they do.
You may be a good fit if you have:
  • 4+ years of experience working on data storage infrastructure
  • Strong command of Python
  • Kubernetes experience, especially on the storage side (Persistent Volumes, CSI drivers, etc.)
  • The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX
  • Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink
  • [Nice-to-have] Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt
  • Genuine excitement about AI. You follow the research, have opinions, and enjoy being in the weeds
  • Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimize what already exists

If some of the above doesn't line up perfectly with your experience, we still encourage you to apply!


We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

Full-Time Employees at Cohere enjoy these Perks:

An open and inclusive culture and work environment

Work closely with a team on the cutting edge of AI research

Weekly lunch stipend, in-office lunches & snacks

Full health and dental benefits, including a separate budget to take care of your mental health

100% Parental Leave top-up for up to 6 months

Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement

Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend

6 weeks of vacation (30 working days!)
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Data Infrastructure in New York, NY vacancy
  • $140k - $200k

     ...include frontend and backend engineers, AI research scientists, and...  ...'re looking to hire for our Data side of our AI team at...  ...through a tight integration of infrastructure, engineering, and research work...  ...are looking for a skilled Software Engineer to join us. What You... 
    Suggested
    Full time
    Work at office
    Shift work

    Speechify

    New York, NY
    2 days ago
  • $140k - $215k

     ...Cybersecurity Data Engineer As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that...  ...large-scale distributed data processing systems Own Flink/Spark infrastructure on Kubernetes/AWS/GPS/OCI Ensure availability,... 
    Suggested
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    New York, NY
    6 hours ago
  • $165k - $242k

     ...Senior Software Engineer, Data Center Infrastructure Tooling CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted... 
    Suggested
    Temporary work
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $200k - $220k

     ...Senior Software Engineer, Data Infrastructure (RDBMS) United States Build to Protect Civilization TRM is a blockchain intelligence company that’s on a mission to build a safer financial system for billions of people. We’re a lean, high‑impact team tackling some of the... 
    Suggested
    Remote work
    Shift work

    TRM

    New York, NY
    4 days ago
  •  ...Software Engineer, ML Data Infrastructure Ideogram's mission is to make world-class design accessible to everyone, multiplying human creativity. We build proprietary generative media models and AI native creative workflows, tackling unsolved challenges in graphic design... 
    Suggested
    Work at office

    Ideogram

    New York, NY
    3 days ago
  •  ...Software Engineer - Data Infrastructure - Kafka Home based - EMEA Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops a managed solutions... 
    Remote work
    Work from home

    Canonical Group Ltd

    New York, NY
    4 days ago
  •  ...Software Engineer, Data Infrastructure Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design, and engineering. Our organization is very flat, and our... 
    Contract work
    Work at office

    Anysphere

    New York, NY
    1 day ago
  •  ...Framework Ventures is seeking a Software Engineer III to design and develop digital identity infrastructure with remote work options. The role requires 6+ years of experience in software development, proficiency in object-oriented programming, and the ability to architect... 
    Remote work

    Framework Ventures

    New York, NY
    4 days ago
  • $160k - $240k

     ...Senior Software Engineer - Data Center Infrastructure Management API Location New York Business Area Engineering and CTO Ref # 10050006 Description & Requirements Our Team: We are on a mission to build applications that enable Bloomberg Engineering... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    1 day ago
  • $160k - $240k

    Senior Software Engineer - MySQL Data Infrastructure Location New York Business Area Engineering and CTO Ref # 10046723 Description & Requirements Our financial products rely on petabytes of real‑time and historical data. DataHub is Bloomberg’s distributed data platform... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  • $160k - $240k

    Senior Software Engineer - Data Center Infrastructure Management API Location New York Business Area Engineering and CTO Ref # 10043898 Description & Requirements Our Team The team is at the forefront of Bloomberg's infrastructure management, crafting secure and reliable... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    5 days ago
  • $200k - $250k

     ...Lead Software Engineer - Data Infrastructure Boston or NYC Layer Health was founded in 2023 by leading machine learning researchers from MIT and Harvard Medical School. We are building an AI layer that can accurately and scalably synthesize information from medical... 
    Work at office
    2 days per week
    3 days per week

    Layer Health

    New York, NY
    3 days ago
  •  ...NVentures (venture arm of NVIDIA). About the Role Suno is growing fast, and we're hiring Staff and Senior Software Engineers to work on Data Infrastructure at Suno, where you will be responsible for building and scaling the foundational systems that power Suno's... 
    Work at office
    Local area
    Immediate start

    SUNO

    New York, NY
    3 days ago
  • $200k - $275k

     ...Staff Data Infrastructure Engineer Peregrine helps public safety organizations, state and local and governments, federal agencies, and private...  ...pipeline orchestration using Airflow or similar tools Strong software engineering fundamentals in Python and/or Scala, with a... 
    Local area

    Peregrine Corporation

    New York, NY
    3 days ago
  • $15k

     ...technology talks by our experts, a beautiful modern office, daily catered lunches, and more. Your Team As a Senior/Staff Software Engineer on our Data Infrastructure group, you will contribute to scaling and advancing our entire data infrastructure. This includes building data‑... 
    Work at office
    Local area

    The Voleon Group

    New York, NY
    4 days ago
  •  ...Senior Python Full-Stack Engineer - AI Data & Infrastructure About the Role What if your Python expertise could directly shape the infrastructure behind the world's most advanced AI systems? We're looking for a Senior Python Full-Stack Engineer to build and optimize... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    4 days ago
  • $176k - $237.6k

     ...experience, building world‑class open‑source software and communities, and want to be a part of...  ...'d love to hear from you! Summary Cloud Data Store (CDS) owns the storage, retrieval,...  ...team, click here] As a Senior Software Engineer , you will get the chance to design, build... 
    Full time
    Temporary work
    Part time
    Remote work
    Work from home
    Home office

    Temporal Technologies

    New York, NY
    4 days ago
  •  ...A global cloud technology company is seeking a Senior Software Engineer to architect and develop cost management features. This fully remote...  ...Canada and requires expertise in Python, FastAPI, and various data tools. You will collaborate with engineers to create data... 
    Remote work
    Flexible hours

    Do-It

    New York, NY
    4 days ago
  •  ...Senior C++ Full-Stack Engineer - AI Data & Infrastructure About the Role What if your C++ skills could directly shape the infrastructure behind the world's most advanced AI systems? We're looking for a Senior C++ Full-Stack Engineer to build and optimize the... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    3 days ago
  • $180k - $220k

     ...A leading data platform company in the United States seeks a Senior Software Engineer to lead initiatives in scalability and reliability. The role involves architectural design, mentoring engineers, and ensuring high system quality. Candidates should bring 6+ years of... 

    Datavant

    New York, NY
    3 days ago
  • $320k - $405k

     ...Software Engineer, Research Data Platform San Francisco, CA | New York City, NY About Anthropic Anthropic's mission is to create reliable...  ...closer to the research workflow than a typical data infrastructure position: you'll often embed with research teams, build... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    1 day ago
  •  ...healthcare technology company in the United States seeks a Senior Software Engineer to build and maintain core components of its application...  ...operational efficiency, providing constructive feedback, and ensuring data pipeline architecture is robust and scalable. The position... 
    Flexible hours

    Stellar Health

    New York, NY
    4 days ago
  • $190k - $220k

     ...safer world. By leveraging blockchain data, threat intelligence, and advanced analytics...  ...in law enforcement, data science, engineering, and financial intelligence, tackling complex...  ...Competence in deploying and monitoring infrastructure within public cloud platforms,... 
    Remote work
    Shift work

    TRM

    New York, NY
    4 days ago
  • $170k - $280k

     ...to build the future of payments. Our infrastructure powers card programs for 100+ innovative...  ...NewYork City. We're hiring a Senior Software Engineer to join our Infrastructure team and build...  ...services and APIs that make Lithic's data accessible across the organization.... 
    Full time
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Lithic LLC

    New York, NY
    4 days ago
  • $175k - $225k

     ...Tokenization is the most significant infrastructure upgrade in modern capital markets, enabling...  ...assets. RWA.xyz is the leading data platform for tokenized assets. We are...  ...and Wall Street. Overview Role: Software Engineer Team: Data Platform Type:... 
    Part time
    Weekend work

    RWA Inc

    New York, NY
    4 days ago
  • $120k - $140k

     ...Data Platform Engineer Key Responsibilities Platform & Data Engineering Design, build...  ...encryption, and governance controls. Software Engineering: Writing maintainable,...  ...practices. DevOps / DataOps: CI/CD, infrastructure-as-code, and automated deployment of... 
    Full time
    Temporary work
    Local area
    Immediate start

    Pearson Education Services

    Hoboken, NJ
    3 days ago
  • $200k - $236k

     ...Software Engineer, Data Platform Hybrid - SF Bay Area GlossGenius is the AI-powered system behind the world's most meaningful appointments...  ...The primary focus of this role is to reimagine the data infrastructure to support our AI platform. This transformation will be... 
    Work at office
    Home office
    Flexible hours
    3 days per week

    GlossGenius

    New York, NY
    3 days ago
  • $130k - $300k

     ...Analytics Data Platform Lakehouse team builds and operates the foundations that power data engineers, applied AI, and product teams-managing millions of tables on their behalf...  ...with data engineers, analysts, and infrastructure teams to define the roadmap for our lakehouse... 
    Work at office

    Datadog

    New York, NY
    3 days ago
  • $120k - $140k

     ...Senior Data Engineer (API & Platform Integration) Key Responsibilities Platform & Data...  ..., and governance controls. Software Engineering: Writing maintainable, testable...  ...practices. DevOps / DataOps: CI/CD, infrastructure-as-code, and automated deployment of... 
    Full time
    Temporary work
    Local area
    Immediate start

    Pearson

    Hoboken, NJ
    2 days ago
  •  ...Lead Software Engineer We have an opportunity to impact your career and provide an adventure...  ...the Commercial & Investment Banking – Data Analytics – Payments Technology team,...  ...product architectures Proficiency with Infrastructure as Code (Terraform) and containerized... 

    Chase

    Jersey City, NJ
    14 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Data Infrastructure. Be the first to apply!