Senior Software Engineer, Data Platform

Zeus AI Senior Software Engineer, Data Platform Cambridge, MA·Remote·Full time Company website

At Zeus AI, we’re building an AI platform for Earth observations, supported by NASA, the Department of Energy (DOE), and the Department of Defense (DOD). Our interdisciplinary team of engineers and scientists is dedicated to a mission: to create large-scale machine learning models that transform Earth observations into a digital twin of the global weather system for diverse scientific and commercial applications. Advised by industry-leading experts, our core objective is to enhance our understanding and management of the planet through research. We are a remote-first company offering in-person work in Cambridge for team members located nearby.

About Zeus AI

Zeus AI integrates multi-modal, multi-resolution data to create a unified model of our planet. Our model predicts timely, complete, high-resolution global information. Our technology, developed at NASA Ames Research Center in Silicon Valley, uses state of the art computer vision to produce accurate, real-time and high-resolution weather variables. Our team has numerous publications and awards at the intersection of machine learning and Earth sciences with experience working in government agencies, academia, and private industry.

Description

The challenge

Zeus AI is building machine learning models for global and regional scale Earth system modeling, ingesting observations to produce an accurate low latency representation of the planet through machine learning data assimilation. This problem is often framed as observation to observation forecasting or direct observation prediction. We are tackling this problem with a multi-modal and multi-resolution modeling framework using numerous observation types including satellites, stations, aircraft, drones, and marine vessels to power forecasts and digital twin models. Data from this system must be ingested both historically and in near-real time while efficiently serving observations, initial conditions, and forecasts to users.

The role

We are looking for a senior software engineer to join our core science and engineering team. In this role, you will own the data infrastructure that provides near real-time satellite feeds and model outputs. You will be responsible for minimizing and monitoring downtime to satisfy customer service level requirements. You will also be responsible for DevOps and best practices on software and infrastructure design.

You will develop and manage the software infrastructure supporting data platform operations including data and inference pipelines. This will include a combination of data engineering and machine learning operations for global and regional scale weather forecasts, optimizing system architecture and implementing best practices across the stack. You will develop data pipelines to ingest remote sensing observations into Zeus AI’s data lake while optimizing data loading into machine learning pipelines. You will also manage serving data to users through cloud storage, APIs, and web visualizations.

Duties and responsibilities

• Own the data platform that powers machine learning weather models, including training and real-time inference
• Design, implement, and operate robust pipelines to ingest, process, and serve multi-dimensional remote sensing datasets from public and private providers
• Maintain systems to monitor and report on pipeline health, data integrity, and computational performance
• Lead platform engineering best practices across CI/CD, infrastructure as code, testing, deployments, and operational readiness.

Qualifications

• 5+ years of experience working on backend and data engineering
• 1+ years of experience with geospatial datasets and processing
• Experience operating live data pipelines with uptime requirements and status monitoring
• Strong understanding of CI/CD, infrastructure as code, and DevOps practices for data platforms.
• Experience with cloud computing systems like AWS, Azure, GCP, and Lambda.
• Strong interest in scientific research and development, with a desire to contribute to cutting-edge advancements
• Ability to independently drive technical projects and own systems end to end with a high degree of autonomy.

What we offer

• The opportunity to work on cutting-edge research at the intersection of Earth science and machine learning, with access to extensive computing resources.
• A collaborative and stimulating work environment alongside a team of passionate and talented scientists and engineers.
• Competitive compensation, including salary, equity, and a comprehensive benefits package (health, dental, vision, and 401k retirement options).
• Flexible work arrangements and a co-working space benefit.
• The chance to make a tangible difference in the world by contributing to climate solutions and significantly improving weather forecasting.