Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - Data Infrastructure

Arena AI

Member Of Technical Staff - Data Infrastructure Software Engineer

Arena Intelligence is seeking a Member of Technical Staff - Data Infrastructure software engineer to join our team and build the data pipelines and infrastructure that powers real-world AI evaluation. You'll play a crucial role in designing and building the data pipelines that process and analyze tens of millions user vote data, directly impacting how we understand and evaluate AI model performance. This role is ideal for someone who thrives in fast-moving environments and interested in building products to ensure accurate and fair evaluation of human preferences across different models, which will shape the direction of future AI development.

As an early member of our data engineering team, you'll partner closely with researchers, engineers, and product leadership to retrieve valuable data and insights from human votes and feedback. You'll help us move fast while staying rigorous, improving data quality, scaling our infrastructure to new levels, and deepening our ability to compare frontier models and predict human preferences.

You'll:

  • Design and build robust data pipelines to ingest, process, and transform user vote data to features essential for model performance evaluation.
  • Collaborate with researchers and product leadership to understand product goals and necessary data.
  • Design and implement solutions to generate result dashboards and reports, providing useful information for the public, model providers, and researchers.
  • Ensure the integrity, data quality, and reliability of the pipelines.
  • Scale our data infrastructure to accommodate increasing data volumes and evolving analytical needs.

You'll have:

  • 5+ years of experience in software engineering, with a dedicated focus on data engineering and big data technologies
  • Proficiency in SQL and at least one programming language commonly used for data analysis (Python (preferred), Scala, R).
  • Hands-on experience with data processing and pipeline frameworks (Apache Spark, Ray Data, etc.) and at least one popular big data analytics platform (Databricks, Snowflake).
  • Demonstrated experience in designing, implementing, optimizing, and debugging production data pipelines.

Bonus points:

  • Prior work in data analytics or datalake platforms.
  • Experience in advanced data analysis tools, such as Delta lake, streaming tables.
  • Exposure to machine learning is a plus.

What we offer:

  • We offer competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate's permanent work location.
  • Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
  • The opportunity to work on cutting-edge AI with a small, mission-driven team
  • A culture that values transparency, trust, and community impact

Come help build the space where anyone can explore and help shape the future of AI.

Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer - Data Infrastructure in San Francisco, CA vacancy
  •  ...Role As a Data Infrastructure Software Engineer working at OpenEvidence, you will build end-to-end systems powering critical product and research workflows. Your work will focus on performance, scalability, and accuracy, granting you full autonomy over the infrastructure... 
    Suggested
    Full time

    Open Evidence

    San Francisco, CA
    more than 2 months ago
  • $190k - $240k

     ...About the role You will build the infrastructure that turns physical operation into...  ...training and evaluation. This is a senior software engineering role responsible for the systems after...  ...rather than becoming ungoverned data volume. What you will do Build... 
    Suggested
    Full time
    Contract work

    Galactic Resource Advancement Mechanism

    San Francisco, CA
    a month ago
  • $160k - $220k

     ...turns siloed and disconnected data into operational...  ...internationally.  Team As an engineering team, we believe strongly that...  ...We are looking for a Data Infrastructure Engineer to join our growing...  ...or similar tools ~ Strong software engineering fundamentals in... 
    Suggested
    Full time
    Work at office
    Local area

    Peregrine Technologies, Llc

    San Francisco, CA
    more than 2 months ago
  • $140k - $200k

     ...include frontend and backend engineers, AI research scientists, and...  ...'re looking to hire for our Data side of our AI team at...  ...through a tight integration of infrastructure, engineering, and research work...  ...are looking for a skilled Software Engineer to join us. What You... 
    Suggested
    Remote job
    Full time
    Work at office
    Shift work

    Speechify

    San Francisco, CA
    more than 2 months ago
  • $266k

     ...Platform at OpenAI owns the foundational data stack powering critical product,...  ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is...  ..., and analytics.We’re not just scaling infrastructure - we’re redefining how people interact... 
    Suggested
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $153k - $376k

     ...of design and collaboration, join us!The Data Platform team at Figma builds and...  ...including AI researchers, machine learning engineers, data scientists, product engineers, and...  ...ML Datalake, orchestration and pipeline infrastructure, and large-scale data ingestion and processing... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    San Francisco, CA
    5 days ago
  •  ...expertise in model innovation and systems engineering paired with a design-minded product...  ...experts in AI. About the Role Data is the lifeblood of our models, and we are looking for a Software Engineer, Data Infrastructure to own the strategy and execution for... 
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia, Inc.

    San Francisco, CA
    2 days ago
  • $162k - $216k

     ...economy.We design and ship category-defining software that enables Ryder and its 50,000+...  ...everything from customer-facing software to the data platform that will power the next era of...  ...problems and creating impact for the engine of the American economy, you’ll love it here... 
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    3 days ago
  •  ...Design and implement high-throughput data pipelines and streaming systems with strong...  ...and operate real-time and batch ingestion infrastructure using Kafka, Flink, and Airflow. Own...  ...early data, platform, or infrastructure engineer. ~ Preferred: strong Kubernetes... 
    Full time
    Work at office

    Decagon

    San Francisco, CA
    a month ago
  •  ...London, and Amsterdam. Making data driven decisions is key to...  ...guidance to teams across engineering, product, and business and help...  .... Engineers on Data Infrastructure are domain experts in Data Warehouse...  ...~6+ years of software engineering experience ~ Extensive... 
    Full time
    Work experience placement
    Local area

    Plaid Inc.

    San Francisco, CA
    14 days ago
  • $7.5k

     ...benefits packages, technology talks by our experts, a beautiful modern office, daily catered lunches, and more.As a Software Engineer on our Data Infrastructure team, you will contribute to scaling and advancing our entire data infrastructure. This includes building data-... 
    Work at office
    Local area

    The Voleon Group

    Berkeley, CA
    4 days ago
  • $213k - $263k

     ...measuring and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve...  ...Design and implement robust tools and infrastructure for data mining, exploration, and analysis... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $170k - $230k

     ...it happen. Job Description The Data Platform Team is part of the Data Organization...  ...(e.g., Claude Code) across the full software development lifecycle - including design...  ...push the boundaries of productivity and engineering outcomes. Bonus skills... 
    Full time
    Work at office
    Local area
    Home office
    Flexible hours

    Highnote

    San Francisco, CA
    more than 2 months ago
  • $196k - $261k

     ...can build in Notion. The Data Product Platform team is responsible...  ...’ll join a team of talented engineers in our mission to build the...  .... Notion’s platforms and infrastructure are vital to enabling our...  ...that own a wide swath of software platforms (hosted or built in... 
    Full time
    Temporary work
    Local area

    Notion

    San Francisco, CA
    more than 2 months ago
  •  ...We are looking for passionate engineers who are excited to build the data foundation for the identity layer...  ...of engineering, data science, and infrastructure to make the platform fast, reliable...  ...Persona ~5+ years of experience in software engineering, with deep expertise... 
    Full time
    For contractors
    Internship
    Immediate start

    Persona

    San Francisco, CA
    more than 2 months ago
  • $130.6k - $192k

     ...reliable on-demand, logistics engine for delivery! We're looking...  ...help us develop a 24x7, global infrastructure system that powers DoorDash's...  .... About the Team Data Platform’s Data User Experience...  ...years of industry experience in software engineering ~ Strong backend... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    22 days ago
  • $192k - $240k

     ...management, bill pay, and travel software, Brex enables founders and...  ...to grow your career. Engineering at Brex Engineering at Brex...  .... Our teams span Software, Data, Security, and IT, and operate...  ...data, query, and search infrastructure that powers critical Brex product... 
    Full time
    Work at office
    Remote work
    Work from home

    Brex Inc.

    San Francisco, CA
    more than 2 months ago
  •  ...Omni Omni is the AI analytics platform that turns company data into a trusted source of truth for AI. Built on a...  ...experience building data platforms, backend systems, workflow engines, or data / ML infrastructure ~ Deep experience with analytical data systems such as... 
    Full time

    Omni

    San Francisco, CA
    more than 2 months ago
  • $230k - $265k

     ...financial tools they need. About the Position: We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of our next-generation Data Platform. This role is critical to ensuring that our data infrastructure is... 
    Full time
    Work from home
    Flexible hours

    Parafin

    San Francisco, CA
    more than 2 months ago
  • About the TeamDoorDash is a data driven organization and relies...  ...organization owns all the infrastructure necessary to run an operationally...  ...simplify data workflows for engineers, analysts, and ML...  ...Codex, Cursor) in the full software development lifecycle, including... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    3 days ago
  • $165.2k - $223.6k

     ...listening platforms, and a flexible infrastructure to continuously enhance...  ...Development Engineers on the ART19 team are end-to...  ...designing, developing and deploying software solutions while holding a high...  ...Experience building scalable data pipelines and analytics platforms... 
    Internship
    Local area
    Flexible hours

    Amazon

    San Francisco, CA
    1 day ago
  • $110.5k - $160k

     ...RoleTwitch is building the future of interactive entertainment. The Data Platform team develops and operates the data platform that...  ...tools to store, transform, move, and understand data.As a software engineer on Data Platform, you will deliver the next generation of... 
    Flexible hours

    Twitch

    San Francisco, CA
    1 day ago
  • $192k - $240k

     ...management, bill pay, and travel software, Brex enables founders and finance...  ...support you need to grow your career.Data at BrexOur Scientists and Engineers work together to make data — and...  ...numbers. The Data team at Brex develops infrastructure, statistical models, and products... 
    Work at office
    3 days per week

    Brex

    San Francisco, CA
    4 days ago
  • $170k - $205k

     ...only vertically integrated AI infrastructure company built from the ground...  ...energy, manufacturing, data center construction, and cloud...  ...Crusoe Energy as a Senior Data Engineer, an early and pivotal hire on...  ...Engineering Teams: Partner with software engineers, data scientists,... 
    Full time
    Temporary work
    Work at office
    Remote work

    Crusoe

    San Francisco, CA
    4 days ago
  • $260k - $350k

     ...design and ship category-defining software that enables Ryder and its 50...  ...-facing software to the data platform that will power the...  ...and creating impact for the engine of the American economy, you’...  ...streaming pipelines, optimize cloud infrastructure, and champion best practices... 
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    3 days ago
  •  ...relies on accounting. Yet most software in the space was built in the...  ...facing a growing, unsolved data problem as a consequence of...  ...before your auditors do. The Data Infrastructure team builds the financial...  ...accounting modules, reporting engine, and AI agents. We’re mid-way... 

    Numeric

    San Francisco, CA
    1 day ago
  •  ...Whatnot updates on our news and engineering blogs and join us as we...  ...commerce. Role The Data Platform team at Whatnot builds...  ..., multi-tenant streaming infrastructure rather than simply building...  ...understanding You As our next Software Engineer, Data Platform, you... 
    Local area
    Remote work
    Work from home
    Home office

    Whatnot

    San Francisco, CA
    6 hours ago
  • $164k

     ...Senior Software Engineer, Data Platform Chime San Francisco, CA, US About the Role Chime's Data Platform team builds the infrastructure every engineering and analytics team depends on - ingestion, transformation, quality, governance, and self-serve tooling... 
    Full time
    Work at office
    Local area
    Remote work
    Night shift

    Chime - San Francisco, CA, US

    San Francisco, CA
    5 days ago
  • $193.4k - $290k

     ...Harvey is generating far more data than we currently know how...  ...and paved paths that product engineers, data engineers, and...  ...Engineering, product teams, and Infrastructure. Today this work is distributed...  ...treating data infrastructure as a software product built from reusable... 
    Night shift

    Harvey

    San Francisco, CA
    4 days ago
  • $165k - $185k

     ...more, go to THE ROLE ~ As a Senior Data Platform Engineer, you will build and operate the data infrastructure that supports Zeta’s products, analytics,...  ...sessions. QUALIFICATIONS ~ 7+ years of software engineering experience. ~ Strong... 
    Full time
    Work at office

    Zeta Global

    San Francisco, CA
    5 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - Data Infrastructure. Be the first to apply!