Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - Data Infrastructure

Arena AI

Member Of Technical Staff - Data Infrastructure Software EngineerArena Intelligence is seeking a Member of Technical Staff - Data Infrastructure software engineer to join our team and build the data pipelines and infrastructure that powers real-world AI evaluation. You'll play a crucial role in designing and building the data pipelines that process and analyze tens of millions user vote data, directly impacting how we understand and evaluate AI model performance. This role is ideal for someone who thrives in fast-moving environments and interested in building products to ensure accurate and fair evaluation of human preferences across different models, which will shape the direction of future AI development.As an early member of our data engineering team, you'll partner closely with researchers, engineers, and product leadership to retrieve valuable data and insights from human votes and feedback. You'll help us move fast while staying rigorous, improving data quality, scaling our infrastructure to new levels, and deepening our ability to compare frontier models and predict human preferences.You'll:Design and build robust data pipelines to ingest, process, and transform user vote data to features essential for model performance evaluation.Collaborate with researchers and product leadership to understand product goals and necessary data.Design and implement solutions to generate result dashboards and reports, providing useful information for the public, model providers, and researchers.Ensure the integrity, data quality, and reliability of the pipelines.Scale our data infrastructure to accommodate increasing data volumes and evolving analytical needs.You'll have:5+ years of experience in software engineering, with a dedicated focus on data engineering and big data technologiesProficiency in SQL and at least one programming language commonly used for data analysis (Python (preferred), Scala, R).Hands-on experience with data processing and pipeline frameworks (Apache Spark, Ray Data, etc.) and at least one popular big data analytics platform (Databricks, Snowflake).Demonstrated experience in designing, implementing, optimizing, and debugging production data pipelines.Bonus points:Prior work in data analytics or datalake platforms.Experience in advanced data analysis tools, such as Delta lake, streaming tables.Exposure to machine learning is a plus.What we offer:We offer competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate's permanent work location.Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.The opportunity to work on cutting-edge AI with a small, mission-driven teamA culture that values transparency, trust, and community impactCome help build the space where anyone can explore and help shape the future of AI.Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer - Data Infrastructure in San Francisco, CA vacancy
  •  ...Role As a Data Infrastructure Software Engineer working at OpenEvidence, you will build end-to-end systems powering critical product and research workflows. Your work will focus on performance, scalability, and accuracy, granting you full autonomy over the infrastructure... 
    Suggested
    Full time

    Open Evidence

    San Francisco, CA
    23 hours ago
  • $160k - $220k

     ...turns siloed and disconnected data into operational...  ...internationally.  Team As an engineering team, we believe strongly that...  ...We are looking for a Data Infrastructure Engineer to join our growing...  ...or similar tools ~ Strong software engineering fundamentals in... 
    Suggested
    Full time
    Work at office
    Local area

    Peregrine Technologies, Llc

    San Francisco, CA
    23 hours ago
  • $190k - $240k

     ...About the role You will build the infrastructure that turns physical operation into...  ...training and evaluation. This is a senior software engineering role responsible for the systems after...  ...rather than becoming ungoverned data volume. What you will do Build... 
    Suggested
    Full time
    Contract work

    Galactic Resource Advancement Mechanism

    San Francisco, CA
    23 hours ago
  • $140k - $200k

     ...include frontend and backend engineers, AI research scientists, and...  ...'re looking to hire for our Data side of our AI team at...  ...through a tight integration of infrastructure, engineering, and research work...  ...are looking for a skilled Software Engineer to join us. What You... 
    Suggested
    Remote job
    Full time
    Work at office
    Shift work

    Speechify

    San Francisco, CA
    23 hours ago
  • $266k

     ...Platform at OpenAI owns the foundational data stack powering critical product,...  ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is...  ..., and analytics.We’re not just scaling infrastructure - we’re redefining how people interact... 
    Suggested
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  • $153k - $376k

     ...of design and collaboration, join us!The Data Platform team at Figma builds and...  ...including AI researchers, machine learning engineers, data scientists, product engineers, and...  ...ML Datalake, orchestration and pipeline infrastructure, and large-scale data ingestion and processing... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    San Francisco, CA
    4 days ago
  •  ...team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to...  ...the lifeblood of our models, and we are looking for a TLM, Data Infrastructure to own the strategy and execution for all data at Cartesia.... 
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia, Inc.

    San Francisco, CA
    3 days ago
  •  ...assembled a world-class team with deep infrastructure and payments DNA to build the operating...  ...for machines. Our founder ran payments engineering at Shopify for five years and built an...  ...infrastructure role at a company where the data layer isn't a back-office function - it... 

    Sapiom, Inc

    San Francisco, CA
    2 days ago
  • $162k - $216k

     ...economy.We design and ship category-defining software that enables Ryder and its 50,000+...  ...everything from customer-facing software to the data platform that will power the next era of...  ...problems and creating impact for the engine of the American economy, you’ll love it here... 
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    2 days ago
  • $7.5k

     ...benefits packages, technology talks by our experts, a beautiful modern office, daily catered lunches, and more.As a Software Engineer on our Data Infrastructure team, you will contribute to scaling and advancing our entire data infrastructure. This includes building data-... 
    Work at office
    Local area

    The Voleon Group

    Berkeley, CA
    3 days ago
  • $257k - $386k

     ...in building the best creator platform with the best team in the creator economy and are looking for a Senior/Staff Software Engineer, Data Infrastructure to support our mission.This role is remote, with optional in-person attendance in either the New York or San Francisco... 
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    2 days per week

    Patreon

    San Francisco, CA
    23 hours ago
  •  ...London and Amsterdam.Making data driven decisions is key to Plaid...  ...guidance to teams across engineering, product, and business and...  ...effectively.Engineers on Data Infrastructure are domain experts in Data...  ...changes.Qualifications6+ years of software engineering... 
    Work experience placement
    Local area

    Plaid Financial

    San Francisco, CA
    23 hours ago
  • $130.6k - $192k

     ...reliable on-demand, logistics engine for delivery! We're looking...  ...help us develop a 24x7, global infrastructure system that powers DoorDash's...  .... About the Team Data Platform’s Data User Experience...  ...years of industry experience in software engineering ~ Strong backend... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    23 hours ago
  •  ...Omni Omni is the AI analytics platform that turns company data into a trusted source of truth for AI. Built on a...  ...experience building data platforms, backend systems, workflow engines, or data / ML infrastructure ~ Deep experience with analytical data systems such as... 
    Full time

    Omni

    San Francisco, CA
    23 hours ago
  • $192k - $240k

     ...management, bill pay, and travel software, Brex enables founders and...  ...to grow your career. Engineering at Brex Engineering at Brex...  .... Our teams span Software, Data, Security, and IT, and operate...  ...data, query, and search infrastructure that powers critical Brex product... 
    Full time
    Work at office
    Remote work
    Work from home

    Brex Inc.

    San Francisco, CA
    23 hours ago
  •  ...We are looking for passionate engineers who are excited to build the data foundation for the identity layer...  ...of engineering, data science, and infrastructure to make the platform fast, reliable...  ...Persona ~5+ years of experience in software engineering, with deep expertise... 
    Full time
    For contractors
    Internship
    Immediate start

    Persona

    San Francisco, CA
    23 hours ago
  • $196k - $261k

     ...can build in Notion. The Data Product Platform team is responsible...  ...’ll join a team of talented engineers in our mission to build the...  .... Notion’s platforms and infrastructure are vital to enabling our...  ...that own a wide swath of software platforms (hosted or built in... 
    Full time
    Temporary work
    Local area

    Notion

    San Francisco, CA
    23 hours ago
  • $192k - $240k

     ...management, bill pay, and travel software, Brex enables founders and finance...  ...support you need to grow your career.Data at BrexOur Scientists and Engineers work together to make data — and...  ...numbers. The Data team at Brex develops infrastructure, statistical models, and products... 
    Work at office
    3 days per week

    Brex

    San Francisco, CA
    3 days ago
  • $130k - $200k

    About Vercel:Vercel is the agentic infrastructure company. We free people and agents to ship...  ...developer experience.Now, software is entering a new era, and the next generation...  ....About the RoleWe're looking for a Data Platform Engineer to join our Data Engineering team and... 
    Work from home
    Worldwide
    Flexible hours

    Vercel

    San Francisco, CA
    2 days ago
  • About the TeamDoorDash is a data driven organization and relies...  ...organization owns all the infrastructure necessary to run an operationally...  ...simplify data workflows for engineers, analysts, and ML...  ...Codex, Cursor) in the full software development lifecycle, including... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    2 days ago
  •  ...has the financial tools they need.About the Position:We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of our next-generation Data Platform. This role is critical to ensuring that our data infrastructure is... 
    Flexible hours

    Parafin

    San Francisco, CA
    2 days ago
  • $165.2k - $223.6k

     ...listening platforms, and a flexible infrastructure to continuously enhance...  ...Development Engineers on the ART19 team are end-to...  ...designing, developing and deploying software solutions while holding a high...  ...Experience building scalable data pipelines and analytics platforms... 
    Internship
    Local area
    Flexible hours

    Amazon

    San Francisco, CA
    18 hours ago
  •  ...Rippling.com addresses.About the Data Cloud TeamRippling Data Cloud...  .... Data Cloud is the data infrastructure layer that powers Rippling AI...  ...Data Access - Owns the query engine (RQL, Rippling Query Language...  ...databasesDevelop high-quality software with attention to detail... 
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    2 days ago
  • $260k - $350k

     ...design and ship category-defining software that enables Ryder and its 50...  ...-facing software to the data platform that will power the...  ...and creating impact for the engine of the American economy, you’...  ...streaming pipelines, optimize cloud infrastructure, and champion best practices... 
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    2 days ago
  •  ...Whatnot updates on our news and engineering blogs and join us as we...  ...together through commerce.RoleThe Data Platform team at Whatnot...  ..., multi-tenant streaming infrastructure rather than simply building...  ...understandingYouAs our next Software Engineer, Data Platform, you... 
    Local area
    Remote work
    Home office

    Whatnot

    San Francisco, CA
    3 days ago
  • $10k

     ...About RampRamp is building the smart infrastructure for finance teams, embedded in the transaction...  ...books.The problems are high-stakes, data-dense, and unforgiving.We hire people with...  ...'ll partner with applied scientists, AI engineers, Risk engineers, and other ML developers... 
    Full time
    Work at office
    Home office
    Flexible hours

    Paribus (Ramp)

    San Francisco, CA
    3 days ago
  • $211k - $251k

     ...strong depth in either platform engineering or product engineering....  ...built, and run large-scale data systems processing terabytes...  ...bring 4-7+ years of hands-on software development experience building...  ...you own real-time event infrastructure, streaming and batch ETL pipelines... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    1 day ago
  •  ...You’ll join a full-stack data team building the systems making...  ...our real-time eventing infrastructure, streaming and batch ETL pipelines...  ...of these areas: Platform Engineering You have designed, built,...  ...Shared Qualities Strong software engineering background with... 
    Full time
    Flexible hours
    San Francisco, CA
    1 day ago
  •  ..., join us, and build real world value. As a Senior Software Engineer on the Data Engineering team, you are a core builder of the Caspian...  ...into more complex ownership. Contribute to platform infrastructure through Terraform, and work with Unity Catalog to establish... 
    Full time

    Ripple

    San Francisco, CA
    23 hours ago
  •  ...human preferences — the Human Data team is at the heart of that effort. The Human Data engineering team creates the systems...  ...the Role We’re looking for software engineers to join the Human...  ...platforms, prototypes, tools, and infrastructure that power how our AI models... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - Data Infrastructure. Be the first to apply!