Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, Big Data Storage

Full-time

Pinterest

About Pinterest:

Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.

Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the  flexibility to do your best work. Creating a career you love? It’s Possible.

At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI.

Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here .

We’re looking for a Staff Software Engineer to help build the next generation of Pinterest’s big data storage platform. You’ll work on some of the most exciting big data open source technologies — especially Apache Iceberg — at exabyte scale to power the data infrastructure that helps Pinners discover and do what they love.

As a Staff Software Engineer, you’ll serve as a technical leader and hands-on contributor, designing and building highly scalable storage systems for Pinterest’s data lake. You’ll partner closely with teams across data, ML/AI, analytics, and infrastructure to evolve our storage and metadata management capabilities, enabling efficient, reliable, and governed access to data at massive scale.

What you’ll do:


  • Design, implement, and optimize Pinterest’s exabyte-scale data lake storage platform.

  • Lead complex technical projects and initiatives for data lake storage and metadata management, driving them from architecture through execution.

  • Collaborate with stakeholders and partner teams across the organization to design storage and metadata layer technologies that unlock big data and ML/AI innovations.

  • Build storage capabilities that efficiently support large-scale ML/AI workloads, including high-throughput data access, schema evolution, and large-scale column backfills.

  • Shape the long-term technical direction for scalable, reliable, and efficient big data storage systems.

  • Engage with and contribute to open source communities such as Apache Iceberg, Spark, and Flink to help address Pinterest’s scaling challenges.

What we’re looking for:


  • 8+ years of relevant industry experience designing and building large-scale production distributed systems.

  • Strong experience designing and maintaining scalable storage, metadata, or data lake infrastructure.

  • Experience building storage capabilities for large-scale ML/AI or analytics workloads, including high-throughput data access, schema evolution, and large-scale column backfills.

  • Deep knowledge with building distributed systems, data storage systems, and production infrastructure.

  • Experience with big data technologies such as Apache Iceberg, Spark, Flink, Presto/Trino, Hive, or similar systems.

  • Proficiency in programming languages like Java, Scala, or Python.

  • Proven ability to lead complex technical initiatives and influence architecture across teams.

  • Strong collaboration, communication, and problem-solving skills, with a drive for technical excellence and innovation.

  • Bachelor’s degree in a relevant field such as Computer Science, or equivalent experience


In-Office Requirement Statement:


  • We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection.

  • This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. 

Relocation Statement:


  • This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.


#LI-HYBRID

#LI-AH2

Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, Big Data Storage in Palo Alto, CA vacancy
  • $180k - $220k

     ...Harness is the AI Software Delivery Platform company, led by technologist...  ...a talented and experienced Data Platform Engineer to join our team as the...  ...ingestion, processing, and storage. Collaborate with data...  ...Scala. ~ Experience with big data technologies such as BigQuery... 
    Big data
    Full time
    Local area
    Immediate start
    Flexible hours
    Shift work
    3 days per week

    Harness Inc.

    Mountain View, CA
    9 hours ago
  •  ...a high-growth, cloud-native data platform company committed to...  ...are seeking an outstanding Staff Software Engineer with a passion for large scale...  ...system, caching, storage engine and multi tenant capabilities...  ...following highly desired: ~ Big Data storage technologies... 
    Big data
    Full time

    Snowflake

    Menlo Park, CA
    9 hours ago
  • $175k - $287k

     ...model training, feature engineering and serving with...  ...algorithms, AI frameworks, data infra, compute software, and hardware to...  ...ensuring its most optimal storage in the Feature Store,...  ...possible. As a Staff Software Engineer,...  ...Distributed Serving and Big Data Communication... 
    Big data
    Full time
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    9 hours ago
  • $207k - $300k

     ...and controller.Manage flash storage management, controlling and tuning...  ....8 years of experience in software development.5 years of...  ...qualifications:Master’s degree or PhD in Engineering, Computer Science, or a...  ...system design, networking and data storage, security, artificial... 
    Suggested

    Google

    Mountain View, CA
    14 days ago
  • $202.5k - $274k

     ...and execute on web, mobile, and front end software developmentProvides technical direction...  ...AI technologyCoach and mentor junior engineers on best practices of software engineering...  ...technologies (if no practical work experience w/ Big Data, or cutting edge front-end technology—... 
    Big data
    Work experience placement
    Worldwide

    Intuit

    Mountain View, CA
    18 days ago
  •  ...how we use AI in our recruiting process here . We’re looking for a senior staff software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting big... 
    Big data
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    Palo Alto, CA
    27 days ago
  •  ...that will set the standards for software-defined vehicles around the...  ...Role Summary The Vehicle Data Services team is seeking passionate and skilled Staff Software Engineers to lead and support our Cloud...  ...of Redis for caching, session storage, or distributed data... 
    Full time
    Contract work
    Local area

    Rivian and Volkswagen Group Technologies

    Palo Alto, CA
    9 hours ago
  •  ...transformation. About the Role We're hiring a Staff Software Engineer to own Commure's data warehouse platform end-to-end. You'll design, build, and...  ...high fidelity. Architect the data lake on object storage using an open table format (Iceberg, Delta Lake, or Hudi... 
    Full time
    Work at office
    Immediate start

    Commure

    Mountain View, CA
    9 hours ago
  •  ...transformation. About the Role The Data Integrations team owns the systems that...  ...endpoints. The domain is EMRs, but the engineering problem is distributed systems at scale...  ...grows. We're looking for a Staff Software Engineer to set technical direction for... 
    Full time
    Work at office
    Immediate start

    Commure

    Mountain View, CA
    9 hours ago
  • $192k - $260k

     ...obsessed with enabling data teams to solve the world...  ...in the world. Our engineering teams build highly technical...  ...of the largest scale software platforms. The fleet consists...  ...powering all the big data and machine learning...  ...machines. Data Plane Storage Deliver reliable and... 
    Big data
    Work at office
    Local area
    Worldwide
    Flexible hours

    Databricks

    Mountain View, CA
    6 days ago
  • $200k

     ...We are looking for people with strong Backend Data Engineering capabilities to build highly efficient, resilient systems & pipelines for large-scale data processing. You’ll be part of Luma’s applied research team and work directly on mission critical work-streams utilizing... 
    Full time
    Work experience placement

    Luma Ai

    Palo Alto, CA
    9 hours ago
  • $239k - $359k

     ...exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking, grow along...  ...and leave your mark, come join us. THE ROLE As a Staff Software Engineer in the Hyperscale Build Infrastructure team, you will be responsible... 
    Full time
    Work at office
    Flexible hours

    Pure Storage

    Santa Clara, CA
    9 hours ago
  •  ...Big Data EngineerHeadquartered in New Jersey (U.S), Cygnus Professionals Inc. is a next...  ...contact details and rate part.Role: Big Data Engineer w/SparkLocation: Palo Alto, CADuration:...  ...large scale applications using various software design patterns and OO design principles... 
    Big data
    Contract work
    Immediate start

    Cygnus Professionals

    Palo Alto, CA
    1 day ago
  •  ...About the Team Data Platform at OpenAI owns the foundational...  ...Airflow; and support ML feature engineering tooling such as Chronon. Our...  ...supports massive compute fleets and storage systems, designed for high...  .... You will scale and harden big data compute and storage platforms... 
    Big data
    Work at office
    Relocation package

    OpenAI

    Mountain View, CA
    9 hours ago
  •  ...Data Platform Engineer The Digital Media Solutions Lab at Samsung Research America is building a...  ...candidate should be adept at enterprise software development using large-scale distributed...  ...Requirements: Broad knowledge of big data technology landscape (Hadoop,... 
    Big data

    Omega Solutions Inc

    Mountain View, CA
    2 days ago
  • $155k - $185k

     ...are looking for an experienced Software Engineer with a passion for building robust and scalable data infrastructure to join our Data...  ...data movement, processing, and storage Scale data infrastructure to...  ...experience with streaming and big data processing frameworks (e.g... 
    Big data
    Permanent employment

    Otter.ai

    Mountain View, CA
    4 days ago
  • $207k - $300k

     ...customer base.Reimagine our data storage tiers, indexing mechanisms, and...  ...by partnering across engineering and product to enhance core BigQuery...  ...experience.8 years of experience in software development. 5 years of...  ...large-scale cloud computing, big data, and AI, we help our... 
    Big data

    Google

    Sunnyvale, CA
    2 days ago
  • $193.93k - $352.29k

     ...Fidelity, T. Rowe Price, and other leading investors. About the Role We are looking for a Senior/Staff Software Engineer to serve as a technical leader for Nuro's ML Data engine. You will sit at the critical intersection of Autonomy, Machine Learning, and... 
    Immediate start
    Flexible hours
    Shift work

    Nuro

    Mountain View, CA
    18 days ago
  • $207k - $300k

     ...development, and maintenance of large-scale software solutions, including kernel storage stacks, Linux drivers, firmware,...  ..., and mentor a distributed team of engineers while managing project priorities,...  ...field.8 years of experience with data structures and algorithms.3 years... 
    Worldwide

    Google

    Sunnyvale, CA
    19 days ago
  •  ...Description Description: TSW Core is looking for a highly motivated Data Engineer. In this role, you will be responsible for designing and...  ...for both real-time and batch data processing in the big data domain, promoting their adoption in various business use cases... 
    Big data

    TSW Core LLC

    Palo Alto, CA
    26 days ago
  • $70 - $95 per hour

     ...Job Description Job Description Data Engineer The Cloud services group is looking for world class engineers to join our...  ...platforms and infrastructure. Looking for world class server software engineers with Big Data Infrastructure and Data warehousing experience to... 
    Big data
    Hourly pay

    Cypress HCM

    Mountain View, CA
    24 days ago
  • $175k - $221k

     ...If you're inspired to dream big, innovate fast, and make a difference...  ...ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch...  ...resource scheduling, and tiered storage strategies. Raise the platform... 
    Big data
    Full time
    Local area
    Work from home

    NewsBreak

    Mountain View, CA
    18 days ago
  • $143k - $286k

     ...PermanentCompany: Walmartwe are seeking a Staff Software Engineer to design and build enterprise-scale...  ...observabilityPartner with product, UX, data, and platform teamsMentor engineers and...  ...scale platform experienceExperience with Big Data technologies (Spark, Hadoop, Flink... 
    Big data
    Full time
    Temporary work
    Part time
    Visa sponsorship

    Walmart

    Sunnyvale, CA
    a month ago
  • Data Pipeline Engineer ByteDance is a technology company operating a range of content platforms that inform, educate, entertain and inspire people...  ...Administration, etc. Taking advantage of cutting-edge big data and AI technologies, we are aiming at building a more automated... 
    Big data

    Adapt Talent

    Mountain View, CA
    6 days ago
  • $202.5k - $274k

     ...OverviewCome join the QuickBooks Capital and Lending Platform as a Staff Software Engineer in Data. You will join an innovative and passionate team of...  ...like Python, PySpark, Spark, SQL, Data Bricks, Big Data fundamentals, AWS, Elastic Search, Kafka, to build enterprise... 
    Big data
    Worldwide

    Intuit

    Mountain View, CA
    a month ago
  • Sr. Data Engineer Mountain View, CA / Denver, CO / Remote Full-Time Position Summary: We are looking for a...  ...analytics, and databases Data ingestion, ETL and storage Interest in pulling data from many sources Experience in big data, data mining and statistical analysis... 
    Big data
    Full time
    Remote work

    1872 Consulting

    Mountain View, CA
    6 days ago
  • $143k - $286k

     ...yearType: Full time / Regular/PermanentCompany: WalmartBusiness Segment: Home OfficeWe are in search of a Staff Software Engineer possessing strong expertise in Big Data technologies to be a part of our Search Indexing Platform team. This role is hands-on and demands... 
    Big data
    Permanent employment
    Full time
    Temporary work
    Part time
    Worldwide
    Flexible hours

    Walmart

    Sunnyvale, CA
    28 days ago
  • $83.98 - $111.27 per hour

     ...Health Care is seeking a dynamic and experienced Senior Manager of Data Engineering to lead our data engineering teams. This role is critical to...  ..., Snowflake, BigQuery, Redshift). Proficiency with big data technologies (e.g., Spark, Kafka) and workflow orchestration... 
    Big data
    Hourly pay
    Full time

    Stanford Health Care

    Palo Alto, CA
    2 days ago
  • $207k - $300k

     ...planning, and tool use.Develop end-to-end data flywheel on agent evalset curation, and...  ...'s degree in Computer Science or Engineering, or equivalent practical experience.Experience...  ...the intelligence of our prototypes. As a Software Engineer, you will be working with the... 

    Google

    Mountain View, CA
    14 days ago
  • $175k - $200k

     ...Bank is looking for a motivated Senior Data Engineer to contribute towards the success of our...  ...Spark Experience in NoSQL Databases and Big data technologies including Azure CosmosDB...  ...Experience working with different data storage options including ADSLS Gen2 and Azure... 
    Big data
    Work experience placement

    East West Bancorp, Inc.

    Palo Alto, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, Big Data Storage. Be the first to apply!