Staff Software Engineer, Big Data Storage
About Pinterest:
Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.
Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible.
At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI.
Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here .
We’re looking for a Staff Software Engineer to help build the next generation of Pinterest’s big data storage platform. You’ll work on some of the most exciting big data open source technologies — especially Apache Iceberg — at exabyte scale to power the data infrastructure that helps Pinners discover and do what they love.
As a Staff Software Engineer, you’ll serve as a technical leader and hands-on contributor, designing and building highly scalable storage systems for Pinterest’s data lake. You’ll partner closely with teams across data, ML/AI, analytics, and infrastructure to evolve our storage and metadata management capabilities, enabling efficient, reliable, and governed access to data at massive scale.
What you’ll do:
- Design, implement, and optimize Pinterest’s exabyte-scale data lake storage platform.
- Lead complex technical projects and initiatives for data lake storage and metadata management, driving them from architecture through execution.
- Collaborate with stakeholders and partner teams across the organization to design storage and metadata layer technologies that unlock big data and ML/AI innovations.
- Build storage capabilities that efficiently support large-scale ML/AI workloads, including high-throughput data access, schema evolution, and large-scale column backfills.
- Shape the long-term technical direction for scalable, reliable, and efficient big data storage systems.
- Engage with and contribute to open source communities such as Apache Iceberg, Spark, and Flink to help address Pinterest’s scaling challenges.
What we’re looking for:
- 8+ years of relevant industry experience designing and building large-scale production distributed systems.
- Strong experience designing and maintaining scalable storage, metadata, or data lake infrastructure.
- Experience building storage capabilities for large-scale ML/AI or analytics workloads, including high-throughput data access, schema evolution, and large-scale column backfills.
- Deep knowledge with building distributed systems, data storage systems, and production infrastructure.
- Experience with big data technologies such as Apache Iceberg, Spark, Flink, Presto/Trino, Hive, or similar systems.
- Proficiency in programming languages like Java, Scala, or Python.
- Proven ability to lead complex technical initiatives and influence architecture across teams.
- Strong collaboration, communication, and problem-solving skills, with a drive for technical excellence and innovation.
- Bachelor’s degree in a relevant field such as Computer Science, or equivalent experience
In-Office Requirement Statement:
- We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection.
- This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country.
Relocation Statement:
- This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.
#LI-HYBRID
#LI-AH2
$180k - $220k
...Harness is the AI Software Delivery Platform company, led by technologist... ...a talented and experienced Data Platform Engineer to join our team as the... ...ingestion, processing, and storage. Collaborate with data... ...Scala. ~ Experience with big data technologies such as BigQuery...Big dataFull timeLocal areaImmediate startFlexible hoursShift work3 days per week- ...a high-growth, cloud-native data platform company committed to... ...are seeking an outstanding Staff Software Engineer with a passion for large scale... ...system, caching, storage engine and multi tenant capabilities... ...following highly desired: ~ Big Data storage technologies...Big dataFull time
$175k - $287k
...model training, feature engineering and serving with... ...algorithms, AI frameworks, data infra, compute software, and hardware to... ...ensuring its most optimal storage in the Feature Store,... ...possible. As a Staff Software Engineer,... ...Distributed Serving and Big Data Communication...Big dataFull timeFor contractorsWork experience placementWork at officeFlexible hours$207k - $300k
...and controller.Manage flash storage management, controlling and tuning... ....8 years of experience in software development.5 years of... ...qualifications:Master’s degree or PhD in Engineering, Computer Science, or a... ...system design, networking and data storage, security, artificial...Suggested$202.5k - $274k
...and execute on web, mobile, and front end software developmentProvides technical direction... ...AI technologyCoach and mentor junior engineers on best practices of software engineering... ...technologies (if no practical work experience w/ Big Data, or cutting edge front-end technology—...Big dataWork experience placementWorldwide- ...how we use AI in our recruiting process here . We’re looking for a senior staff software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting big...Big dataFull timeWork at officeRemote workRelocationRelocation package
- ...that will set the standards for software-defined vehicles around the... ...Role Summary The Vehicle Data Services team is seeking passionate and skilled Staff Software Engineers to lead and support our Cloud... ...of Redis for caching, session storage, or distributed data...Full timeContract workLocal area
- ...transformation. About the Role We're hiring a Staff Software Engineer to own Commure's data warehouse platform end-to-end. You'll design, build, and... ...high fidelity. Architect the data lake on object storage using an open table format (Iceberg, Delta Lake, or Hudi...Full timeWork at officeImmediate start
- ...transformation. About the Role The Data Integrations team owns the systems that... ...endpoints. The domain is EMRs, but the engineering problem is distributed systems at scale... ...grows. We're looking for a Staff Software Engineer to set technical direction for...Full timeWork at officeImmediate start
$192k - $260k
...obsessed with enabling data teams to solve the world... ...in the world. Our engineering teams build highly technical... ...of the largest scale software platforms. The fleet consists... ...powering all the big data and machine learning... ...machines. Data Plane Storage Deliver reliable and...Big dataWork at officeLocal areaWorldwideFlexible hours$200k
...We are looking for people with strong Backend Data Engineering capabilities to build highly efficient, resilient systems & pipelines for large-scale data processing. You’ll be part of Luma’s applied research team and work directly on mission critical work-streams utilizing...Full timeWork experience placement$239k - $359k
...exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking, grow along... ...and leave your mark, come join us. THE ROLE As a Staff Software Engineer in the Hyperscale Build Infrastructure team, you will be responsible...Full timeWork at officeFlexible hours- ...Big Data EngineerHeadquartered in New Jersey (U.S), Cygnus Professionals Inc. is a next... ...contact details and rate part.Role: Big Data Engineer w/SparkLocation: Palo Alto, CADuration:... ...large scale applications using various software design patterns and OO design principles...Big dataContract workImmediate start
- ...About the Team Data Platform at OpenAI owns the foundational... ...Airflow; and support ML feature engineering tooling such as Chronon. Our... ...supports massive compute fleets and storage systems, designed for high... .... You will scale and harden big data compute and storage platforms...Big dataWork at officeRelocation package
- ...Data Platform Engineer The Digital Media Solutions Lab at Samsung Research America is building a... ...candidate should be adept at enterprise software development using large-scale distributed... ...Requirements: Broad knowledge of big data technology landscape (Hadoop,...Big data
$155k - $185k
...are looking for an experienced Software Engineer with a passion for building robust and scalable data infrastructure to join our Data... ...data movement, processing, and storage Scale data infrastructure to... ...experience with streaming and big data processing frameworks (e.g...Big dataPermanent employment$207k - $300k
...customer base.Reimagine our data storage tiers, indexing mechanisms, and... ...by partnering across engineering and product to enhance core BigQuery... ...experience.8 years of experience in software development. 5 years of... ...large-scale cloud computing, big data, and AI, we help our...Big data$193.93k - $352.29k
...Fidelity, T. Rowe Price, and other leading investors. About the Role We are looking for a Senior/Staff Software Engineer to serve as a technical leader for Nuro's ML Data engine. You will sit at the critical intersection of Autonomy, Machine Learning, and...Immediate startFlexible hoursShift work$207k - $300k
...development, and maintenance of large-scale software solutions, including kernel storage stacks, Linux drivers, firmware,... ..., and mentor a distributed team of engineers while managing project priorities,... ...field.8 years of experience with data structures and algorithms.3 years...Worldwide- ...Description Description: TSW Core is looking for a highly motivated Data Engineer. In this role, you will be responsible for designing and... ...for both real-time and batch data processing in the big data domain, promoting their adoption in various business use cases...Big data
$70 - $95 per hour
...Job Description Job Description Data Engineer The Cloud services group is looking for world class engineers to join our... ...platforms and infrastructure. Looking for world class server software engineers with Big Data Infrastructure and Data warehousing experience to...Big dataHourly pay$175k - $221k
...If you're inspired to dream big, innovate fast, and make a difference... ...ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch... ...resource scheduling, and tiered storage strategies. Raise the platform...Big dataFull timeLocal areaWork from home$143k - $286k
...PermanentCompany: Walmartwe are seeking a Staff Software Engineer to design and build enterprise-scale... ...observabilityPartner with product, UX, data, and platform teamsMentor engineers and... ...scale platform experienceExperience with Big Data technologies (Spark, Hadoop, Flink...Big dataFull timeTemporary workPart timeVisa sponsorship- Data Pipeline Engineer ByteDance is a technology company operating a range of content platforms that inform, educate, entertain and inspire people... ...Administration, etc. Taking advantage of cutting-edge big data and AI technologies, we are aiming at building a more automated...Big data
$202.5k - $274k
...OverviewCome join the QuickBooks Capital and Lending Platform as a Staff Software Engineer in Data. You will join an innovative and passionate team of... ...like Python, PySpark, Spark, SQL, Data Bricks, Big Data fundamentals, AWS, Elastic Search, Kafka, to build enterprise...Big dataWorldwide- Sr. Data Engineer Mountain View, CA / Denver, CO / Remote Full-Time Position Summary: We are looking for a... ...analytics, and databases Data ingestion, ETL and storage Interest in pulling data from many sources Experience in big data, data mining and statistical analysis...Big dataFull timeRemote work
$143k - $286k
...yearType: Full time / Regular/PermanentCompany: WalmartBusiness Segment: Home OfficeWe are in search of a Staff Software Engineer possessing strong expertise in Big Data technologies to be a part of our Search Indexing Platform team. This role is hands-on and demands...Big dataPermanent employmentFull timeTemporary workPart timeWorldwideFlexible hours$83.98 - $111.27 per hour
...Health Care is seeking a dynamic and experienced Senior Manager of Data Engineering to lead our data engineering teams. This role is critical to... ..., Snowflake, BigQuery, Redshift). Proficiency with big data technologies (e.g., Spark, Kafka) and workflow orchestration...Big dataHourly payFull time$207k - $300k
...planning, and tool use.Develop end-to-end data flywheel on agent evalset curation, and... ...'s degree in Computer Science or Engineering, or equivalent practical experience.Experience... ...the intelligence of our prototypes. As a Software Engineer, you will be working with the...$175k - $200k
...Bank is looking for a motivated Senior Data Engineer to contribute towards the success of our... ...Spark Experience in NoSQL Databases and Big data technologies including Azure CosmosDB... ...Experience working with different data storage options including ADSLS Gen2 and Azure...Big dataWork experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, Big Data Storage. Be the first to apply!
- aws data engineer Palo Alto, CA
- data engineer machine learning Palo Alto, CA
- data science developer Palo Alto, CA
- senior data engineer Palo Alto, CA
- finance data engineer Palo Alto, CA
- data engineer analytics Palo Alto, CA
- senior data integration developer Palo Alto, CA
- junior data engineer remote Palo Alto, CA
- data center engineer Palo Alto, CA
- data engineer Palo Alto, CA



