Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Engineer, Big Data Platform

Full-time

Pinterest

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . We’re looking for a principal software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting big data and AI open source technologies (Flink, Spark, Kubernetes, etc. ), at the scale of exabytes of data to help Pinners discover and do what they love. What you’ll do: - Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications - Build and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shuffling - Work with internal customers on critical business use cases that rely on big data - Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scale - Contribute to the team’s technical vision and long-term roadmap What we’re looking for: - 12+ years of industry experience with a proven track record of technical excellence - 8+ years of experience of building and support large scalable Kubernetes or big data platform - Deep knowledge of big data / ML technologies (e.

g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow) - Proficiency in one or more programming languages (Java, Go, Scala, Python) - Experiences in Kubernetes and AWS technologies - Exceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress. - Bachelor’s degree in Computer Science, a related technical field, or equivalent experience. In-Office Requirement Statement: - We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection. - This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. Relocation Statement: - This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model. #LI-REMOTE #LI-CL5 At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise. Information regarding the culture at Pinterest and benefits available for this position can be found here .

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal Engineer, Big Data Platform in San Francisco, CA vacancy
  • $242.63k

     ...people around the world come to our platform to find creative ideas, dream...  ...process here.We’re looking for a principal software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll... 
    Platform
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    2 days ago
  •  ...About the Role Join a startup building an agentic data lakehouse platform. As a Senior Software Engineer, Distributed Data Systems, you'll work on a greenfield...  ..., or platform engineer ~ Experience with big data systems (Apache Spark, Hadoop) ~ Strong background... 
    Platform
    Big data
    Full time

    Clera

    San Francisco, CA
    19 hours ago
  •  ...around the world come to our platform to find creative ideas, dream...  ...Mission The Privacy & Conversion Data team is responsible for how...  ...We’re seeking a Staff Engineer to lead the architecture and technical...  ...SQL; experience with modern big data ecosystems is a plus. ~... 
    Platform
    Big data
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    19 hours ago
  • $170.4 per hour

     ...are passionate about enabling Data & AI teams to solve the world'...  ...best data and AI infrastructure platform so our customers can use deep...  ...their business. Founded by engineers, we leap at every opportunity...  ...Track: Expertise in large-scale big data solutions and ETL pipelines... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  •  ...Persona is the configurable identity platform built for businesses in a digital-...  ...We are looking for passionate engineers who are excited to build the data foundation for the identity layer of...  ...it. ~ Hands-on experience with big-data or streaming technologies such... 
    Platform
    Big data
    Full time
    For contractors
    Internship
    Immediate start

    Persona

    San Francisco, CA
    19 hours ago
  • $123.7k - $254.67k

     ...Millions of people around the world come to our platform to find creative ideas, dream about new...  ...marketers. We leverage massive data and cutting-edge science to automate and...  ...can trust to grow their business.As a Data Engineer at tvScientific, you will be a key player... 
    Platform
    Big data
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    3 days ago
  • $162k - $216k

     ...everything from customer-facing software to the data platform that will power the next era of...  ...complex problems and creating impact for the engine of the American economy, you’ll love it...  ...Strong foundation in data analytics and big data technologies, with the ability to... 
    Platform
    Big data
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    3 days ago
  •  ...Member Of Technical Staff - Data Infrastructure Software EngineerArena...  ...Data Infrastructure software engineer to join our team and build the...  ...focus on data engineering and big data technologiesProficiency...  ...popular big data analytics platform (Databricks, Snowflake).Demonstrated... 
    Platform
    Big data
    Permanent employment

    Arena AI

    San Francisco, CA
    2 days ago
  • $266k

    About the TeamData Platform at OpenAI owns the foundational data stack powering critical product, research, and analytics...  ...Airflow; and support ML feature engineering tooling such as Chronon. Our...  ...OpenAI. You will scale and harden big data compute and storage platforms... 
    Platform
    Big data
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    2 days ago
  • $185k - $218k

    About CheckrCheckr is building the data platform to power safe and fair decisions. Over 140,00...  ...every Checkr product. As a Senior Data Engineer, you'll lead the execution of core services...  ..., and stream processingFamiliarity with big data technologies such as Kafka, Spark,... 
    Platform
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    2 days ago
  • $260k - $350k

     ...everything from customer-facing software to the data platform that will power the next era of...  ...complex problems and creating impact for the engine of the American economy, you’ll love it...  ...:Comprehensive knowledge of modern big data5+ years experience in software development... 
    Platform
    Big data
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    3 days ago
  •  ...Rippling.com addresses.About the Data Cloud TeamRippling Data Cloud...  ...the Employee Graph and all platform data (payroll rules, earnings...  ....Data Access - Owns the query engine (RQL, Rippling Query Language)...  ...MongoDB, CDC, and KafkaLeverage big data technologies like Aurora,... 
    Platform
    Big data
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    3 days ago
  • About the TeamDoorDash is a data driven organization and relies on...  ...decisions. The Core Data Platform organization owns all the infrastructure...  ...simplify data workflows for engineers, analysts, and ML...  ...softwareExperience working on big data domains (streaming, batch... 
    Platform
    Big data
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    3 days ago
  •  ...: Want to build robust and scalable data infrastructure to power data-driven City...  ...the data practice that sits around the platform—clear service offerings, consistent...  ...data quality standards. This role is the principal engineer leading that effort. You’ll own the department... 
    Platform
    Full time
    Traineeship
    Work experience placement
    Work at office

    City and County of San Francisco

    San Francisco, CA
    16 days ago
  • $166k - $225k

     ...are passionate about enabling data teams to solve the world's toughest...  ...data and AI infrastructure platform so our customers can use deep...  ...their business. Founded by engineers — and customer obsessed — we leap...  ...source standard framework for big data.Data Plane Storage:... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    4 days ago
  • $185k - $218k

     ...Senior Data EngineerDenver, Colorado, United States; San Francisco...  ...is building the data platform to power safe and fair decisions...  ...Checkr product.As a Senior Data Engineer, you'll lead the execution of...  ...stream processingFamiliarity with big data technologies such as Kafka... 
    Platform
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    2 days ago
  • $180k - $250k

     ...slowing the deployment of the data centers that will power the next...  ...the energy intelligence platform for the AI economy. Our software...  ...Verse. This role supports Core Engineering needs within the organization...  ...Intimate knowledge of scaling "big data" solutions in cloud-based... 
    Platform
    Big data
    Remote work
    Flexible hours

    Verse

    San Francisco, CA
    8 days ago
  • $228.6k - $317.23k

     ...Databricks, we are passionate about enabling data teams to solve the world's toughest...  ...world's best data and AI infrastructure platform so our customers can use deep data insights...  ...their business. We are the Lakeflow Engineering team, responsible for Databricks ETL product... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  • We're looking for a Manager, Data Engineering with deep Big Data expertise to design, develop, and maintain scalable data pipelines and analytics...  ...data warehousing solutionsExperience with cloud-based data platforms such as AWS, GCP, or AzureStrong programming skills in... 
    Platform
    Big data
    Hourly pay
    Freelance

    Solomon Page

    San Francisco, CA
    1 day ago
  • $141.9k - $190.3k

    Job Posting Title:Sr Data EngineerReq ID:10153288Job Description:...  ...Technology is a global organization of engineers, product developers, designers...  ...and building the products and platforms that will power our media,...  ..., building ETL pipelines in Big Data environments (cloud, on-... 
    Platform
    Big data
    Full time
    Work experience placement

    Hulu

    San Francisco, CA
    2 days ago
  • $160k - $175k

     ...Data EngineerGridware is a San Francisco-based technology company...  ...advanced Active Grid Response platform uses high-precision sensors to...  ...investors.Role OverviewAs a Data Engineer at Gridware, you'll help build...  ..., Lakehouse platforms, or big data tools (Databricks, Spark,... 
    Platform
    Big data
    Local area

    Gridware

    San Francisco, CA
    2 days ago
  • $193.8k - $285k

    About the TeamDoorDash is a data driven organization and relies on timely, accurate and...  ...foundation of DoorDash success. The Data Engineering team builds database solutions for various...  .../Redshift, AWS/GCP, Hadoop/Spark/Big data, Lambda/KAPPA architectures, Flink/Airflow... 
    Big data
    Hourly pay
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    3 days ago
  •  ...The Data Engineer will be responsible for collecting, parsing, managing, analyzing, and visualizing...  ...secure data pipelines across various platforms. The engineer will ensure that data...  ...engineering experience across traditional ETL and Big Data (on‑prem or cloud). ~ Experience... 
    Platform
    Big data

    Compunnel

    San Francisco, CA
    19 hours ago
  •  ...Data EngineerLocation: San Francisco, CARequired Clearance: SecretSalary...  ...looking for a skilled Data Engineer with a strong focus on AI and...  ...data infrastructure on cloud platforms (e.g., AWS, Google Cloud,...  ...Java, or SQL.Experience with big data technologies and frameworks... 
    Platform
    Big data

    Fullscope

    San Francisco, CA
    19 hours ago
  •  ...Lead Data Engineer With MarTechLocation: SFO, CA (Hybrid 2 days a week)Key ResponsibilitiesLead...  ...-grade tools. Develop high-performance big-data applications using Scala, Databricks...  ...& ExperienceDeep expertise in MarTech platforms with hands-on experience in Adobe Campaign... 
    Platform
    Big data
    2 days per week

    Staffing the Universe

    San Francisco, CA
    4 days ago
  •  ...Open role: Data Engineer (Full-time) Location: San Francisco, CA (On-site) As a Data Engineer...  ...pipelines and storage solutions that handle our platform's information. This role ensures that...  ...performance tuning. Familiarity with big data or NoSQL technologies (such as... 
    Platform
    Big data
    Full time

    Methodic

    San Francisco, CA
    4 days ago
  • $172.5k - $260.1k

     ...Salesforce.About the TeamAt Slack, data isn't just infrastructure — it's the engine behind every great enterprise...  ...'s most widely used collaboration platforms.What You'll Be DoingTranslate complex...  ...S3, EMR), Apache Pinot, or Hadoop/Big Data ecosystemsExperience with Flink... 
    Platform
    Big data
    Permanent employment
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  • $160k - $175k

     ...Data Engineer Gridware is a San Francisco-based technology company dedicated to protecting...  ...Gridware's advanced Active Grid Response platform uses high-precision sensors to detect potential...  ...warehouses, Lakehouse platforms, or big data tools (Databricks, Spark, or... 
    Platform
    Big data
    Local area

    Gridware

    San Francisco, CA
    1 day ago
  •  ...Sr Data EngineerDisney Entertainment and ESPN Product & TechnologyTechnology...  ...is a global organization of engineers, product developers, designers...  ...and building the products and platforms that will power our media,...  ..., including machine learning, big data, microservices, and data... 
    Platform
    Big data

    Disney

    San Francisco, CA
    1 day ago
  • $133.37k - $156.9k

     ...new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionU.S. Bank is seeking a motivated Chief Engineer with strong leadership abilities to contribute toward the success of our technology initiatives. Provides a combination of... 
    Platform
    Full time
    Work experience placement
    Local area
    3 days per week

    US Bank

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Engineer, Big Data Platform. Be the first to apply!