Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Engineer, Big Data Platform

$242.63k
Full-time

Pinterest

About Pinterest:

Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.

Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible.

At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI.

Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here.

We’re looking for a principal software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting big data and AI open source technologies (Flink, Spark, Kubernetes, etc.), at the scale of exabytes of data to help Pinners discover and do what they love.

What you’ll do:

  • Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications
  • Build and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shuffling
  • Work with internal customers on critical business use cases that rely on big data
  • Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scale
  • Contribute to the team’s technical vision and long-term roadmap

What we’re looking for:

  • 12+ years of industry experience with a proven track record of technical excellence
  • 8+ years of experience of building and support large scalable Kubernetes or big data platform
  • Deep knowledge of big data / ML technologies (e.g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow)
  • Proficiency in one or more programming languages (Java, Go, Scala, Python)
  • Experiences in Kubernetes and AWS technologies
  • Exceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress.
  • Bachelor’s degree in Computer Science, a related technical field, or equivalent experience.

In-Office Requirement Statement:

  • We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection.
  • This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country.

Relocation Statement:

  • This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.

#LI-REMOTE

#LI-CL5

At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise.

Information regarding the culture at Pinterest and benefits available for this position can be found here.

US based applicants only

$242,634—$499,541 USD

Our Commitment to Inclusion:

Pinterest is an equal opportunity employer and makes employment decisions on the basis of merit. We want to have the best qualified people in every job. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, national origin, religion or religious creed, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, age, marital status, status as a protected veteran, physical or mental disability, medical condition, genetic information or characteristics (or those of a family member) or any other consideration made unlawful by applicable federal, state or local laws. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you require a medical or religious accommodation during the job application process, please complete this form for support.

By submitting this application, I certify that all information submitted in my application and throughout the hiring process is true, accurate, and complete to the best of my knowledge. I understand that any false statement, omission, or misrepresentation may disqualify me from employment consideration or result in termination if discovered after hire.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal Engineer, Big Data Platform in San Francisco, CA vacancy
  • $144.9k - $168.4k

     ...we revolutionize how it works. Our AI-powered Demand Side Platform (DSP) connects the world's most ambitious marketers with...  ...future of digital advertising? We are seeking a Software Engineer to join our Big Data Services team. This role focuses on building, maintaining... 
    Platform
    Big data
    Full time
    Internship
    Work at office
    Relocation

    Quantcast

    San Francisco, CA
    10 hours ago
  • $170.4 per hour

     ...are passionate about enabling Data & AI teams to solve the world'...  ...best data and AI infrastructure platform so our customers can use deep...  ...their business. Founded by engineers, we leap at every opportunity...  ...Track: Expertise in large-scale big data solutions and ETL pipelines... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    10 hours ago
  •  ...Wirestock is one of the leading data platforms for ethically sourced multimodal data...  ...data. About the Role We're hiring a Principal Machine Learning Engineer to lead the data-science function powering...  ...and scalable evaluation models. Big Data Infrastructure: Execute... 
    Platform
    Big data
    Shift work

    Wirestock

    San Francisco, CA
    3 days ago
  •  ...Persona is the configurable identity platform built for businesses in a digital-...  ...We are looking for passionate engineers who are excited to build the data foundation for the identity layer of...  ...it. ~ Hands-on experience with big-data or streaming technologies such... 
    Platform
    Big data
    Full time
    For contractors
    Internship
    Immediate start

    Persona

    San Francisco, CA
    10 hours ago
  • $141.1k - $190.91k

     ...a rich and variety of science data. To keep up our innovation, Benchling...  ...scalable and extensible data platform that can serve both its...  ...of Benchling’s Data Platform engineers, you’ll join a rapidly growing...  ...customer-facing data warehouse. The Big Data Infrastructure team is... 
    Platform
    Big data
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Home office
    Flexible hours
    3 days per week

    Benchling

    San Francisco, CA
    10 hours ago
  • Wirestock is seeking a Principal Machine Learning Engineer in San Francisco to lead the data-science function powering our content platform. You will drive curation, QC, and enrichment of a petabyte-scale library using computer vision and AI, and shape data strategy with... 
    Platform
    Big data

    Wirestock

    San Francisco, CA
    4 days ago
  • $123.7k - $254.67k

     ...Millions of people around the world come to our platform to find creative ideas, dream about new...  ...marketers. We leverage massive data and cutting-edge science to automate and...  ...can trust to grow their business.As a Data Engineer at tvScientific, you will be a key player... 
    Platform
    Big data
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    10 hours ago
  • $162k - $216k

     ...everything from customer-facing software to the data platform that will power the next era of...  ...complex problems and creating impact for the engine of the American economy, you’ll love it...  ...Strong foundation in data analytics and big data technologies, with the ability to... 
    Platform
    Big data
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    3 days ago
  • $185k - $385k

    About the TeamData Platform at OpenAI owns the foundational data stack powering critical product, research, and analytics...  ...Airflow; and support ML feature engineering tooling such as Chronon. Our...  ...OpenAI. You will scale and harden big data compute and storage platforms... 
    Platform
    Big data
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  • $260k - $350k

     ...everything from customer-facing software to the data platform that will power the next era of...  ...complex problems and creating impact for the engine of the American economy, you’ll love it...  ...:Comprehensive knowledge of modern big data5+ years experience in software development... 
    Platform
    Big data
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    10 hours ago
  •  ...: Want to build robust and scalable data infrastructure to power data-driven City...  ...the data practice that sits around the platform—clear service offerings, consistent...  ...data quality standards. This role is the principal engineer leading that effort. You’ll own the department... 
    Platform
    Full time
    Traineeship
    Work experience placement
    Work at office

    City and County of San Francisco

    San Francisco, CA
    8 days ago
  •  ...Rippling.com addresses.About the Data Cloud TeamRippling Data Cloud...  ...the Employee Graph and all platform data (payroll rules, earnings...  ....Data Access - Owns the query engine (RQL, Rippling Query Language)...  ...MongoDB, CDC, and KafkaLeverage big data technologies like Aurora,... 
    Platform
    Big data
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    10 hours ago
  • About the TeamDoorDash is a data driven organization and relies on...  ...decisions. The Core Data Platform organization owns all the infrastructure...  ...simplify data workflows for engineers, analysts, and ML...  ...softwareExperience working on big data domains (streaming, batch... 
    Platform
    Big data
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    10 hours ago
  • $166k - $225k

     ...are passionate about enabling data teams to solve the world's toughest...  ...data and AI infrastructure platform so our customers can use deep...  ...their business. Founded by engineers — and customer obsessed — we leap...  ...source standard framework for big data.Data Plane Storage:... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $185k - $218k

     ...Senior Data Engineer Denver, Colorado, United States; San Francisco, California, United States Checkr is building the data platform to power safe and fair decisions. Over 140,000 companies and...  ...processing ~ Familiarity with big data technologies such as Kafka,... 
    Platform
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours
    3 days per week

    Checkr

    San Francisco, CA
    1 hour ago
  • $123.7k - $254.67k

     ...Millions of people around the world come to our platform to find creative ideas, dream about new...  ...marketers. We leverage massive data and cutting-edge science to automate and...  ...trust to grow their business. As a Data Engineer at tvScientific, you will be a key player... 
    Platform
    Big data
    Work at office
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    2 days ago
  •  ...unified payments and financial platform for global businesses. Powered...  ...at the heart of our company's data and AI strategy. We are...  ...a high level architect (staff engineer), you will oversee the strategy...  ...services, and client libraries for big data using tools like GCP, Databricks... 
    Platform
    Big data
    Work at office
    Worldwide

    Airwallex

    San Francisco, CA
    4 days ago
  • $228.6k - $317.23k

     ...Databricks, we are passionate about enabling data teams to solve the world's toughest...  ...world's best data and AI infrastructure platform so our customers can use deep data insights...  ...their business. We are the Lakeflow Engineering team, responsible for Databricks ETL product... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    4 days ago
  •  ...Senior Data EngineerSAN FRANCISCO, CA / ENGINEERING / FULL-TIMEWhat Will You Be Doing?Building fast, reliable, scalable...  ..., and helping architect our data platform and data warehouses to ensure that...  ...with Apache Spark or other Big Data frameworks; working with cloud... 
    Platform
    Big data
    Work experience placement

    1872 Consulting

    San Francisco, CA
    19 hours ago
  •  ...Zof AI is seeking a Senior Data Engineer to build the pipelines that turn raw agent runs, test results, and remediation outcomes...  ...have worked as an Analytics Engineer, ETL Developer, Big Data Engineer, or Data Platform Engineer, this is that discipline at Zof AI. The ideal... 
    Platform
    Big data
    Full time

    Zof AI

    San Francisco, CA
    4 days ago
  • We're looking for a Manager, Data Engineering with deep Big Data expertise to design, develop, and maintain scalable data pipelines and analytics...  ...data warehousing solutionsExperience with cloud-based data platforms such as AWS, GCP, or AzureStrong programming skills in... 
    Platform
    Big data
    Hourly pay
    Freelance

    Solomon Page

    San Francisco, CA
    3 days ago
  • $193.8k - $285k

    About the TeamDoorDash is a data driven organization and relies on timely, accurate and...  ...foundation of DoorDash success. The Data Engineering team builds database solutions for various...  .../Redshift, AWS/GCP, Hadoop/Spark/Big data, Lambda/KAPPA architectures, Flink/Airflow... 
    Big data
    Hourly pay
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    10 hours ago
  •  ...Big Data EngineerCA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco...  ...administering Hadoop or other Data Science and Analytics platforms using the technologies above• Experience with DevOps support•... 
    Platform
    Big data
    Work experience placement

    ClifyX

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...driven communication. If you're ready to own data strategy at a high-growth AI company,...  ...foundation of everything we build. As Senior Data Engineer , you won’t just clean datasets and...  ...internal data into insights – Our own platform is a goldmine of information. You’ll uncover... 
    Platform
    Big data
    Full time
    Remote work
    Flexible hours

    Gloo

    San Francisco, CA
    10 hours ago
  • $141.9k - $190.3k

    Job Posting Title:Sr Data EngineerReq ID:10153288Job Description:...  ...Technology is a global organization of engineers, product developers, designers...  ...and building the products and platforms that will power our media,...  ..., building ETL pipelines in Big Data environments (cloud, on-... 
    Platform
    Big data
    Full time
    Work experience placement

    Hulu

    San Francisco, CA
    4 days ago
  •  ...Lead Data Engineer - Job DescriptionResponsibilitiesDevelopment Tasks:Collect metrics based on user interactions.Visualize data...  ...years of experience in heavy volume data processing, data platform, data lake, big data, data warehouse, or equivalent.5+ years of experience... 
    Platform
    Big data

    My3Tech Inc

    San Francisco, CA
    21 hours ago
  • $172.5k - $260.1k

     ...Salesforce.About the TeamAt Slack, data isn't just infrastructure — it's the engine behind every great enterprise...  ...'s most widely used collaboration platforms.What You'll Be DoingTranslate complex...  ...S3, EMR), Apache Pinot, or Hadoop/Big Data ecosystemsExperience with Flink... 
    Platform
    Big data
    Permanent employment
    Full time

    Salesforce

    San Francisco, CA
    10 hours ago
  • Front is the customer operations platform built for B2B complexity,...  ...Startup Employers 2022 List.Front’s Data team builds the analytics...  ...We’re looking for a Staff Data Engineer to own critical parts of that...  ...datasetsWorking knowledge of at least one big data technology (HDFS, EMR,... 
    Platform
    Big data
    Work at office
    Immediate start
    Remote work
    Work from home
    Monday to Friday

    FrontApp

    San Francisco, CA
    10 hours ago
  • $116.2k - $229.1k

    Position Summary Join Deloitte’s AI & Engineering practice and help organizations transform enterprise technology platforms, modernize data environments, and unlock value through...  ...Lead: Evaluate, pilot, and integrate new big data and analytics technologies, ensuring... 
    Platform
    Big data
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    4 days ago
  •  ...Lead Data Engineer With MartechLocation: SFO, CA (Hybrid 2 days a week)Key ResponsibilitiesLead...  ...-grade tools. Develop high-performance big-data applications using Scala, Databricks...  ...& ExperienceDeep expertise in MarTech platforms with hands-on experience in Adobe Campaign... 
    Platform
    Big data
    2 days per week

    Georgia IT Inc

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Engineer, Big Data Platform. Be the first to apply!