Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Engineer, Big Data Platform

Full-time

Pinterest

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . We’re looking for a principal software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting big data and AI open source technologies (Flink, Spark, Kubernetes, etc. ), at the scale of exabytes of data to help Pinners discover and do what they love. What you’ll do: - Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications - Build and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shuffling - Work with internal customers on critical business use cases that rely on big data - Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scale - Contribute to the team’s technical vision and long-term roadmap What we’re looking for: - 12+ years of industry experience with a proven track record of technical excellence - 8+ years of experience of building and support large scalable Kubernetes or big data platform - Deep knowledge of big data / ML technologies (e.

g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow) - Proficiency in one or more programming languages (Java, Go, Scala, Python) - Experiences in Kubernetes and AWS technologies - Exceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress. - Bachelor’s degree in Computer Science, a related technical field, or equivalent experience. In-Office Requirement Statement: - We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection. - This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. Relocation Statement: - This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model. #LI-REMOTE #LI-CL5 At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise. Information regarding the culture at Pinterest and benefits available for this position can be found here .

Vacancy posted 19 days ago
Similar jobs that could be interesting for youBased on the Principal Engineer, Big Data Platform in San Francisco, CA vacancy
  •  ...Millions of people around the world come to our platform to find creative ideas, dream about new...  ...marketers. We leverage massive data and cutting-edge science to automate and...  ...trust to grow their business.   As a Data Engineer at tvScientific, you will be a key player... 
    Platform
    Big data
    Full time

    Pinterest

    San Francisco, CA
    11 days ago
  • $170.4 per hour

     ...are passionate about enabling Data & AI teams to solve the world'...  ...best data and AI infrastructure platform so our customers can use deep...  ...their business. Founded by engineers, we leap at every opportunity...  ...Track: Expertise in large-scale big data solutions and ETL pipelines... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    a month ago
  • $180k - $250k

     ...slowing the deployment of the data centers that will power the next...  ...the energy intelligence platform for the AI economy. Our software...  ...Verse. This role supports Core Engineering needs within the organization...  ...Intimate knowledge of scaling "big data" solutions in cloud-based... 
    Platform
    Big data
    Remote work
    Flexible hours

    Verse

    San Francisco, CA
    18 days ago
  • $266k

    About the TeamData Platform at OpenAI owns the foundational data stack powering critical product, research, and analytics...  ...Airflow; and support ML feature engineering tooling such as Chronon. Our...  ...OpenAI. You will scale and harden big data compute and storage platforms... 
    Platform
    Big data
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    7 days ago
  • $260k - $350k

     ...everything from customer-facing software to the data platform that will power the next era of...  ...complex problems and creating impact for the engine of the American economy, you’ll love it...  ...:Comprehensive knowledge of modern big data5+ years experience in software development... 
    Platform
    Big data
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    a month ago
  • $162k - $216k

     ...everything from customer-facing software to the data platform that will power the next era of...  ...complex problems and creating impact for the engine of the American economy, you'll love it...  ...Strong foundation in data analytics and big data technologies, with the ability to... 
    Platform
    Big data
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton (A Ryder Technology Lab)

    San Francisco, CA
    18 days ago
  •  ...Big Data EngineerCA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco...  ...administering Hadoop or other Data Science and Analytics platforms using the technologies above• Experience with DevOps support•... 
    Platform
    Big data
    Work experience placement

    ClifyX

    San Francisco, CA
    4 days ago
  • $155.4k - $208.4k

     ...Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all...  ...and building the products and platforms that will power our media, advertising...  ....  ~5+ years of related big data engineering experience modeling... 
    Platform
    Big data
    Work experience placement

    Disney Entertainment and ESPN Product & Technology

    San Francisco, CA
    10 hours ago
  • Data Scientist Designs, develops, and implements Hadoop ecosystem based applications to support...  ...in coding, designing and supporting of big data solutions in Hadoop. Experience using...  ...skills. Preferred skills: Google Cloud Platform (GCP) experience. Experience supporting teams... 
    Platform
    Big data

    My3Tech Inc

    San Francisco, CA
    3 days ago
  • Role: Data Engineer Location: Bay Area, CA Why Join Us? Work with a leading technology organization...  ..., alongside advanced SQL expertise. Big Data Infrastructure: Deep, hands-on...  ...Architecture: Proficiency with public cloud platforms (such as AWS or GCP ). Data Modeling:... 
    Platform
    Big data

    The AES Group

    San Francisco, CA
    5 days ago
  • Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING / FULL-TIME What Will You Be Doing? Building...  ..., and helping architect our data platform and data warehouses to ensure that our data...  .... Experience with Apache Spark or other Big Data frameworks; working with cloud infrastructure... 
    Platform
    Big data
    Full time
    Work experience placement

    1872 Consulting

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...driven communication. If you're ready to own data strategy at a high-growth AI company,...  ...foundation of everything we build. As Senior Data Engineer , you won’t just clean datasets and...  ...internal data into insights - Our own platform is a goldmine of information. You’ll uncover... 
    Platform
    Big data
    Full time
    Remote work
    Flexible hours

    Gloo

    San Francisco, CA
    3 days ago
  • $224k - $264k

     ...About Checkr Checkr is building the data platform to power safe and fair decisions. Over 140...  ...Breakthrough Company. As a Staff Data Engineer on the People Data team, you'll help build...  ...(e.g., MongoDB). ~ Experience with big data technologies such as Kafka, Spark,... 
    Platform
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours
    3 days per week

    Checkr

    San Francisco, CA
    4 days ago
  • Zof AI is seeking an Analytics Engineer to build the pipelines that turn raw agent...  ..., and remediation outcomes into data the company can trust. This role owns...  ...Analytics Engineer, ETL Developer, Big Data Engineer, or Data Platform Engineer, this is that discipline at... 
    Platform
    Big data
    Full time

    Zof AI

    San Francisco, CA
    1 day ago
  • Lead Data Engineer - Job Description Responsibilities Development Tasks: Collect metrics based on user interactions. Visualize data...  ...of experience in heavy volume data processing, data platform, data lake, big data, data warehouse, or equivalent. 5+ years of experience... 
    Platform
    Big data

    My3Tech Inc

    San Francisco, CA
    2 days ago
  • Data Engineer (San Francisco, CA) About Atmosphere: Atmosphere is the world’s first and largest...  ...Channels from prominent brands. The platform has been built from the ground up with proprietary...  .... Experience building and optimizing ‘big data’ data pipelines, architectures and... 
    Platform
    Big data

    Free Streaming Content

    San Francisco, CA
    2 days ago
  •  ...Gridware’s advanced Active Grid Response platform uses high-precision sensors to detect...  ..., please visit  Role Overview As a Data Engineer at Gridware, you’ll help build and maintain...  ...warehouses, Lakehouse platforms, or big data tools (Databricks, Spark, or equivalent... 
    Platform
    Big data
    Local area

    Gridware

    San Francisco, CA
    24 days ago
  • Lead Data Engineer With MarTechLocation: SFO, CA (Hybrid 2 days a week)Key ResponsibilitiesLead...  ...-grade tools. Develop high-performance big-data applications using Scala, Databricks...  ...& ExperienceDeep expertise in MarTech platforms with hands-on experience in Adobe Campaign... 
    Platform
    Big data
    2 days per week

    Staffing the Universe

    San Francisco, CA
    1 day ago
  • Open role: Data Engineer (Full-time) Location: San Francisco, CA (On-site) As a Data Engineer...  ...and storage solutions that handle our platform's information. This role ensures that everything...  ...performance tuning. Familiarity with big data or NoSQL technologies (such as... 
    Platform
    Big data
    Full time

    Methodic

    San Francisco, CA
    5 days ago
  • $228.6k - $317.23k

     ...Databricks, we are passionate about enabling data teams to solve the world's toughest...  ...world's best data and AI infrastructure platform so our customers can use deep data insights...  ...their business. We are the Lakeflow Engineering team, responsible for Databricks ETL product... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    a month ago
  • Data Engineer RADIUMONE IS A GLOBAL PROGRAMMATIC AD BUYING PLATFORM RadiumOne is the 6th largest web property in the U.S. according to comScore We build intelligent software that automates media buying, making big data actionable for marketers and connects them to their... 
    Platform
    Big data
    Local area

    Stepping Up Solutions

    San Francisco, CA
    2 days ago
  • $199k

     ...Chime is looking for a seasoned engineering leader to help manage and guide the Data team to drive the company to build...  ...-making, and advance Chime's data platform. Partner closely with Analytics...  ...We believe in being bold, dreaming big, and taking risks, while also working... 
    Platform
    Full time
    Work at office
    Local area
    Remote work

    Chime Financial, Inc

    San Francisco, CA
    1 day ago
  • We have a full-time job opportunity of Data Engineer in San Francisco, California (Hybrid). Location...  ..., test, deploy, and maintain scalable Big Data solutions. Manage project...  ...with expertise in cloud or on-premise data platforms. Proficient in at least one modern programming... 
    Platform
    Big data
    Full time
    Work at office

    NexDimension

    San Francisco, CA
    5 days ago
  • Lead Data Engineer RADIUMONE IS A GLOBAL PROGRAMMATIC AD BUYING PLATFORM RadiumOne is the 6th largest web property in the U.S. according to comScore We build intelligent software that automates media buying, making big data actionable for marketers and connects them to... 
    Platform
    Big data

    Stepping Up Solutions

    San Francisco, CA
    1 day ago
  • We're looking for a Manager, Data Engineering with deep Big Data expertise to design, develop, and maintain scalable data pipelines and analytics...  ...data warehousing solutionsExperience with cloud-based data platforms such as AWS, GCP, or AzureStrong programming skills in... 
    Platform
    Big data
    Hourly pay
    Freelance

    Solomon Page

    San Francisco, CA
    a month ago
  • Data Engineer The role will be responsible for expanding and optimizing our data and data pipeline...  ...Experience on Databricks on Azure Cloud platform, deep understanding on Delta lake, Lake...  ...stream processing, and highly scalable ‘big data’ data stores. Familiar with... 
    Platform
    Big data

    My3Tech Inc

    San Francisco, CA
    4 days ago
  • $150.4k - $277.6k

    Senior Data Engineer Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer...  ...with JVM languages: Java or Scala 5+ years experience with big data platforms Familiarity with ML/AI workflows and feature engineering to... 
    Platform
    Big data
    Relocation

    Apple

    San Francisco, CA
    1 day ago
  • $172.5k - $260.1k

     ...Salesforce.About the TeamAt Slack, data isn't just infrastructure — it's the engine behind every great enterprise...  ...'s most widely used collaboration platforms.What You'll Be DoingTranslate complex...  ...S3, EMR), Apache Pinot, or Hadoop/Big Data ecosystemsExperience with Flink... 
    Platform
    Big data
    Permanent employment
    Full time

    Salesforce

    San Francisco, CA
    23 days ago
  •  ...change lives along the way. The Role As a Data Engineer at Air Apps, you will be responsible for...  ...warehouses and data lakes using cloud platforms such as AWS, Google Cloud, or Azure ....  ...database optimization . Experience with big data frameworks (Apache Spark, Hadoop, Kafka... 
    Platform
    Big data
    Temporary work
    Worldwide

    Air Apps

    San Francisco, CA
    1 day ago
  •  ...team! Why Join Us: We are seeking a Senior Data Engineer to join our engineering team. With our...  ...role in building and maintaining data platform, pipelines, and management tools. What You...  ...distributed data pipelines using big data technologies on large scale data sets... 
    Platform
    Big data
    Full time
    Work at office
    Remote work
    Flexible hours

    Engg

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Engineer, Big Data Platform. Be the first to apply!