Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Engineer, Big Data Platform

$242.63k

Pinterest

About Pinterest:Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI.Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here.We’re looking for a principal software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting big data and AI open source technologies (Flink, Spark, Kubernetes, etc.), at the scale of exabytes of data to help Pinners discover and do what they love.What you’ll do:Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applicationsBuild and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shufflingWork with internal customers on critical business use cases that rely on big data Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scaleContribute to the team’s technical vision and long-term roadmapWhat we’re looking for:12+ years of industry experience with a proven track record of technical excellence8+ years of experience of building and support large scalable Kubernetes or big data platformDeep knowledge of big data / ML technologies (e.g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow)Proficiency in one or more programming languages (Java, Go, Scala, Python)Experiences in Kubernetes and AWS technologiesExceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress.Bachelor’s degree in Computer Science, a related technical field, or equivalent experience.In-Office Requirement Statement:We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection.This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. Relocation Statement:This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.#LI-REMOTE#LI-CL5At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise.Information regarding the culture at Pinterest and benefits available for this position can be found here.US based applicants only$242,634—$499,541 USDOur Commitment to Inclusion:Pinterest is an equal opportunity employer and makes employment decisions on the basis of merit. We want to have the best qualified people in every job. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, national origin, religion or religious creed, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, age, marital status, status as a protected veteran, physical or mental disability, medical condition, genetic information or characteristics (or those of a family member) or any other consideration made unlawful by applicable federal, state or local laws. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you require a medical or religious accommodation during the job application process, please complete this form for support.By submitting this application, I certify that all information submitted in my application and throughout the hiring process is true, accurate, and complete to the best of my knowledge. I understand that any false statement, omission, or misrepresentation may disqualify me from employment consideration or result in termination if discovered after hire.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal Engineer, Big Data Platform in San Francisco, CA vacancy
  •  ...About the Role Join a startup building an agentic data lakehouse platform. As a Senior Software Engineer, Distributed Data Systems, you'll work on a greenfield...  ..., or platform engineer ~ Experience with big data systems (Apache Spark, Hadoop) ~ Strong background... 
    Platform
    Big data
    Full time

    Clera

    San Francisco, CA
    20 hours ago
  •  ...around the world come to our platform to find creative ideas, dream...  ...Mission The Privacy & Conversion Data team is responsible for how...  ...We’re seeking a Staff Engineer to lead the architecture and technical...  ...SQL; experience with modern big data ecosystems is a plus. ~... 
    Platform
    Big data
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    20 hours ago
  • $170.4 per hour

     ...are passionate about enabling Data & AI teams to solve the world'...  ...best data and AI infrastructure platform so our customers can use deep...  ...their business. Founded by engineers, we leap at every opportunity...  ...Track: Expertise in large-scale big data solutions and ETL pipelines... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    4 days ago
  •  ...provider in San Francisco is seeking an experienced Data Engineer to support its Data Analytics platform. This role involves developing data pipelines, automating...  ..., including proficiency in Python and knowledge of big data tools. CGS offers a comprehensive benefits... 
    Platform
    Big data

    CGS Federal (Contact Government Services)

    San Francisco, CA
    1 day ago
  •  ...Wirestock is one of the leading data platforms for ethically sourced multimodal data...  ...data. About the Role We're hiring a Principal Machine Learning Engineer to lead the data-science function powering...  ...and scalable evaluation models. Big Data Infrastructure: Execute... 
    Platform
    Big data
    Shift work

    Wirestock

    San Francisco, CA
    2 days ago
  • Stepping Up Solutions in San Francisco is looking for a talented Lead Data Engineer to join their Data Technology team. In this role, you will...  ...success. The ideal candidate has expertise in No SQL and Big Data technologies, programming skills in Bash/Shell, Python, or... 
    Platform
    Big data

    Stepping Up Solutions

    San Francisco, CA
    2 days ago
  •  ...Persona is the configurable identity platform built for businesses in a digital-...  ...We are looking for passionate engineers who are excited to build the data foundation for the identity layer of...  ...it. ~ Hands-on experience with big-data or streaming technologies such... 
    Platform
    Big data
    Full time
    For contractors
    Internship
    Immediate start

    Persona

    San Francisco, CA
    20 hours ago
  • $123.7k - $254.67k

     ...Millions of people around the world come to our platform to find creative ideas, dream about new...  ...marketers. We leverage massive data and cutting-edge science to automate and...  ...can trust to grow their business.As a Data Engineer at tvScientific, you will be a key player... 
    Platform
    Big data
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    4 days ago
  • $162k - $216k

     ...everything from customer-facing software to the data platform that will power the next era of...  ...complex problems and creating impact for the engine of the American economy, you’ll love it...  ...Strong foundation in data analytics and big data technologies, with the ability to... 
    Platform
    Big data
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    4 days ago
  • Wirestock is seeking a Principal Machine Learning Engineer in San Francisco to lead the data-science function powering our content platform. You will drive curation, QC, and enrichment of a petabyte-scale library using computer vision and AI, and shape data strategy with... 
    Platform
    Big data

    Wirestock

    San Francisco, CA
    3 days ago
  • $266k

    About the TeamData Platform at OpenAI owns the foundational data stack powering critical product, research, and analytics...  ...Airflow; and support ML feature engineering tooling such as Chronon. Our...  ...OpenAI. You will scale and harden big data compute and storage platforms... 
    Platform
    Big data
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $260k - $350k

     ...everything from customer-facing software to the data platform that will power the next era of...  ...complex problems and creating impact for the engine of the American economy, you’ll love it...  ...:Comprehensive knowledge of modern big data5+ years experience in software development... 
    Platform
    Big data
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    4 days ago
  • Disney Cruise Line - The Walt Disney Company is seeking a senior big data engineer to design and maintain Identity and Device data products within a scalable data platform. You will improve code, modernize models, and collaborate across squads including PM, design, QA,... 
    Platform
    Big data

    Disney Cruise Line

    San Francisco, CA
    2 days ago
  •  ...Rippling.com addresses.About the Data Cloud TeamRippling Data Cloud...  ...the Employee Graph and all platform data (payroll rules, earnings...  ....Data Access - Owns the query engine (RQL, Rippling Query Language)...  ...MongoDB, CDC, and KafkaLeverage big data technologies like Aurora,... 
    Platform
    Big data
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    4 days ago
  • About the TeamDoorDash is a data driven organization and relies on...  ...decisions. The Core Data Platform organization owns all the infrastructure...  ...simplify data workflows for engineers, analysts, and ML...  ...softwareExperience working on big data domains (streaming, batch... 
    Platform
    Big data
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    4 days ago
  • $166k - $225k

     ...are passionate about enabling data teams to solve the world's toughest...  ...data and AI infrastructure platform so our customers can use deep...  ...their business. Founded by engineers — and customer obsessed — we leap...  ...source standard framework for big data.Data Plane Storage:... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    20 hours ago
  •  ...: Want to build robust and scalable data infrastructure to power data-driven City...  ...the data practice that sits around the platform—clear service offerings, consistent...  ...data quality standards. This role is the principal engineer leading that effort. You’ll own the department... 
    Platform
    Full time
    Traineeship
    Work experience placement
    Second job
    Work at office

    City and County of San Francisco

    San Francisco, CA
    3 days ago
  • $176k - $210k

    Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data...  ...of AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,000 - $210,... 
    Platform
    Big data

    Komodo Health

    San Francisco, CA
    4 days ago
  • $180k - $250k

     ...slowing the deployment of the data centers that will power the next...  ...the energy intelligence platform for the AI economy. Our software...  ...Verse. This role supports Core Engineering needs within the organization...  ...Intimate knowledge of scaling "big data" solutions in cloud-based... 
    Platform
    Big data
    Remote work
    Flexible hours

    Verse

    San Francisco, CA
    4 days ago
  • $228.6k - $317.23k

     ...Databricks, we are passionate about enabling data teams to solve the world's toughest...  ...world's best data and AI infrastructure platform so our customers can use deep data insights...  ...their business. We are the Lakeflow Engineering team, responsible for Databricks ETL product... 
    Platform
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  •  ...Senior Data EngineerSAN FRANCISCO, CA / ENGINEERING / FULL-TIMEWhat Will You Be Doing?Building fast, reliable, scalable...  ..., and helping architect our data platform and data warehouses to ensure that...  ...with Apache Spark or other Big Data frameworks; working with cloud... 
    Platform
    Big data
    Work experience placement

    1872 Consulting

    San Francisco, CA
    20 hours ago
  •  ...Zof AI is seeking a Senior Data Engineer to build the pipelines that turn raw agent runs, test results, and remediation outcomes...  ...have worked as an Analytics Engineer, ETL Developer, Big Data Engineer, or Data Platform Engineer, this is that discipline at Zof AI. The ideal... 
    Platform
    Big data
    Full time

    Zof AI

    San Francisco, CA
    3 days ago
  •  ...Big Data EngineerCA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco...  ...administering Hadoop or other Data Science and Analytics platforms using the technologies above• Experience with DevOps support•... 
    Platform
    Big data
    Work experience placement

    ClifyX

    San Francisco, CA
    20 hours ago
  • $150k - $250k

     ...driven communication. If you're ready to own data strategy at a high-growth AI company,...  ...foundation of everything we build. As Senior Data Engineer , you won’t just clean datasets and...  ...internal data into insights – Our own platform is a goldmine of information. You’ll uncover... 
    Platform
    Big data
    Full time
    Remote work
    Flexible hours

    Gloo

    San Francisco, CA
    4 days ago
  • We're looking for a Manager, Data Engineering with deep Big Data expertise to design, develop, and maintain scalable data pipelines and analytics...  ...data warehousing solutionsExperience with cloud-based data platforms such as AWS, GCP, or AzureStrong programming skills in... 
    Platform
    Big data
    Hourly pay
    Freelance

    Solomon Page

    San Francisco, CA
    2 days ago
  • $141.9k - $190.3k

    Job Posting Title:Sr Data EngineerReq ID:10153288Job Description:...  ...Technology is a global organization of engineers, product developers, designers...  ...and building the products and platforms that will power our media,...  ..., building ETL pipelines in Big Data environments (cloud, on-... 
    Platform
    Big data
    Full time
    Work experience placement

    Hulu

    San Francisco, CA
    3 days ago
  •  ...Lead Data Engineer - Job DescriptionResponsibilitiesDevelopment Tasks:Collect metrics based on user interactions.Visualize data...  ...years of experience in heavy volume data processing, data platform, data lake, big data, data warehouse, or equivalent.5+ years of experience... 
    Platform
    Big data

    My3Tech Inc

    San Francisco, CA
    20 hours ago
  • $193.8k - $285k

    About the TeamDoorDash is a data driven organization and relies on timely, accurate and...  ...foundation of DoorDash success. The Data Engineering team builds database solutions for various...  .../Redshift, AWS/GCP, Hadoop/Spark/Big data, Lambda/KAPPA architectures, Flink/Airflow... 
    Big data
    Hourly pay
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    4 days ago
  • $116.2k - $229.1k

    Position Summary Join Deloitte’s AI & Engineering practice and help organizations transform enterprise technology platforms, modernize data environments, and unlock value through...  ...Lead: Evaluate, pilot, and integrate new big data and analytics technologies, ensuring... 
    Platform
    Big data
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    3 days ago
  • $172.5k - $260.1k

     ...Salesforce.About the TeamAt Slack, data isn't just infrastructure — it's the engine behind every great enterprise...  ...'s most widely used collaboration platforms.What You'll Be DoingTranslate complex...  ...S3, EMR), Apache Pinot, or Hadoop/Big Data ecosystemsExperience with Flink... 
    Platform
    Big data
    Permanent employment
    Full time

    Salesforce

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Engineer, Big Data Platform. Be the first to apply!