Principal Engineer, Big Data Platform
About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . We’re looking for a principal software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting big data and AI open source technologies (Flink, Spark, Kubernetes, etc. ), at the scale of exabytes of data to help Pinners discover and do what they love. What you’ll do: - Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications - Build and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shuffling - Work with internal customers on critical business use cases that rely on big data - Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scale - Contribute to the team’s technical vision and long-term roadmap What we’re looking for: - 12+ years of industry experience with a proven track record of technical excellence - 8+ years of experience of building and support large scalable Kubernetes or big data platform - Deep knowledge of big data / ML technologies (e.
g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow) - Proficiency in one or more programming languages (Java, Go, Scala, Python) - Experiences in Kubernetes and AWS technologies - Exceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress. - Bachelor’s degree in Computer Science, a related technical field, or equivalent experience. In-Office Requirement Statement: - We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection. - This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. Relocation Statement: - This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model. #LI-REMOTE #LI-CL5 At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise. Information regarding the culture at Pinterest and benefits available for this position can be found here .
- ...Millions of people around the world come to our platform to find creative ideas, dream about new... ...marketers. We leverage massive data and cutting-edge science to automate and... ...trust to grow their business. As a Data Engineer at tvScientific, you will be a key player...PlatformBig dataFull time
$170.4 per hour
...are passionate about enabling Data & AI teams to solve the world'... ...best data and AI infrastructure platform so our customers can use deep... ...their business. Founded by engineers, we leap at every opportunity... ...Track: Expertise in large-scale big data solutions and ETL pipelines...PlatformBig dataLocal areaWorldwide$180k - $250k
...slowing the deployment of the data centers that will power the next... ...the energy intelligence platform for the AI economy. Our software... ...Verse. This role supports Core Engineering needs within the organization... ...Intimate knowledge of scaling "big data" solutions in cloud-based...PlatformBig dataRemote workFlexible hours$266k
About the TeamData Platform at OpenAI owns the foundational data stack powering critical product, research, and analytics... ...Airflow; and support ML feature engineering tooling such as Chronon. Our... ...OpenAI. You will scale and harden big data compute and storage platforms...PlatformBig dataWork at officeLocal areaRelocation packageFlexible hours$260k - $350k
...everything from customer-facing software to the data platform that will power the next era of... ...complex problems and creating impact for the engine of the American economy, you’ll love it... ...:Comprehensive knowledge of modern big data5+ years experience in software development...PlatformBig dataFull timeWork at officeImmediate start$162k - $216k
...everything from customer-facing software to the data platform that will power the next era of... ...complex problems and creating impact for the engine of the American economy, you'll love it... ...Strong foundation in data analytics and big data technologies, with the ability to...PlatformBig dataFull timeWork at officeImmediate startRemote workMonday to Friday- ...Big Data EngineerCA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco... ...administering Hadoop or other Data Science and Analytics platforms using the technologies above• Experience with DevOps support•...PlatformBig dataWork experience placement
$155.4k - $208.4k
...Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all... ...and building the products and platforms that will power our media, advertising... .... ~5+ years of related big data engineering experience modeling...PlatformBig dataWork experience placement- Data Scientist Designs, develops, and implements Hadoop ecosystem based applications to support... ...in coding, designing and supporting of big data solutions in Hadoop. Experience using... ...skills. Preferred skills: Google Cloud Platform (GCP) experience. Experience supporting teams...PlatformBig data
- Role: Data Engineer Location: Bay Area, CA Why Join Us? Work with a leading technology organization... ..., alongside advanced SQL expertise. Big Data Infrastructure: Deep, hands-on... ...Architecture: Proficiency with public cloud platforms (such as AWS or GCP ). Data Modeling:...PlatformBig data
- Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING / FULL-TIME What Will You Be Doing? Building... ..., and helping architect our data platform and data warehouses to ensure that our data... .... Experience with Apache Spark or other Big Data frameworks; working with cloud infrastructure...PlatformBig dataFull timeWork experience placement
$150k - $250k
...driven communication. If you're ready to own data strategy at a high-growth AI company,... ...foundation of everything we build. As Senior Data Engineer , you won’t just clean datasets and... ...internal data into insights - Our own platform is a goldmine of information. You’ll uncover...PlatformBig dataFull timeRemote workFlexible hours$224k - $264k
...About Checkr Checkr is building the data platform to power safe and fair decisions. Over 140... ...Breakthrough Company. As a Staff Data Engineer on the People Data team, you'll help build... ...(e.g., MongoDB). ~ Experience with big data technologies such as Kafka, Spark,...PlatformBig dataWork at officeLocal areaRemote workRelocationFlexible hours3 days per week- Zof AI is seeking an Analytics Engineer to build the pipelines that turn raw agent... ..., and remediation outcomes into data the company can trust. This role owns... ...Analytics Engineer, ETL Developer, Big Data Engineer, or Data Platform Engineer, this is that discipline at...PlatformBig dataFull time
- Lead Data Engineer - Job Description Responsibilities Development Tasks: Collect metrics based on user interactions. Visualize data... ...of experience in heavy volume data processing, data platform, data lake, big data, data warehouse, or equivalent. 5+ years of experience...PlatformBig data
- Data Engineer (San Francisco, CA) About Atmosphere: Atmosphere is the world’s first and largest... ...Channels from prominent brands. The platform has been built from the ground up with proprietary... .... Experience building and optimizing ‘big data’ data pipelines, architectures and...PlatformBig data
- ...Gridware’s advanced Active Grid Response platform uses high-precision sensors to detect... ..., please visit Role Overview As a Data Engineer at Gridware, you’ll help build and maintain... ...warehouses, Lakehouse platforms, or big data tools (Databricks, Spark, or equivalent...PlatformBig dataLocal area
- Lead Data Engineer With MarTechLocation: SFO, CA (Hybrid 2 days a week)Key ResponsibilitiesLead... ...-grade tools. Develop high-performance big-data applications using Scala, Databricks... ...& ExperienceDeep expertise in MarTech platforms with hands-on experience in Adobe Campaign...PlatformBig data2 days per week
- Open role: Data Engineer (Full-time) Location: San Francisco, CA (On-site) As a Data Engineer... ...and storage solutions that handle our platform's information. This role ensures that everything... ...performance tuning. Familiarity with big data or NoSQL technologies (such as...PlatformBig dataFull time
$228.6k - $317.23k
...Databricks, we are passionate about enabling data teams to solve the world's toughest... ...world's best data and AI infrastructure platform so our customers can use deep data insights... ...their business. We are the Lakeflow Engineering team, responsible for Databricks ETL product...PlatformBig dataLocal areaWorldwide- Data Engineer RADIUMONE IS A GLOBAL PROGRAMMATIC AD BUYING PLATFORM RadiumOne is the 6th largest web property in the U.S. according to comScore We build intelligent software that automates media buying, making big data actionable for marketers and connects them to their...PlatformBig dataLocal area
$199k
...Chime is looking for a seasoned engineering leader to help manage and guide the Data team to drive the company to build... ...-making, and advance Chime's data platform. Partner closely with Analytics... ...We believe in being bold, dreaming big, and taking risks, while also working...PlatformFull timeWork at officeLocal areaRemote work- We have a full-time job opportunity of Data Engineer in San Francisco, California (Hybrid). Location... ..., test, deploy, and maintain scalable Big Data solutions. Manage project... ...with expertise in cloud or on-premise data platforms. Proficient in at least one modern programming...PlatformBig dataFull timeWork at office
- Lead Data Engineer RADIUMONE IS A GLOBAL PROGRAMMATIC AD BUYING PLATFORM RadiumOne is the 6th largest web property in the U.S. according to comScore We build intelligent software that automates media buying, making big data actionable for marketers and connects them to...PlatformBig data
- We're looking for a Manager, Data Engineering with deep Big Data expertise to design, develop, and maintain scalable data pipelines and analytics... ...data warehousing solutionsExperience with cloud-based data platforms such as AWS, GCP, or AzureStrong programming skills in...PlatformBig dataHourly payFreelance
- Data Engineer The role will be responsible for expanding and optimizing our data and data pipeline... ...Experience on Databricks on Azure Cloud platform, deep understanding on Delta lake, Lake... ...stream processing, and highly scalable ‘big data’ data stores. Familiar with...PlatformBig data
$150.4k - $277.6k
Senior Data Engineer Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer... ...with JVM languages: Java or Scala 5+ years experience with big data platforms Familiarity with ML/AI workflows and feature engineering to...PlatformBig dataRelocation$172.5k - $260.1k
...Salesforce.About the TeamAt Slack, data isn't just infrastructure — it's the engine behind every great enterprise... ...'s most widely used collaboration platforms.What You'll Be DoingTranslate complex... ...S3, EMR), Apache Pinot, or Hadoop/Big Data ecosystemsExperience with Flink...PlatformBig dataPermanent employmentFull time- ...change lives along the way. The Role As a Data Engineer at Air Apps, you will be responsible for... ...warehouses and data lakes using cloud platforms such as AWS, Google Cloud, or Azure .... ...database optimization . Experience with big data frameworks (Apache Spark, Hadoop, Kafka...PlatformBig dataTemporary workWorldwide
- ...team! Why Join Us: We are seeking a Senior Data Engineer to join our engineering team. With our... ...role in building and maintaining data platform, pipelines, and management tools. What You... ...distributed data pipelines using big data technologies on large scale data sets...PlatformBig dataFull timeWork at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Engineer, Big Data Platform. Be the first to apply!
- director data engineering San Francisco, CA
- principal engineer San Francisco, CA
- senior chief engineer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
- principal data engineer San Francisco, CA
- senior civil engineer project manager San Francisco, CA
- chief engineer San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- director software engineering San Francisco, CA
- principal network engineer San Francisco, CA



