Principal Engineer, Big Data Platform
$242.63kAbout Pinterest:Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI.Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here.We’re looking for a principal software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting big data and AI open source technologies (Flink, Spark, Kubernetes, etc.), at the scale of exabytes of data to help Pinners discover and do what they love.What you’ll do:Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applicationsBuild and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shufflingWork with internal customers on critical business use cases that rely on big data Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scaleContribute to the team’s technical vision and long-term roadmapWhat we’re looking for:12+ years of industry experience with a proven track record of technical excellence8+ years of experience of building and support large scalable Kubernetes or big data platformDeep knowledge of big data / ML technologies (e.g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow)Proficiency in one or more programming languages (Java, Go, Scala, Python)Experiences in Kubernetes and AWS technologiesExceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress.Bachelor’s degree in Computer Science, a related technical field, or equivalent experience.In-Office Requirement Statement:We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection.This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. Relocation Statement:This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.#LI-REMOTE#LI-CL5At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise.Information regarding the culture at Pinterest and benefits available for this position can be found here.US based applicants only$242,634—$499,541 USDOur Commitment to Inclusion:Pinterest is an equal opportunity employer and makes employment decisions on the basis of merit. We want to have the best qualified people in every job. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, national origin, religion or religious creed, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, age, marital status, status as a protected veteran, physical or mental disability, medical condition, genetic information or characteristics (or those of a family member) or any other consideration made unlawful by applicable federal, state or local laws. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you require a medical or religious accommodation during the job application process, please complete this form for support.By submitting this application, I certify that all information submitted in my application and throughout the hiring process is true, accurate, and complete to the best of my knowledge. I understand that any false statement, omission, or misrepresentation may disqualify me from employment consideration or result in termination if discovered after hire.
$197k - $270.6k
...let’s talk. The Technology, Data, and Intelligence Team... ...Intelligence (TDI) organization is the engine that powers Okta’s global... ...do their best work. The Principal Data Engineer Opportunity... ...scale and growth by building platforms that are utilized across the...PlatformTemporary workLocal areaWorldwideFlexible hours$162k - $216k
...everything from customer-facing software to the data platform that will power the next era of... ...complex problems and creating impact for the engine of the American economy, you’ll love it... ...Strong foundation in data analytics and big data technologies, with the ability to...PlatformBig dataFull timeWork at officeImmediate start- ...com addresses.About The RoleThe Data Cloud team is building an end-... ...on distributed processing engines and distributed databasesDevelop... ...MongoDB, CDC, and KafkaLeverage big data technologies like Aurora,... ...Rippling PlatformCreate data platforms, data lakes, and data...PlatformBig dataWork at office3 days per week
$266k
About the TeamData Platform at OpenAI owns the foundational data stack powering critical product, research, and analytics... ...Airflow; and support ML feature engineering tooling such as Chronon. Our... ...OpenAI. You will scale and harden big data compute and storage platforms...PlatformBig dataWork at officeLocal areaRelocation packageFlexible hours$224k - $264k
About CheckrCheckr is building the data platform to power safe and fair decisions. Over 140,00... ...Breakthrough Company.As a Staff Software Engineer on the People Data team, you'll help... ...stores (e.g., MongoDB).Experience with big data technologies such as Kafka, Spark,...PlatformBig dataWork at officeLocal areaRemote workRelocation3 days per week$260k - $350k
...everything from customer-facing software to the data platform that will power the next era of... ...complex problems and creating impact for the engine of the American economy, you’ll love it... ...:Comprehensive knowledge of modern big data5+ years experience in software development...PlatformBig dataFull timeWork at officeImmediate start- ...Arena Intelligence Arena is the platform for evaluating how AI models perform... ...seeking a Member of Technical Staff - Data Infrastructure software engineer to join our team and build the data... ...dedicated focus on data engineering and big data technologies ~ Proficiency...PlatformBig dataPermanent employmentWork at office
- ...Rippling.com addresses.About the Data Cloud TeamRippling Data Cloud... ...the Employee Graph and all platform data (payroll rules, earnings... ....Data Access - Owns the query engine (RQL, Rippling Query Language)... ...MongoDB, CDC, and KafkaLeverage big data technologies like Aurora,...PlatformBig dataWork at office3 days per week
$166k - $225k
...are passionate about enabling data teams to solve the world's toughest... ...data and AI infrastructure platform so our customers can use deep... ...their business. Founded by engineers — and customer obsessed — we leap... ...source standard framework for big data.Data Plane Storage:...PlatformBig dataLocal areaWorldwide- About the TeamDoorDash is a data driven organization and relies on... ...decisions. The Core Data Platform organization owns all the infrastructure... ...simplify data workflows for engineers, analysts, and ML... ...softwareExperience working on big data domains (streaming, batch...PlatformBig dataHourly payWork at officeLocal areaRemote workRelocationFlexible hours
$300k - $390k
...is seeking a highly motivated and experienced engineering leader to lead a team responsible for our Lila's product data platform. You will own the data platform and... ...blog posts highlighting Lila’s leadership in big data processing. Scientist and Engineering...PlatformBig dataFull timeWork at officeLocal areaFlexible hours- ...Data ScientistResponsibilities: Designs, develops, and implements Hadoop ecosystem based... ...experience in coding, designing and supporting of big data solutions in Hadoop. Experience using... ...skills. Preferred skills: Google Cloud Platform (GCP) experience. Experience supporting...PlatformBig data
- ...Sr. Data EngineerLocation: San Francisco, CAExperience: 5+Team: EngineeringPractice: Digital... ...changes to extend the scope of analytics platform.You love writing code and have an... ...modeling.SQL proficiency! Experience with big data tools such as Hadoop, BigQuery, Presto...PlatformBig data
- ...Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING / FULL-TIME What will you be doing... ...augmenting, and helping architect our data platform and data warehouses to ensure that our... ...~ Experience with Apache Spark or other Big Data frameworks; working with cloud infrastructure...PlatformBig dataFull timeWork experience placement
$228.6k - $317.23k
...Databricks, we are passionate about enabling data teams to solve the world's toughest... ...world's best data and AI infrastructure platform so our customers can use deep data insights... ...their business. We are the Lakeflow Engineering team, responsible for Databricks ETL product...PlatformBig dataLocal areaWorldwide$193.8k - $285k
About the TeamDoorDash is a data driven organization and relies on timely, accurate and... ...foundation of DoorDash success. The Data Engineering team builds database solutions for various... .../Redshift, AWS/GCP, Hadoop/Spark/Big data, Lambda/KAPPA architectures, Flink/Airflow...Big dataHourly payTemporary workWork at officeLocal areaRemote workFlexible hours$155.4k - $208.4k
Job Posting Title:Sr Data EngineerReq ID:10153284Job Description:... ...Technology is a global organization of engineers, product developers, designers... ...and building the products and platforms that will power our media,... .... 5+ years of related big data engineering experience modeling...PlatformBig dataFull timeWork experience placement- ...Lead Data EngineerLocation: SFO, CA (Hybrid 2 days a week)Key... ...ResponsibilitiesLead end-to-end MarTech engineering initiatives across... ...tools. Develop high-performance big-data applications using Scala... ...expertise in MarTech platforms with hands-on experience in Adobe...PlatformBig data2 days per week
$196k - $269.5k
...FaireFaire is a technology wholesale platform built on the belief that the... ...'re using the power of tech, data, and machine learning to... ...Product Analysts and Software Engineers to support product launches and... ...data warehousing concepts, ETLs, big data technologies, and...PlatformBig dataWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week- ...Data EngineerRADIUMONE IS A GLOBAL PROGRAMMATIC AD BUYING PLATFORMRadiumOne... ...media buying, making big data actionable for marketers... ...seeking a talented Software Engineering Manager.RadiumOne generates... ...two real-time analytics platforms.You will be responsible with...PlatformBig dataLocal area
- ...We have a full-time job opportunity of Data Engineer in San Francisco, California (Hybrid).... ...develop, test, deploy, and maintain scalable Big Data solutions. Manage project... ...with expertise in cloud or on-premise data platforms. Proficient in at least one modern programming...PlatformBig dataFull timeWork at office
- ...Data EngineerEmployment Type: Full-Time, Mid-levelCGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower... ....Strong knowledge of big data analysis and...PlatformBig dataFull time
$235k - $275k
...leading marketplace and last-mile platforms, we deliver care where people... ...runway.About the RoleOur engineering team has scaled from 12 to 40... ...Product, Operations, and Data to deliver measurable impact... ...complexityHands-on experience with Big Data, data platforms, and...PlatformBig dataTemporary workWork at officeMonday to FridayMonday to Thursday- ...lives along the way. The Role As a Data Engineer at Air Apps, you will be responsible... ...warehouses and data lakes using cloud platforms such as AWS, Google Cloud, or Azure .... ...database optimization . Experience with big data frameworks (Apache Spark, Hadoop,...PlatformBig dataTemporary workWorldwide
- ...Why Join Us: We are seeking a Senior Data Engineer to join our engineering team. With our rapid... ...role in building and maintaining data platform, pipelines, and management tools. What... ...developing distributed data pipelines using big data technologies on large scale data...PlatformBig dataFull timeWork at officeRemote workFlexible hours
$172.28k - $231.11k
...~ Reach & Scale: The products and platforms this group builds and operates delight... ...entertainment & news. The Product & Data Engineering team is responsible for end to end... ...functional business partners. As a Principal Data Engineer in the Data Platforms team...PlatformWork experience placementWorldwideShift work$199k
...RoleChime is looking for a seasoned engineering leader to help manage and guide the Data team to drive the company to build... ...-making, and advance Chime's data platform.Partner closely with Analytics,... ...We believe in being bold, dreaming big, and taking risks, while also working...PlatformFull timeWork at officeLocal areaRemote work- ...initiatives through digital product engineering, automation, data engineering, and infrastructure modernization... ...with deep expertise in modern data platforms, enterprise, solution, and technical... ...Certified: Solutions Architect or Big Data Specialty Databricks...PlatformBig dataPermanent employmentFull timeRemote workWork from homeFlexible hours
- ...countries through innovative data collection and analysis. We develop... ...technologies and analytics platforms to provide utilities,... ...degree in Computer Science, Engineering, or related field ~3+ years... ...Python Experience with big data processing and distributed...PlatformBig dataWork at officeRemote work
$280k - $330k
...roleNotion's Search & Context Platform is the substrate that powers how... ...all of it production-grade.Data growth is faster than ever, and... ...on the retrieval layer.As the Engineering Manager for this team, you'll... ...embeddings, ANN/vector indexes), big data pipelines, hybrid...PlatformBig dataLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Engineer, Big Data Platform. Be the first to apply!
- principal security engineer San Francisco, CA
- chief engineer San Francisco, CA
- senior chief engineer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
- principal developer San Francisco, CA
- technical director engineering San Francisco, CA
- general engineer San Francisco, CA
- director software engineering San Francisco, CA
- engineering director San Francisco, CA
- director data engineering San Francisco, CA


