Principal Engineer, Big Data Platform
Full-time
Responsibilities
- Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications.
- Build and scale data infrastructure frameworks for petabyte-scale datasets, including compute engines, job management, resource management, scheduling, and remote shuffling.
- Partner with internal customers on critical business use cases relying on big data.
- Provide company-wide technical leadership on reliable, fast, and efficient data processing and storage at scale.
- Contribute to the team’s technical vision and long-term roadmap.
Requirements
- 12+ years of industry experience with a proven track record of technical excellence.
- 8+ years of experience building and supporting large-scale Kubernetes or big data platforms.
- Deep knowledge of big data and machine learning technologies such as Flink, Spark, Presto, Kubernetes, Ray, PyTorch, or TensorFlow.
- Proficiency in one or more of Java, Go, Scala, or Python.
- Experience with Kubernetes and AWS technologies.
- Exceptional collaboration skills and the ability to navigate ambiguity, make tradeoffs, and align stakeholders.
- Bachelor’s degree in computer science, a related technical field, or equivalent experience.
Benefits
- Remote work arrangement with in-office collaboration required 1–2 times per quarter; the role can be based anywhere in the country.
- US-based applicants only.
- The position is not eligible for relocation assistance.
- The role is eligible for equity.
- Pinterest provides inclusive workplace support and equal opportunity employment.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal Engineer, Big Data Platform in Remote vacancy
- The Principal Data Engineer serves as a hands-on technical authority responsible for defining and implementing... ..., and optimize production code and platform capabilities while providing technical... ..., Kafka is required. Experience with big data, statistics, and machine learning...PlatformBig dataRemote workFlexible hours
- Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies... ...and drive the build out of next generation data platform.As a hands-on engineer, you will influence all...PlatformBig dataWork experience placement
- Req ID: 32803At NTT DATA Services, we know that with the right people on board, anything... ....NTT DATA Services currently seeks a Principal Big Data Engineer to join our team in Durham, North... ...the build out of next generation data platform.As a hands-on engineer, you will...PlatformBig dataFor contractorsWork experience placement
$242.63k
...people around the world come to our platform to find creative ideas, dream... ...process here.We’re looking for a principal software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll...PlatformBig dataWork at officeRemote workRelocationRelocation package- ...seeking a highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data... ...performance and scalability. Leverage big data technologies and frameworks (e.g.... ...infrastructure, including cloud-based platforms, containerization technologies, and...PlatformBig dataFull timeLocal area
- ...information.Job DescriptionThe Principal will be responsible for... ...singular projects related to data engineering requirements and initiatives... ...utilizing the AWS technology platform.Create and optimize ETL/ELT... ...CT, OMOP, DICOM).Exposure to big data technologies and handling...PlatformBig dataFull timeWork at officeRemote workWorldwideFlexible hours
$267.8k - $288.56k
...healthcare, energy and data centers. With revenue... ...Devices, Inc. Job Title: Principal Data EngineerJob... ...scalable enterprise data platforms and architectures to support... ..., and modern data engineering tools for efficient... ...distributed frameworks and big data technologies, and...PlatformBig dataPermanent employmentFull timeWork at officeRemote workWork from homeDay shift2 days per week- ZipRecruiter is hiring an Engineering Manager to lead our Big Data Engineering team. You will own the mission, drive execution, and ensure code quality... ...of ownership and excellence in a data-driven, scalable platform. We offer a hybrid work environment with US-based remote...PlatformBig dataRemote work
- ...Description L3Harris Enterprise Data and AI team is seeking a Data... ...the company’s modern data platform, Unified Data Layer, focusing... ...ontology management to support big data analytics at scale ~Collaborate... ...architect or in a senior data engineering role, ideally supporting...PlatformBig dataFull timeFlexible hours
$165k - $220k
Senior Director - Engineering and Data Operations - OpenData Join to apply for Senior Director - Engineering... ...and technical expert who defines the platform’s future scalability through sound... ...in architecting and delivering Big Data solutions in a fully managed cloud...PlatformBig dataWork at officeLocal areaWork from homeFlexible hoursShift work- ...difficult adversarial problems on the platform: Alternate Account Detection... ...You will report to the Senior Engineering Manager of the Account... ...complex ground truth and training data challenges for adversarial... ...identifying opportunities to leverage big data and behavioral signals to...PlatformBig dataFull timeImmediate start
$200k - $280k
...this level of clearance.*** Are you a Principal Systems Engineer who is ready for a new challenge that... ...Full-Stack Application Development, Big Data, Cloud Technologies, Analytics,... ...Cloud Architecture/ Cloud Engineer/ Platform Engineering (especially in AWS) AI/...PlatformBig dataFull timeContract workRemote workWork from homeRelocation package$200k - $280k
...this level of clearance.*** Are you a Principal Systems Engineer who is ready for a new challenge that... ...Full-Stack Application Development, Big Data, Cloud Technologies, Analytics,... ...and analytic query experience with a platform. Work with numerous concurrent IC-...PlatformBig dataFull timeContract workRemote workWork from homeRelocation package- ...special place to work.Job OverviewThe Principal, Engineer is a hands-on subject matter expert who... ...demonstrates strong proficiency in Java, Python, data structures, and algorithms, actively... ...from on-premises environments to cloud platforms, specifically Google Cloud Platform (...PlatformWork experience placementFlexible hours
- ...Millions of people around the world come to our platform to find creative ideas, dream about new possibilities... ...here . We’re looking for a Staff Software Engineer to help build the next generation of Pinterest’s big data storage platform. You’ll work on some of the...PlatformBig dataFull timeWork at officeRelocationRelocation package
$228k - $253k
...Ibotta is seeking a Principal Machine Learning Engineer to join our Core Data & Analytics team and contribute to our mission... ...systems, and large-scale ML platforms. This role will immediately define... ...and evaluate cutting edge big data and machine learning technologies...PlatformBig dataFull timeWork at officeImmediate startRemote workRelocationRelocation packageFlexible hours$125.5k - $230.2k
...world.Manager - Financial Services - Data and Analytics - Data Architecture and Engineering EY is the only professional... ...Engineering, Cloud Data Modernization, Big Data initiatives and Event-driven... ...and designing large data platforms, data warehouses, streaming applications...PlatformBig dataWork experience placementSummer holidayFlexible hours- ...applications and tools for the effective management and operation of big data platform • Analyze and improve stability, efficiency, and scalability of the platform • Work closely with Architects, lead engineers and business on product design and features. • Mentor and...PlatformBig dataFull timeWork experience placement
$160k - $200k
...ROLE SUMMARY Build and lead a team of software engineers and analysts, driving innovation across Viant’s big data and DSP platforms. Design and deliver scalable systems that support data processing, analytics, and machine learning capabilities in collaboration with partner...PlatformBig dataFor contractorsLocal areaRemote work- ...highly skilled Full Stack Developer with Big Data expertise to support mission-critical... ...will bring a strong mix of full stack engineering capabilities and data-intensive... ...integration between application layers and data platforms Support system modernization efforts...PlatformBig dataFull time
$132.1k - $178.8k
...world.Amazon Business Team is looking for a Data Engineer (DE) to play a significant role in... ...distributed systems and administering the platform software. You are expected to analyze challenging... ...of SQL experience- Experience with big data technologies such as: Hadoop, Hive,...PlatformBig dataFlexible hours- ...Data Engineering Manager You've discovered something special. A company that cares. Cares about leading the way in... ...Tableau, as well as experience working with cloud-based platforms like Azure, GCP, or Databricks and big data technologies including Hadoop, Spark, and...PlatformBig dataFull timeWork experience placementWork at officeRemote workMonday to FridayFlexible hours
- ...around the world come to our platform to find creative ideas, dream... ...Mission The Privacy & Conversion Data team is responsible for how... ...We’re seeking a Staff Engineer to lead the architecture and technical... ...SQL; experience with modern big data ecosystems is a plus. ~...PlatformBig dataFull timeWork at officeRemote workRelocationRelocation package
- An established industry player is seeking a skilled data engineer to leverage big data for impactful missions. In this dynamic role, you will design and develop scalable data platforms, ensuring that complex data applications are operationalized effectively. Collaborating...PlatformBig dataRemote job
- ...Data Engineering Manager Spokeo is a people intelligence platform that helps over 18 million monthly visitors reconnect with friends, reunite with families, and build... ...(AWS, Azure) ~5+ years of experience with big data technologies (Spark, Hadoop, MapReduce, Hive...PlatformBig dataRemote workHome office
$127.34k - $160k
POSITION OVERVIEWNBME is looking for a Data Engineer to join a highly skilled and growing team... ...modernize, expand, and optimize NBME's data platform by building data lakes, complex data... ...apply) At least 4 years of experience in big data technologies At least 4 years'...PlatformBig dataInternshipWork at officeLocal areaRemote work- ...are passionate about enabling data teams to solve the world's toughest... ...data and AI infrastructure platform so our customers can use deep... ...their business. Founded by engineers — and customer obsessed — we leap... ...source standard framework for big data. Data Plane Storage :...PlatformBig dataFull time
- ...Description Data Engineer Chantilly, Va *Active TS/SCI w/ FSP required prior to application... ...technical expertise in a variety of big data technologies and the proven ability... ... Design and develop a processing platform using various configuration management...PlatformBig dataFull timeWork at office
$207.4k - $278.1k
...global organization of engineers, product developers,designers, technologists, data scientists, and more -... ...buildingthe products and platforms that will power our... ...brands.Job Summary:As a Principal Machine Learning Engineer... ...hands-on experience with big data technologies such...PlatformBig data$215k
...analyzes billions of alternative data points to uncover actionable... ...highly skilled Senior Data Engineering Manager to lead one of our... ...that support our products, AI platforms, and customer-facing data... ...engineering, data architecture, big data development, ETL engineering...PlatformBig dataWork at officeRemote workVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Engineer, Big Data Platform. Be the first to apply!
Related searches
- project engineer assistant project manager Remote
- principal data engineer Remote
- principal cloud engineer Remote
- director data engineering Remote
- director of product engineering Remote
- principal developer Remote
- senior principal engineer Remote
- assistant chief engineer Remote
- hotel chief engineer Remote
- senior civil engineer project manager Remote




