Data Platform Engineer — Scale Big Data Lakes & Pipelines
Persona
Persona in San Francisco is seeking passionate engineers to build the data foundation for the identity layer of the internet. As part of the Data Platform team, you will design systems to move and store data at scale, focusing on performance and reliability. With over 3 years of experience in software engineering and skills in Python, Spark, and distributed systems, you’ll tackle high-throughput data processes in a collaborative team environment. Enjoy benefits like unlimited PTO and wellness stipends. #J-18808-Ljbffr Persona
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Platform Engineer — Scale Big Data Lakes & Pipelines in San Francisco, CA vacancy
- ...Software Engineer We are looking for a foundational... ...evolution of our data platform. You will be part... ...warehouse and data lake, using modern cloud... ...GCP, or Azure). Pipeline Development: Develop and scale robust, fault-... ....g., Java, Go). Big Data Expertise: You...PipelineBig data
Crustdata (YC F24)
San Francisco, CA4 days ago - ...financial journey. ABOUT THE TEAM Data Platform Engineers at Rocket Money further our... ...source, design resilient pipelines, and create self‑service... ...practices, and systems that will scale with Rocket Money as it... ...You have experience making big changes to critical data infrastructure...PipelineBig dataTemporary workWork at office
Dormont Manufacturing Company
San Francisco, CA3 days ago $104.33k - $156.49k
...organizations to use data and AI responsibly. Our platform simplifies the... ...Senior Data Platform Engineer will be part of an innovative... ...architecture for scale. Your Mission You... ...and maintain CI/CD pipelines and infrastructure‑as... ...Snowflake, Redshift) and big‑data technologies (...PipelineBig dataWork experience placementWork at officeLocal areaFlexible hours3 days per week1 day per weekI did my part and supported the Regular Toilet
San Francisco, CA4 days ago- DoorDash is seeking a Data Platform Engineer based in the Bay Area to lead the vision and strategy for... ...growing analytics framework. You will scale the platform for increasing data workloads... ...in Computer Science and experience in big-data domains. The role includes...Big data
$135k - $180k
...in real time, at scale, across every screen. Our data exists with the consent... ..., and software engineers to deliver... ...formats such as Delta Lake and Iceberg A deep... ...distributed systems and big data processing... ...of CI/CD pipelines for data platforms Experience working...PipelineBig data$196k - $269.5k
About This Role Our Engineering organization owns... ...work. The Platform group empowers teams... ...Product Engineering, Data Science, Product Management... ...maintenance, and scaling to serve millions... ...data models and pipelines for key domains,... ...concepts, ETLs, big data technologies,...PipelineBig dataWork experience placementWork at officeRemote workMonday to FridayFlexible hours3 days per week- ngrok Inc. is seeking a skilled Engineer to join their Data Platform team. This role focuses on building and maintaining data pipelines, ensuring data accuracy and reliability, and supporting... ...experience with Python, SQL, and large-scale data systems. The position offers a...PipelineRemote job
- Persona is seeking a Senior Engineer for the Data Platform team in San Francisco, California. In this role, you will design and operate systems that manage data at massive scale, working on datalakes and data pipelines. This position demands expertise in software engineering...PipelineFull time
- Garuda Ventures is hiring a Sr Data Engineer to manage petabyte-scale data pipelines that will power Factory OS. The role involves designing data architectures and ensuring data quality across various environments. The ideal candidate should have 5-7 years of data engineering...Pipeline
- ...Francisco, is seeking an experienced analytics engineer to drive key technical projects across... ...will lead the development of scalable data models and enhance data processing quality... ...candidate will have experience in large-scale data processing and be proficient in tools...PipelineWork at office
- ...interactions. Visualize data for business teams.... ...and redesign data pipelines using Kafka streams.... ...between hands-on engineering (50%) and team leadership... ...processing, data platform, data lake, big data, data warehouse,... ...experience with large-scale data loads, feature extraction...PipelineBig dataLocal area
My3Tech Inc
San Francisco, CA1 day ago - ...Job Title: Data Engineer Location: San Francisco,... ...maintain scalable data pipelines and ETL processes... ...on cloud platforms (e.g., AWS, Google... ...model deployment and scaling. Implement monitoring... .... Experience with big data technologies... ...BigQuery, Azure Data Lake). Familiarity with...PipelineBig data
Fullscope
San Francisco, CA20 hours ago - ...looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and... ...thematic research platform that processes... ...Python-based ETL/ELT pipelines, orchestrate... .../ELT processes at scale using Python, incorporating... ...experience with Big Data technologies...PipelineBig dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
San Francisco, CA20 hours ago - ...The Role As a Data Engineer at Air Apps, you... ...and optimizing data pipelines, data warehouses, and data lakes to ensure efficient... ...lakes using cloud platforms such as AWS,... ...Experience with big data frameworks (Apache... ...ability to handle large-scale data challenges ....PipelineBig dataTemporary workWorldwide
Air Apps
San Francisco, CA4 days ago - ...San Francisco, Salt Lake City, Portland,... ...As a Senior Data Engineer, You Will: Design... ...operationalize large-scale enterprise data solutions... ...redesign, and re-platform on-premise data... ..., and deploy data pipelines from ingestion to... ...within a big data architecture...PipelineBig dataRemote workFlexible hoursShift work
xScion Solutions
San Francisco, CA4 days ago $182k - $228k
...collecting and analyzing large‑scale data sets. Your primary... ...developing the data platform that empowers teams to... ..., and maintain data pipelines and reports. If you... ...members to refine the data engineering roadmap and drive... ...Familiarity with Spark or other big data processing...PipelineBig dataFull timeWork at office3 days per week$125.5k - $230.2k
.... Technology – Data and Decision Science – Data Engineering – Manager We are... ...on cloud platforms (e.g., AWS, Azure... ...end-to-end data pipeline development, including... ...with Spark for big data processing... ...clients. Large-Scale Implementation... ...Data Lake Implementation:...PipelineBig dataSummer holidayFlexible hoursErnst & Young Oman
San Francisco, CA2 days ago$224k - $308k
...Machine Learning Platform Engineer, you will help design... ...bridge between data science and production... ...team that scales Faire’s ability to... ...using Spark, Delta Lake, MLflow, and Databricks... ...usage Build CI/CD pipelines for ML using... ...Frameworks PyTorch MLFlow Big Data & Processing...PipelineBig dataWork experience placementLocal area- ...Solutions is hiring a Senior Data Engineer (Apache Spark) in San... ...the design of large-scale distributed data... ...Apache Spark and cloud platforms at APPIT Software in San... ...daily Design data lake and lakehouse architectures... ...-time and batch data pipelines with robust fault-...PipelineFlexible hours
- A prominent car sharing platform in San Francisco seeks a skilled Data Engineer to develop a robust data platform. The successful candidate will work on the orchestration of data pipelines for various teams, mentor junior engineers, and implement security measures. With...Pipeline
$146.4k - $235.38k
...business-critical data that is trapped inside... ...Management platform, companies can create... ...Data and AI Platform Engineer will design, build... ...capabilities at scale. Reporting to the... ...robust platforms, pipelines, and services. This... ...(warehouse, lake/lakehouse, streaming...PipelineContract workWork at officeLocal areaRemote work2 days per weekDocuSign
San Francisco, CA1 day ago- Turo Inc. is looking for a data engineer in San Francisco to build resilient, scalable systems... ...you will focus on developing the data platform for various teams while mentoring... ...relevant experience and expertise in data pipeline orchestration, cloud services, and modern...PipelineWork at office3 days per week
- ...AWS Data Engineer Location: San Francisco and jersey city ( 3 days onsite 2 days... ...Have Skills : Spark, AWS, data lake, data pipelining python Job Description: As... ...Processing: Leverage Spark and other big data technologies to process and analyze...PipelineBig dataRemote work
Apex Informatics
San Francisco, CA1 day ago $120k - $150k
The Opportunity As a Data Engineer, you are passionate and drive excellence across data ingestion... .... Optimize how data gets delivered, and scale our data systems where needed Design... ...observability, usage metrics, and monitoring of the platform Create data tools for the organization...PipelineFull time3 days per week- United States Digital Space LLC is seeking a Software Engineer to build and maintain data infrastructure for processing petabytes of data across millions of users. You will write clean, well-tested code and collaborate closely with teams to deliver innovative solutions....PipelineRelocationRelocation package
- ...Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING /... ...reliable, scalable data pipelines that process over... ...helping architect our data platform and data warehouses to... ...data warehouses, data lakes, or databases. ~... ...Apache Spark or other Big Data frameworks; working...PipelineBig dataFull timeWork experience placement
1872 Consulting
San Francisco, CA2 days ago - ...The Data Engineer will be responsible for collecting, parsing, managing... ..., and secure data pipelines across various platforms. The engineer will ensure... ...Agile ceremonies and follow Scaled Agile processes defined by... ...across traditional ETL and Big Data (on‑prem or cloud). Experience...PipelineBig data
Compunnel
San Francisco, CA15 hours ago - ...Lead Data Engineer With Martech Location: SFO, CA (Hybrid... ..., and activation pipelines. Architect scalable... ...Develop high-performance big-data applications using... ...expertise in MarTech platforms with hands-on experience... ...Experience in large-scale marketing ecosystems (...PipelineBig data2 days per week
Georgia IT Inc
San Francisco, CA20 hours ago $176k - $210k
Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance... ...knowledge of AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,000 - $...PipelineBig data- ...About the job Senior Data Engineer Role: Senior Data Engineer... ...processing, real-time streaming, and pipeline orchestration capabilities.... ...your expertise in solving big data problems, design... ...products and leverage our PB scale data. Our business is data driven...PipelineBig dataWork experience placement
Inizio Partners
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Platform Engineer — Scale Big Data Lakes & Pipelines. Be the first to apply!
Related searches
- senior data center engineer San Francisco, CA
- data operations engineer San Francisco, CA
- data engineer machine learning San Francisco, CA
- remote data engineer San Francisco, CA
- data engineer intern San Francisco, CA
- data systems engineer San Francisco, CA
- data engineer graduate San Francisco, CA
- data science developer San Francisco, CA
- big data engineer San Francisco, CA
- data engineering intern summer San Francisco, CA