Senior Data Engineer: Data Lakes & Airflow Pipelines
AgileEngine
AgileEngine is seeking a Senior Data Engineer to design scalable data lakes, warehouses, and lakehouse architectures that support a thematic research platform handling large volumes of financial data daily. You will implement Python-based ETL/ELT pipelines, orchestrate with Airflow, and work with Snowflake, Spark, and AWS to deliver high-performance data infrastructure. This role blends hands-on engineering with technical consulting responsibilities. #J-18808-Ljbffr AgileEngine
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer: Data Lakes & Airflow Pipelines in San Francisco, CA vacancy
- ...London and Amsterdam.Making data-driven decisions is key... ...to teams across engineering, product, and business... ...We use tools like DBT, Airflow, Redshift, Atlan, and Retool... ...to orchestrate data pipelines and define workflows. We... ...pipelines that power our data lake and data warehouse.Well...PipelineSeniorFull timeWork experience placementLocal areaFlexible hours
- CoreWeave is seeking a Senior Data Engineer to own and evolve the data lake and analytics stack powering observability for its global hardware... ...data lake infrastructure (Iceberg, Trino, Airflow, Spark, Superset) and ETL pipelines while delivering ad-hoc analyses and...PipelineSenior
- DoorDash is seeking a Senior Data Engineer to enhance its data infrastructure and automate scaling operations. This hybrid role requires candidates to be based in Sunnyvale, San Francisco, or Seattle. The successful candidate will have significant experience in data engineering...PipelineSenior
- ..., develop, and maintain scalable data pipelines and ETL/ELT processes .Deploy, configure... ....Collaborate with software engineers, data scientists, and product... ...data warehousing and modern data lake architectures .Experience with Airflow, dbt, or similar orchestration tools...PipelineSenior
$200k - $250k
...Ambience runs on data: which clinicians... ...verify—is a hard data engineering problem, and it's... ...you'll own. As a Senior Data Engineer, you... ...build and run the pipelines that ingest clinical... ...pipelines, data lakes, or warehouses in... ...orchestration tools (Airflow, Dagster), or BI...PipelineSeniorWork at officeImmediate startRemote workFlexible hoursAmbience Healthcare
San Francisco, CA4 days ago- ...DoorDash success. The Data Engineering team builds database solutions... .... By implementing pipelines, data structures, and... ...is looking for a Senior Data Engineer to be a... ...and pipelines for Data Lake and Data WarehouseDevelop... ...management tools like Airflow, Flink, Oozie and...PipelineSeniorHourly payWork at officeLocal areaRemote workFlexible hours
$170k - $200k
...size to advertise on TV. As a Senior Data Engineer in our Reporting and Measure... ...own the large-scale data pipelines that turn high-volume raw data... ...We use Databricks and Delta Lake here Experience with... ...orchestration tools such as Airflow, including DAG design, backfills...PipelineSeniorWork at office2 days per week- ...you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse architectures... ...You will implement Python-based ETL/ELT pipelines, orchestrate workflows with Airflow, develop ingestion workflows from third-...PipelineSeniorWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...Software Engineer We are looking for a foundational... ..., and evolution of our data platform. You will be part... ...warehouse and data lake, using modern cloud technologies... ..., GCP, or Azure). Pipeline Development: Develop... ...using tools like Airflow, Dagster, or Prefect....PipelineSenior
Crustdata (YC F24)
San Francisco, CA3 days ago - Senior Data Engineer San Francisco, CA Hybrid About us Metriport is an open... ...You've built and scaled data pipelines and systems, with hands-on... ...improving our warehouse, data lake, and ETL/ELT architecture so... ..., or orchestration tooling (Airflow, Dagster). Experience...PipelineSeniorWork at officeRemote workWork from homeRelocationFlexible hours
$120k - $145k
...Operating System unifies data, insights, and... ...of your career. As a Senior Analyst, Analytics engineering , you’ll enable our... ...San Francisco, Salt Lake City, Chicago, or New... ...building complex data pipelines using engineering... ...practices in platforms like Airflow or Prefect Strong...PipelineSeniorRemote workWork from homeFlexible hours- About the Team Data is at the foundation... ...success. The Data Engineering team builds database... .... By implementing pipelines, data structures,... ...is looking for a Senior Data Engineer to be... ...pipelines for Data Lake and Data Warehouse... ...tools like Airflow, Flink, Oozie and...PipelineSeniorHourly payLocal areaFlexible hours
$172.5k - $260.1k
...Job Category Software Engineering Job Details About Salesforce... ...We are looking for a Data Engineer who thrives at... ...SQL and scalable pipelines, and coach partners on... ...'s stack: SQL, Python, Airflow, AWS, Spark, Tableau, Hadoop... ...leadership across data lake, data warehouse,...PipelineSenior$225k - $290k
...drive the strategy for data reliability, quality,... ...data landscape. As a senior technical leader, you... ...define best-in-class data engineering practices, and lead... ...including data modeling, pipeline design, and... ...technologies such as Astronomer (Airflow), BigQuery, dbt,...PipelineSeniorFlexible hours$185k - $218k
...CheckrCheckr is building the data platform to power safe and fair... ...every Checkr product. As a Senior Data Engineer, you'll lead the execution of core services and data pipelines, delivering reliable, high-quality... ..., Spark, Iceberg, and data lakes, and the AWS stack (EKS, EMR,...PipelineSeniorWork at officeLocal areaRemote workRelocation3 days per week$101k - $186.75k
Senior Data Engineer | Activision Blizzard MediaCategory OtherLocation San Francisco, California, United... ....ResponsibilitiesBuild scalable data pipelines and services.Understand the business... ...in building a data warehouse and data lake.Knowledge of advertising platforms.Culture...PipelineSeniorFull timeTemporary workPart timeLocal areaRelocation package$130k - $200k
...: We're customer-obsessed, data-driven, and focused on delivering... ...About the role The Data Engineering team at Aircall works on providing... ...and scalability of our data pipelines. You will work closely with... ...and management tools (dbt, Airflow). ~ Solid understanding of...PipelineSeniorWorldwideAircall.io, Inc.
San Francisco, CA3 days ago$160k - $260k
...sounds like you, let’s build what’s next.Senior Data Engineer Hiring Location: San FranciscoPart 1.... ...Truth) throughout the data layers and pipelines.Maintain data consistency,... ...Platform (GCP), specifically BigQuery and Airflow.Excellent problem-solving skills, with...PipelineSeniorTemporary workWork at officeLocal areaWorldwide$200k - $400k
...every payout, which means the data infrastructure powering those... ...As our first dedicated data engineering hire, you'll own the full data... ..., warehouse architecture, pipeline reliability, and the systems... ...with orchestration tooling (Airflow, Dagster, Prefect, or similar...PipelineSeniorTriumph
San Francisco, CAmore than 2 months ago$77k - $202k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging... ...developing and implementing data pipelines, data integration, and data... ...architecture strategies. As a Senior Associate you analyze... ...Boston; MO-St. Louis; UT-Salt Lake City; TX-San Antonio; CA-San...PipelineSeniorFull timeH1b$180k - $220k
...leveraging AI to modernize the data engineering industry. They're looking for a Senior Data Engineer to join their team... ...Francisco and work on PB scale data pipelines, scaling their cloud... ...optimization Commercial exposure to Airflow, DBT, Prefect or other similar tools...PipelineSenior- ...leading consumer marketplace platform to find a Senior Data Engineer in San Francisco. In this pivotal role, you will manage data pipelines and collaborate with business stakeholders... ...particularly in orchestration tools like Airflow or Jenkins, and the ability to build...PipelineSenior
$60 - $70 per hour
...healthcare technology company to hire a Data Engineer, Senior for its Data Services team. This... ...design, build, and operate complex data pipelines and cloud data solutions, embedding security... ...such as dbt, Snowflake, Databricks, Airflow, or Tidal. Solid knowledge of data...PipelineSeniorContract workReleady
San Francisco, CA24 days ago- Komodo Health is seeking a Senior Data Engineer to design, build, and operate large-scale data pipelines powering the Healthcare Map. You will transform diverse healthcare... .../ML use cases. You’ll work with Python, SQL, Airflow, Spark, and AWS, driving reliability, observability...PipelineSeniorRemote job
- Tatari is seeking a Senior Data Engineer to own end-to-end data pipelines for reporting and measurement. You will design, build and operate large-scale ETL processes... .../PySpark, and experience with Databricks and Delta Lake, plus a Hybrid RTO in SF to collaborate in person....PipelineSenior
- Ambience Healthcare, Inc. in San Francisco is seeking a Senior Data Engineer to own the data pipelines that ingest clinical and operational data, model it... ..., SQL, Python, and modern tools like Dagster, dbt, and Airflow. #J-18808-Ljbffr Ambience Healthcare, Inc.PipelineSeniorRemote job
$124k - $280k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging... ...developing and implementing data pipelines, data integration, and data... ...future business needs. As a Senior Manager you lead large... ...Boston; MO-St. Louis; UT-Salt Lake City; TX-San Antonio; CA-San...PipelineSeniorFull timeH1b- Airwallex is seeking a Senior Data Engineer in San Francisco to design scalable data models and end‑to‑end ETL pipelines that power BI, ML, and operations. You’ll collaborate with... ...experience, plus strong SQL, GCP BigQuery, and Airflow skills. This role emphasizes governance,...PipelineSenior
- ...in San Francisco is searching for a Senior Analytics Engineer to oversee the analytics layer end-to... ...dbt models and orchestrating data pipelines while ensuring data quality across the... ...modeling, and orchestration tools like Airflow or dbt Cloud. The position offers a...PipelineSenior
- ...consumer marketplace platform to find a Senior Data Engineer to join their growing data engineering... .... In this role you will own the data pipeline infrastructure for a key business... ...experience Production experience with Airflow, Luigi, Jenkins, or comparable workflow...PipelineSenior3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: Data Lakes & Airflow Pipelines. Be the first to apply!
Related searches
- data platform engineer San Francisco, CA
- aws data engineer San Francisco, CA
- data engineer graduate San Francisco, CA
- big data devops engineer San Francisco, CA
- big data developer San Francisco, CA
- software data engineer San Francisco, CA
- data center engineer San Francisco, CA
- big data cloud engineer San Francisco, CA
- director data engineering San Francisco, CA
- hadoop big data developer San Francisco, CA