Senior Data Engineer | Python/PySpark & Scalable Pipelines
Enexus Global
A data services company is seeking a Sr Data Engineer local to the Bay Area. The role requires strong expertise in Python and PySpark, along with a solid understanding of data structures and algorithms. Key responsibilities include developing data-processing solutions, collaborating with teams to enhance the data platform, and implementing process improvements. This position requires at least 15 years of experience and includes one day onsite a week in Oakland or San Ramon. #J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer | Python/PySpark & Scalable Pipelines in Oakland, CA vacancy
- ...Gusto is seeking a Senior Data Engineer in San Francisco passionate about building reliable, scalable, and high-quality data systems. In this role, you will collaborate closely... ...of experience, strong skills in SQL and Python, and familiarity with cloud platforms. Gusto...PipelineSenior
Prudence Holdings Inc
San Francisco, CA4 days ago - ...software company is seeking a Senior Software Developer to join their Enterprise Data Engineering & Visualization team.... ...role involves designing scalable data solutions and optimizing data pipelines using various technologies like SQL and Python. The ideal candidate will...PipelineSenior
Autodesk
San Francisco, CA3 days ago $190k - $220k
...Gusto in Seattle is seeking a Senior Data Engineer to drive end-to-end data solutions across analytics, product, and engineering teams... ...The role requires 8-10+ years of experience in building scalable data pipelines, strong SQL and programming skills, and a solid...PipelineSeniorWork at office2 days per week3 days per weekGusto
San Francisco, CA3 days ago- ...Komodo Health is seeking a Senior Data Engineer based in San Francisco, California. The role focuses on building and optimizing data pipelines that power their Healthcare Map and analytics... ...experience with data pipelines, AWS, Python, and SQL, and is comfortable using...PipelineSenior
Komodo Health
San Francisco, CA3 days ago $160k - $260k
...Kikoff, a thriving FinTech unicorn based in San Francisco, is seeking a Data Engineer or Analytics Engineer. The role involves collaborating to craft and scale data models, ensuring data quality, and building analytical dashboards. Ideal candidates should have a strong...PipelineSeniorKikoff
San Francisco, CA3 days ago$190.8k - $286.8k
...Plaid is seeking a Data Engineer in San Francisco who will lead data engineering projects and enable faster business decisions through... ...candidate has over 4 years of experience in building data models and pipelines on large datasets, enjoys modern tools like SQL, DBT, and...PipelineSeniorPlaid
San Francisco, CA3 days ago- ...Towards AI, Inc. is looking for a Senior Data Engineer based in Richmond, CA. This role supports the design, development, and maintenance of data infrastructure to ensure efficient data flow across various systems. The ideal candidate will have at least five years of...PipelineSeniorRemote work
Towards AI, Inc.
Richmond, CA4 days ago - ...A tech company in California seeks a Data Engineer to design and develop robust data models and pipelines. The candidate must have a Bachelor's degree in Computer... ...experience in building data pipelines using Python and Pyspark. The role involves collaborating with...PipelineSenior
TheCorporate
Oakland, CA4 days ago - ...Overview Sr Data Engineer. Strong Python and PySpark. Good with Data Structures and algorithms. Local to the... ...usability, re-designing for greater scalability. Provide technical support and... ...Experience building and optimizing data pipelines in a distributed environment...PipelineSeniorLocal area
Enexus Global
Oakland, CA4 days ago - Insight Global in San Francisco is looking for a skilled data engineer with at least 5 years of Snowflake experience to support LEAPS. The company fosters an inclusive environment that values diversity and is committed to equal opportunity employment. Qualified candidates...PipelineSenior
- Insight Global is seeking a Senior Data Engineer to support their Data Strategy & Operations function. This fully remote role focuses on building and managing data integration patterns into Data 360, ensuring reliable data ingestion, and collaborating with cross-functional...PipelineSeniorRemote job
$146.5k - $228k
Scribd, Inc. is looking for a Senior Software Engineer in San Francisco to design and optimize large-scale data pipelines on AWS. Ideal candidates should have 7+ years of experience... ...in backend development and proficiency in Python. Responsibilities include leading projects...PipelineSeniorFlexible hours- ...design and develop the ontology (data model) and data pipelines. Design, implement, and maintain robust... ...– responsible for using Python and Pyspark to perform ETL and derive new datasets... ...Bachelor's Degree in Computer Science, Engineering, or related field or related...PipelineSenior
TheCorporate
Oakland, CA3 days ago - ...experience in Analytics Engineering, Data Engineering, Data... ...in advanced SQL, Python scripting, and Apache Spark (PySpark, Spark SQL) for... ...optimizing ETL pipelines, using modern tools... ...job involves As a Senior Analytics Engineer... ...maintain reliable, scalable ETL pipelines and...PipelineSenior
Robinhood
San Francisco, CA4 days ago $180k - $250k
...operational continuity, and data-driven decision-... ..., where your data engineering expertise... ...integration, and pipeline development, ensuring... ...processing using PySpark or ML data engineering... ...skills to build scalable, production-grade... .... Proficiency in Python or a comparable language...PipelineSeniorFull timeWork at officeCerebras
San Francisco, CA3 days ago- ...NimbleRx in San Francisco is seeking a Senior Data Engineer to own and optimize the data... ...experience in data engineering, fluency in Python (PySpark) and SQL, and a strong foundation... ...technologies. You will build scalable data pipelines and interact with various...PipelineSenior
NimbleRx
San Francisco, CA1 day ago - A robotics technology company based in Berkeley is seeking a Data Pipeline Engineer to design and maintain scalable data pipelines for their logistics robots. The ideal candidate has over 5 years of Python experience, proficiency in GCP/AWS/Azure, and is familiar with...PipelineSenior
- ...Reporting to the Principal Data Engineer, you will be instrumental... ...infrastructure, enabling robust data pipelines and reliable data access... ...: Build and maintain scalable and resilient pipelines to... ..., advanced SQL, dbt, Python (pandas, PySpark), Terraform, orchestration...PipelineSeniorWork at office
City and County of San Francisco
San Francisco, CA3 days ago - ...collecting diverse robot teleoperation data as well as human data at large scale and... ...1st 2024 Design, develop, and maintain scalable data pipelines and ETL processes to extract, transform... ...configuring GCP (Vertex), AWS, Azure Python: 5+ years of experience Machine Learning...PipelineSeniorImmediate start
$132k - $182k
...talk. The Global Data & Insights Team... ...building reliable pipelines, scalable data platforms, and... ..., and the engineering foundations that... ...at scale. The Senior Analytics Engineer... ...~ Exposure to Python, R, or data processing... ...frameworks (e.g., PySpark) is a plus ~ Experience...PipelineSeniorLocal areaImmediate startWorldwideFlexible hoursOkta, Inc.
San Francisco, CA22 hours ago$132k - $182k
...Senior Analytics Engineer, Marketing Opportunity We are seeking... ...of our marketing data engine. You will... ...into a trusted, scalable framework for... ...Marketing metrics (e.g., pipeline, campaign... ...practices Exposure to Python, R, or data... ...frameworks (e.g., PySpark) is a plus Experience...PipelineSeniorImmediate startFlexible hoursOkta for Developers
San Francisco, CA3 days ago- ...Senior Data Engineer (1043) – DataSF – Office of City Administrator Full‑time... ...democratization and privacy. Pipeline Development: Build and maintain scalable, resilient pipelines to... ...and dbt experience. Strong Python skills (pandas, PySpark). Proficiency with Terraform...PipelineSeniorPermanent employmentFull timeWork at office
Zuckerberg San Francisco General
San Francisco, CA1 day ago - ...Senior Data Engineer (1043) – DataSF – Office of City Administrator Employment... ..., ensuring robust data pipelines and reliable data access... ...: Build and maintain scalable, resilient pipelines for... ...transformation. Programming in Python (pandas, PySpark) for data processing....PipelineSeniorPermanent employmentFull timeTraineeshipWork at office
City-and-County-of-SAN-Francisc
San Francisco, CA11 hours ago - ...Comcage LLC DBA Oodle is seeking a Senior Data Engineer to design and maintain scalable data pipelines that support their AI-driven supply chain solutions. This role demands strong Python and SQL skills along with a significant experience in data engineering and production...PipelineSenior
Comcage LLC DBA Oodle
San Francisco, CA1 day ago - ...DataSF Job class: 1043 Senior Data Engineer Role type: Permanent... ...to build robust and scalable data infrastructure to... ..., enabling robust data pipelines and reliable data access... ...programming skills in Python (with libraries like pandas, PySpark) for data processing and...PipelineSeniorPermanent employmentFull timeTraineeshipWork experience placementSecond jobWork at officeImmediate start
City and County of San Francisco
San Francisco, CA22 hours ago $172.5k - $260.1k
...Salesforce, Inc. is seeking a skilled Data Engineer for the Enterprise team in San... ...role involves designing and building scalable data pipelines to support significant enterprise clients... ...architecture skills, expertise in SQL and Python, and experience with tools like...PipelineSenior100 Salesforce, Inc.
San Francisco, CA3 days ago$150k - $180k
...health-focused organization is seeking a Data Engineer to design and maintain data infrastructure... ...in AWS, data modeling, and strong SQL and Python skills. The role includes responsibilities such as managing ETL/ELT pipelines and ensuring data integrity. This full-time...PipelineSeniorFull timePopHealth Learning Center
Oakland, CA4 days ago- ...mobile advertising company in San Francisco is seeking a Data Engineer to join its engineering team. This role involves designing... ...experience in data engineering, a strong background in building scalable data pipelines, and proficiency in technologies such as Kafka and Spark....PipelineSenior
Aarki
San Francisco, CA4 days ago - ...WEX Inc. is looking for a Senior Software Engineer to join the Semantic Data Lake Team in San Francisco.... ...building, and maintaining scalable data models and transformation pipelines, applying modern AI coding... ...engineering, expertise in SQL and Python, and a strong understanding...PipelineSenior
WEX
San Francisco, CA11 hours ago - ...Harnham is seeking a Senior Data Engineer in San Francisco to take ownership of the data pipelines essential to their data ecosystem. The candidate will design and implement scalable ingestion architectures, ensuring data accuracy and compliance with financial standards...PipelineSenior
Harnham
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer | Python/PySpark & Scalable Pipelines. Be the first to apply!
Related searches
- data engineering intern summer Oakland, CA
- data science developer Oakland, CA
- senior data center engineer Oakland, CA
- data developer Oakland, CA
- junior data engineer remote Oakland, CA
- data engineer Oakland, CA
- finance data engineer Oakland, CA
- data center engineer Oakland, CA
- senior cloud data engineer Oakland, CA
- data engineer machine learning Oakland, CA