Senior Data Engineer
InterSources Inc
Sr. Data Engineer (SCM)
Location: Bay area, CA (Hybrid/Remote) Duration: Long term contract
Description:
- Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)
- Apply proven expertise and build high-performance scalable data warehouses
- Securely source external data from numerous partners
- Intelligently design data models for optimal storage and retrieval
- Deploy inclusive data quality checks to ensure high quality of data
- Optimize existing pipelines and maintain of all domain-related data pipelines
- Ownership of the end-to-end data engineering component of the solution
- Experience in creation of data pipelines using Python.
- Python for data manipulation & transformation (python dictionaries, data frames, data stream, joins of all kinds, outside of SQL IDEs)
- Research skills – go figure it out and come back with working model. Pros/cons analysis skills
- Strong work ethic, independent problem-solving skills, self-motivated, comfortable with startup culture
- Excellent and crisp communicator
- Must have domain experience in supply chain (E-commerce /manufacturing etc)
Minimum Qualifications:
- BS/MS in Computer Science or a related technical field
- 10+ years of Python or other modern programming language development experience
- 10+ years of SQL and relational databases experience
- 10+ years experience in custom ETL design, implementation and maintenance
- 5+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Digdag, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
- ...Insight Global is seeking a Senior Data Engineer to support their Data Strategy & Operations function. This fully remote role focuses on building and managing data integration patterns into Data 360, ensuring reliable data ingestion, and collaborating with cross-functional...SeniorRemote work
Insight Global
San Francisco, CA1 day ago - ...A fintech company is seeking a Senior Data Engineer to lead the design and implementation of scalable data pipelines using Python in a cloud environment. This fully remote role requires experience with Databricks, AWS, and Delta Lake. The ideal candidate will have a Bachelor...SeniorRemote work
Plum Inc
San Francisco, CA1 day ago - ...Job Description Description: We're seeking a Senior Data Engineer to build and own our data platform and infrastructure. You will design systems that power transaction processing, analytics, reporting, and real-time insights across our global financial product...SeniorFlexible hours
Serene Healthcare Staffing
San Francisco, CA2 days ago - ...Title: Senior Snowflake Data Engineer Location: Santa Clara, CA -95054 (5 days onsite) Duration: Longterm Contract Note: Need only local resource as in person interview required. Senior Snowflake Data Engineer - Key Requirements: • Strong hands...SeniorContract workLocal area
E-Solutions
San Francisco, CA2 days ago - ...Francisco, CA, with a global presence across the United States, EMEA, and APAC. Role Overview RZR Global is seeking a talented Data Engineer to join our growing engineering team. This role is ideal for an engineer with a strong background in building and operating...Senior
RZR Global Inc.
San Francisco, CA3 days ago - ...Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING / FULL-TIME What Will You Be Doing? Building fast, reliable, scalable data pipelines that process over billions of historical data points collected from tens of thousands of retail stores across the US which...SeniorFull timeWork experience placement
1872 Consulting
San Francisco, CA8 days ago $226k - $254k
...and work relationships. Yes, you can build an exciting business AND have real-life real-customer impact. We are looking for a Data Engineer or Analytics Engineer to join our Data team. You will collaborate with the data scientist and engineers to design, build, and...SeniorWork experience placementLocal areaKikoff
San Francisco, CA1 day ago- ...We are seeking a skilled and experienced Senior Data Engineer to join our innovative team. The ideal candidate will bring deep expertise in modern data engineering technologies, strong collaboration skills, and a solid understanding of the financial services sector. Beyond...SeniorContract work
GrabJobs
San Francisco, CA1 day ago - ...game, every matchmaking decision, and every payout, which means the data infrastructure powering those systems has to be fast, reliable, and built to scale. As our first dedicated data engineering hire, you'll own the full data stack: ingestion, transformation, warehouse...Senior
Triumph Arcade, Inc
San Francisco, CA2 days ago $25 per hour
...Data Engineer Point is building a modern and aspirational banking experience by bringing rewards and benefits to the everyday debit card. We are looking for a data engineer to pioneer the data team at Point and be responsible for building out the data pipelines and...SeniorWork experience placementWork at officeWork from homeFlexible hoursPoint Defunct
San Francisco, CA3 days ago- ...About the job Senior Data Engineer Role: Senior Data Engineer We are seeking a Sr Data Engineer for our Data feeds team to provide batch data processing, real-time streaming, and pipeline orchestration capabilities. You'll be part of the Data Technology...SeniorWork experience placement
Inizio Partners
San Francisco, CA3 days ago $180k - $195k
...company is backed by climate-tech and Silicon Valley investors. For more information, please visit Role Description As a Senior Data Engineer at Gridware, you'll design and scale the data infrastructure that powers our real-time grid monitoring platform. You'll...SeniorGridware
San Francisco, CA3 days ago$160k - $240k
...Senior Data Engineer San Francisco About the Role Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together's mission-critical systems. As a Senior...SeniorFull timeTogether AI
San Francisco, CA2 days ago- ..., General Catalyst, GV, and Accel and enjoy a multi-year runway. About The Role: We're looking for an entrepreneurial Data Engineer with interest in agentic AI and at least 5 years of general engineering experience who wants to make an impact as one of the founding...SeniorTemporary workWork at officeFlexible hours
Sprinter Health
San Francisco, CA2 days ago $130k - $200k
...real growth. How we work at Aircall: We're customer-obsessed, data-driven, and focused on delivering meaningful outcomes. We value... ..., you'll feel at home here. About the role The Data Engineering team at Aircall works on providing high-quality, reliable, and...SeniorWorldwideAircall
San Francisco, CA2 days ago- ...Title: Senior Data Engineer Location: San Francisco, California Work Type: Hybrid Job Type: Contract Key Responsibilities: Design, develop, optimize, and maintain enterprise data pipelines and data warehouse solutions. Build and support ETL/ELT processes...SeniorContract workWork at office
Cogent Data Solutions
San Francisco, CA1 day ago $180k - $220k
...truth for operational metrics, customer-facing reports, billing, actionable insights, and a host of business-critical KPIs. As a Data Engineer in the Data Engineering team, you will own the tooling, frameworks, data pipelines, integrations, databases, schemas and the...SeniorFlexible hoursFinix
San Francisco, CA3 days ago$147.4k - $272.1k
...Senior Data Engineer Work Locations (3) Submit Resume Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what...SeniorRelocationApple
San Francisco, CA3 days ago- ...Title: Senior Data Engineer - Platform Engineering Location: San Francisco, Los Angeles, or Dallas - Hybrid (Requires three days/week in our San Francisco, Los Angeles or Dallas office) Type: Full-time Reports to : Director of Data Engineering...SeniorFull timeWork at officeFlexible hours3 days per week
Kaav Inc.
San Francisco, CA2 days ago $204.5k - $267k
...Senior Data Engineer Formation Bio is a tech and AI driven pharma company differentiated by radically more efficient drug development. Advancements in AI and drug discovery are creating more candidate drugs than the industry can progress because of the high cost and...SeniorWork at officeLocal areaRelocation3 days per weekFormation Bio (Formerly TrailSpark)
San Francisco, CA3 days ago$150k - $220k
...center of this effort, collaborating across engineering, design, research, and education to... ...Content & AI Systems team is building the data layer that powers the next generation of... ...geographic location, prior experience, seniority, and demonstrated role related ability during...SeniorPermanent employmentFull timeLocal areaFlexible hoursKiddom
San Francisco, CA1 day ago$165k - $175k
...headquartered in New York City with offices around the world. To learn more, go to The Role We're looking for a Senior Data Engineer to design, build, and operate the data pipelines and aggregates that power Zeta's AdTech platform. This is a hands-on...SeniorZeta Global
San Francisco, CA8 hours ago- ...Job Description Senior Data Engineer Principal, Lead on site Client is building a global consumer neobank, merging banking, payments, and crypto into a single product. Our initial focus is emerging markets, where traditional banking and local currencies fail...SeniorLocal areaFlexible hours
Simple Solutions
San Francisco, CA3 days ago $185k - $221.4k
...ll Do Build and own production data infrastructure. Design, implement, and operate... ...shape at the right time. Uphold high engineering standards and collaborate broadly. Lead... ...innovation. Autonomy. Small, senior teams give you room to architect and own...SeniorRemote workFlexible hoursForesite Labs
San Francisco, CA1 day ago$15 per hour
...200,000+ volunteer contributors. The Wikimedia Foundation’s Data Platform team enables this global knowledge ecosystem through... ...access to data for research, feature development, and . As a Senior Data Engineer for our Data Platform, you will shape the future of how...SeniorFor contractorsLocal areaRemote workCloudDevs
San Francisco, CA1 day ago$240k - $300k
...Senior Data Engineer At EliseAI, we're improving the industries that matter most: housing and healthcare. Everyone needs a place to live and access to quality healthcare, yet both are often harder to secure than they should be. By integrating AI agents deeply into...SeniorWork at officeLocal areaRelocationEliseAI
San Francisco, CA3 days ago$190.58k
...values-aligned partners; we provide deep, data-driven insights into people, places, and... ...the Position You're a mission-driven data engineer with a track record of building... ...every box! Location and Compensation The Senior Data Engineer is a full-time, salaried position...SeniorFull timeImmediate startRemote workHome officeFlexible hoursGrabJobs
San Francisco, CA2 days ago- ...meaningful impact—both together and individually. Job Summary We are seeking a candidate with experience as, or applicable to, a Senior Data Engineer role with significant demonstrated experience using Python in a cloud environment to lead the design and implementation of...SeniorWork experience placementRemote work
Plum Inc
San Francisco, CA4 days ago $196k - $220.5k
...people to talk and hang out before, during, and after playing games. Discord is looking for an experienced and passionate Senior Data Engineer, Analytics to join our data team! You will be owning the transformation and semantic layer that turns data into clean, tested...SeniorFull timeDiscord
San Francisco, CA3 days ago$180k - $260k
...Engineer data systems that change how people live and work. As a senior data engineer at Gallup, you'll play a key role in designing, developing and optimizing the data systems that underpin our flagship platform, Gallup Access. You'll use your enterprise-level data...SeniorWork at office3 days per weekGallup
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- director data engineering San Francisco, CA
- junior big data engineer San Francisco, CA
- data engineer graduate San Francisco, CA
- senior data engineer San Francisco, CA
- data platform engineer San Francisco, CA
- sr information security engineer San Francisco, CA
- senior data integration developer San Francisco, CA
- data developer San Francisco, CA
- data engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA