Senior Data Engineer
InterSources Inc
Sr. Data Engineer (SCM)
Location: Bay Area, CA (Hybrid/Remote) Duration: Long Term Contract
Description:
- Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)
- Apply proven expertise and build high-performance scalable data warehouses
- Securely source external data from numerous partners
- Intelligently design data models for optimal storage and retrieval
- Deploy inclusive data quality checks to ensure high quality of data
- Optimize existing pipelines and maintain of all domain-related data pipelines
- Ownership of the end-to-end data engineering component of the solution
- Experience in creation of data pipelines using Python.
- Python for data manipulation & transformation (python dictionaries, data frames, data stream, joins of all kinds, outside of SQL IDEs)
- Research skills – go figure it out and come back with working model. Pros/cons analysis skills
- Strong work ethic, independent problem-solving skills, self-motivated, comfortable with startup culture
- Excellent and crisp communicator
- Must have domain experience in supply chain (E-commerce /manufacturing etc)
Minimum Qualifications:
- BS/MS in Computer Science or a related technical field
- 10+ years of Python or other modern programming language development experience
- 10+ years of SQL and relational databases experience
- 10+ years experience in custom ETL design, implementation and maintenance
- 5+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Digdag, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
$180k - $220k
.../yr We're currently working on behalf of an early stage start-up who are leveraging AI to modernize the data engineering industry. They're looking for a Senior Data Engineer to join their team in San Francisco and work on PB scale data pipelines, scaling their cloud...SeniorEvolve Group, Inc.
San Francisco, CA2 days ago- ...Job Description Snowflake data engineering to support LEAPS We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes...Senior
Insight Global
San Francisco, CA1 day ago - ...Francisco, CA, with a global presence across the United States, EMEA, and APAC. Role Overview RZR Global is seeking a talented Data Engineer to join our growing engineering team. This role is ideal for an engineer with a strong background in building and operating large...Senior
RZR Global Inc.
San Francisco, CA4 days ago $160k - $260k
...relationships. Yes, you can build an exciting business AND have real-life real-customer impact. Responsibilities We are looking for a Data Engineer or Analytics Engineer to join our Data team. You will collaborate with the data scientist and engineers to design, build, and...SeniorWork experience placementLocal areaKikoff
San Francisco, CA1 day ago- ...Title: Senior Snowflake Data Engineer Location: Santa Clara, CA -95054 (5 days onsite) Duration: Longterm Contract Note: Need only local resource as in person interview required. Senior Snowflake Data Engineer - Key Requirements: • Strong hands...SeniorContract workLocal area
E-Solutions
San Francisco, CA3 days ago - ...Job Description Description: We're seeking a Senior Data Engineer to build and own our data platform and infrastructure. You will design systems that power transaction processing, analytics, reporting, and real-time insights across our global financial product...SeniorFlexible hours
Serene Healthcare Staffing
San Francisco, CA3 days ago $150k - $250k
...boundaries of AI-driven communication. If you're ready to own data strategy at a high-growth AI company, this is your chance to... ...for our AI—it’s the foundation of everything we build. As Senior Data Engineer , you won’t just clean datasets and maintain pipelines. You’...SeniorFull timeRemote workFlexible hoursGloo
San Francisco, CA1 day ago- ...world's most complex manufacturing and logistics operations. Our Data Engineers are the backbone of that mission — designing, building, and... ...operating the data infrastructure that powers our AI products. As a Senior Data Engineer on our India engineering team, you will own the...Senior
Comcage LLC DBA Oodle
San Francisco, CA5 days ago - ...Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING / FULL-TIME What Will You Be Doing? Building fast, reliable, scalable data pipelines that process over billions of historical data points collected from tens of thousands of retail stores across the US which...SeniorFull timeWork experience placement
1872 Consulting
San Francisco, CA4 days ago $135k - $220k
...federal government filings and proprietary data sources to prevent fraud, accelerate... ...great. You’re hungry to become an elite data engineer, designing rock-solid infrastructure that... ...$135k – $220k + Equity - 0.05% – 0.25% Seniority level Mid‑Senior level Employment...SeniorFull timeWork at officeFlexible hours3 days per weekBASELAYER
San Francisco, CA1 day ago$154k - $186k
...real growth. How we work at Aircall: We’re customer-obsessed, data-driven, and focused on delivering meaningful outcomes. We value... ...impact matter, you’ll feel at home here. About the role The Data Engineering team at Aircall works on providing high-quality, reliable, and...SeniorWorldwideAircall
San Francisco, CA2 days ago$180k - $220k
...truth for operational metrics, customer‑facing reports, billing, actionable insights, and a host of business‑critical KPIs. As a Data Engineer in the Data Engineering team, you will own the tooling, frameworks, data pipelines, integrations, databases, schemas and the...SeniorFinix Payments Inc
San Francisco, CA2 days ago$160k - $240k
...About The Role Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together’s mission‑critical systems. As a Senior Data Engineer, you will work with our Data and...SeniorFull timeTogether AI
San Francisco, CA3 days ago$155k - $185k
...Denver, San Francisco, and New York, we support more than 500,000 small businesses nationwide. Role Overview We’re looking for a Senior Data Engineer who can take loosely defined problems and drive them end-to-end—from framing the problem and aligning stakeholders to...SeniorWork at office2 days per week3 days per weekGusto
San Francisco, CA2 days ago$160k - $210k
...and showcase their collections in a personalized online showroom from anywhere in the world. About The Role We are seeking a Senior Data Engineer to strengthen Arena Club’s strategic decision‑making, enhance operational performance, and integrate data across the company...SeniorArena Club
San Francisco, CA2 days ago$139.2k - $232.6k
...Jacobs is seeking a Senior Engineering Authority in San Francisco, CA to lead telecommunications and ICT systems in data center projects. You will be responsible for design delivery, managing subcontractors, and ensuring project quality through inspections and engineering...SeniorFor subcontractorFlexible hoursJacobs
San Francisco, CA1 day ago$170k - $220k
...Windfall is seeking a Sr. Data Engineer to join our data team. As a Sr. Data Engineer on our data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you...SeniorWindfall
San Francisco, CA4 days ago- ...About the job Senior Data Engineer Role: Senior Data Engineer We are seeking a Sr Data Engineer for our Data feeds team to provide batch data processing, real-time streaming, and pipeline orchestration capabilities. You'll be part of the Data Technology...SeniorWork experience placement
Inizio Partners
San Francisco, CA5 days ago - ...Well-known technology platform company is looking for a Senior Data Engineer to join a growing team. In this role you will work directly with stakeholders to understand their data needs, build and maintain production pipelines, and deliver high-quality data sets that...Senior
Strategic Employment
San Francisco, CA2 days ago $190k - $220k
...founder & former CEO of LiveRamp and Datavant, the two biggest data companies of the last 20 years), and are backed by... ...scale in both data size and complexity, we are looking for a senior data engineer to help us enhance and scale this core part of our platform....SeniorWork at officeRemote workFlexible hours2 days per weekArbital Health, Inc.
San Francisco, CA2 days ago- ...We're looking for a data guru to build product features and run analyses on top of our massive data set (7,000+ companies first-party... ...data enrichment & tagging. Requirements 6+ years of analytics engineering, data engineering, data science, or other highly analytical,...Senior
Varos Research
San Francisco, CA1 day ago $147.4k - $272.1k
...Senior Data Engineer Work Locations (3) Submit Resume Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what...SeniorRelocationApple
San Francisco, CA4 days ago$300 per month
...Employment Type Full time Location Type On-site Department Cloud Engineering Crusoe's mission is to accelerate the abundance of energy and... ...infrastructure. About This Role: Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire on our growing central Data...SeniorFull timeTemporary workEpoch Biodesign
San Francisco, CA2 days ago- ...to redefine computing. About the Role We\'re seeking our first data analytics hire to establish and own the data foundation for our... ...Background in AI infrastructure or related technical domains Data engineering skills or familiarity with data pipeline development Experience...SeniorFull time
Hyperbolic
San Francisco, CA1 day ago $240k - $300k
...Senior Data Engineer At EliseAI, we're improving the industries that matter most: housing and healthcare. Everyone needs a place to live and access to quality healthcare, yet both are often harder to secure than they should be. By integrating AI agents deeply into...SeniorWork at officeLocal areaRelocationEliseai
San Francisco, CA4 days ago- ...game, every matchmaking decision, and every payout, which means the data infrastructure powering those systems has to be fast, reliable, and built to scale. As our first dedicated data engineering hire, you'll own the full data stack: ingestion, transformation, warehouse...Senior
Triumph Arcade, Inc
San Francisco, CA3 days ago $100k - $196k
...About this role: Senior Data Engineer The Data, Analytics and Reporting Technology team is responsible for a cross-cutting set of capabilities within the Global Operations at Wells Fargo. The AI/ML Data Architecture, Engineering and Enablement team is seeking a Senior...SeniorWork experience placementWork at officeRemote workFlexible hoursWells Fargo
San Francisco, CA2 days ago- ...You're driven. You're an xScioneer. Location: Los Angeles, San Francisco, Salt Lake City, Portland, Seattle As a Senior Data Engineer, You Will: Design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue...SeniorRemote workFlexible hoursShift work
xScion Solutions
San Francisco, CA1 day ago $130k - $196.5k
...You will Design, build, and optimize scalable data processing pipelines using Spark, Airflow, and related big data technologies to... ...and authoring solution selection and design documents. Champion engineering best practices (code reviews, testing strategies, CI/CD, security...SeniorWork from homeFlexible hoursNight shiftLiveRamp
San Francisco, CA1 day ago- ...Senior Data Engineer We are seeking a Senior Data Engineer to design, build, and scale data systems that power analytics, reporting, and data-driven decision-making across the organization. In this role, you'll own core data infrastructure, enable reliable data pipelines...SeniorRemote workFlexible hours
Tangerine Search, Inc.
San Francisco, CA13 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- remote data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- big data devops engineer San Francisco, CA
- data engineer San Francisco, CA
- data engineer contract San Francisco, CA
- software data engineer San Francisco, CA
- data engineer graduate San Francisco, CA
- big data cloud engineer San Francisco, CA
- junior big data engineer San Francisco, CA
- sr information security engineer San Francisco, CA