Senior Data Engineer
InterSources
Sr. Data Engineer (SCM)
Location: Bay Area, CA (Hybrid/Remote) Duration: Long Term Contract
Description:
- Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)
- Apply proven expertise and build high-performance scalable data warehouses
- Securely source external data from numerous partners
- Intelligently design data models for optimal storage and retrieval
- Deploy inclusive data quality checks to ensure high quality of data
- Optimize existing pipelines and maintain of all domain-related data pipelines
- Ownership of the end-to-end data engineering component of the solution
- Experience in creation of data pipelines using Python.
- Python for data manipulation & transformation (python dictionaries, data frames, data stream, joins of all kinds, outside of SQL IDEs)
- Research skills – go figure it out and come back with working model. Pros/cons analysis skills
- Strong work ethic, independent problem-solving skills, self-motivated, comfortable with startup culture
- Excellent and crisp communicator
- Must have domain experience in supply chain (E-commerce /manufacturing etc)
Minimum Qualifications:
- BS/MS in Computer Science or a related technical field
- 10+ years of Python or other modern programming language development experience
- 10+ years of SQL and relational databases experience
- 10+ years experience in custom ETL design, implementation and maintenance
- 5+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Digdag, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
$190k - $220k
...by role and will be assessed during the interview process.The Data Engineering team builds tools and systems that make Gusto's data... ...customized experiences to our customers.We're looking for a Senior Data Engineer who can take loosely defined problems and drive...SeniorFull timeWork at officeLocal area2 days per week3 days per week- ...ensure that our team members have what they need to do their best work — both in and out of the office. We are looking for a Senior Data Engineer - Hardware & Supply Chain (Manufacturing) to join our Data Engineering & Analytics team. Your primary focus will be building...SeniorWork at officeLocal areaRemote workFlexible hours
- ...Seattle, Washington D.C., Raleigh, London, and Amsterdam.Making data-driven decisions is key to Plaid's culture. To support that, we... ...data. We provide golden datasets and tooling to teams across engineering, product, and business and help them explore our data quickly and...SeniorFull timeWork experience placementWork at officeLocal areaFlexible hours
$172.5k - $260.1k
...Salesforce.The TeamThe Metrics Foundations team is part of Slack's Data Engineering organization within Data & Insights and works closely with... ...targeted SLAs (service-level agreements).The ExperienceAs a Senior Data Engineer, you play a critical role in building the...SeniorFull time$211k - $290.5k
...At Faire, we're using the power of tech, data, and machine learning to connect this thriving... ...that help our customers thrive.As a Senior Applied AI/ML Scientist on the Listing Quality... ...for data scientists and machine learning engineers, and you will help take us there!What you...SeniorWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week- ...Strava, Inc. is seeking a Senior Data Engineer to join our Data Team and help design and operate scalable data pipelines, models, and governance across our data lake and data warehouse. You will contribute to data ingestion, quality, privacy, and GDPR workflows while...SeniorWork at officeFlexible hours3 days per week
Strava
San Francisco, CA2 hours ago $128k - $249k
...our search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group,...SeniorFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift$160k - $260k
...exceptional teammates and grow your career as we build the future of global banking. If that sounds like you, let’s build what’s next.Senior Data Engineer Hiring Location: San FranciscoPart 1. Data ModelingDesign and implement robust and scalable data models that support...SeniorTemporary workWork at officeLocal areaWorldwide- ...Senior Data EngineerWe're seeking a Senior Data Engineer to build and own our data platform and infrastructure. You will design systems that power transaction processing, analytics, reporting, and real-time insights across our global financial product. You will work on...SeniorFlexible hours
Serene Healthcare Staffing
San Francisco, CA3 days ago - ...Data Engineering RoleAs our first dedicated data engineering hire, you'll own the full data stack: ingestion, transformation, warehouse architecture, pipeline reliability, and the systems that connect model outputs back to production. You'll work at the intersection of...Senior
Triumph
San Francisco, CA3 days ago $180k - $200k
...industry for decades is now at the epicenter of sustaining the global economy. About the role Mytra is looking for a Senior Data Software Engineer to build the data platform that the rest of our software reads from. Every robot and station puts out about 2 MB/s of...SeniorHourly payWork at officeMytra
Brisbane, CA5 days ago$155.8k - $233.6k
...is being written today — and we’re just getting started.Role OverviewWe’re looking for a versatile Senior Analytics Engineer focusing on Product to architect event data models that power decision-making at Harvey. With product-market fit already proven and demand surging...SeniorImmediate startFlexible hours$185.5k - $232k
...individual plays a key part in our mission to bring new treatments to patients faster and more efficiently. About The Position As a Senior Data Engineer at Formation Bio, you will build the trusted data systems that support clinical operations, drug asset evaluation, business...SeniorWork at officeLocal areaRelocation3 days per weekFormation Bio
San Francisco, CA2 days ago$185k - $221.4k
...ll Do Build and own production data infrastructure. Design, implement, and operate... ...shape at the right time. Uphold high engineering standards and collaborate broadly. Lead... ...innovation. Autonomy. Small, senior teams give you room to architect and own...SeniorRemote workFlexible hoursForesite Labs
San Francisco, CA4 days ago- ...Senior Data Engineer As a Senior Data Engineer at Regard, you will own the design, development, and production deployment of the data services that power the Regard platform. From ingesting and standardizing clinical data across health systems to making it reliably...SeniorWork at officeLocal areaHome officeVisa sponsorshipRelocation package
REGARD
San Francisco, CA5 days ago - ...Title: Senior Data Engineer - Platform Engineering Location: San Francisco, Los Angeles, or Dallas - Hybrid (Requires three days/week in our San Francisco, Los Angeles or Dallas office) Type: Full-time Reports to : Director of Data Engineering...SeniorFull timeWork at officeFlexible hours3 days per week
Kaav Inc.
San Francisco, CA5 days ago $150.4k - $277.6k
...Senior Data Engineer Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you can accomplish. We are seeking...SeniorRelocationApple
San Francisco, CA1 day ago$196k - $269.5k
...fragmented and offline. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of... ...work closely with Data Scientists, Product Analysts and Software Engineers to support product launches and roadmaps by designing and building...SeniorWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$165k - $215k
...like a16z, General Catalyst, GV, and Accel and enjoys multi-year runway.About the RoleWe’re looking for an Analytics Engineer to build the trusted data layer that analysts, data scientists, operations, finance, product, and our payer customers depend on.At Sprinter, data...SeniorTemporary workWork at officeMonday to FridayMonday to Thursday- ...Senior Data Engineer RoleWe're looking for a data engineer who can operate at a Senior level:You've built and scaled data pipelines and systems, with hands-on experience across the ecosystem — distributed processing, lakehouses, warehouses, streaming, orchestration. You...SeniorWork at officeRemote workWork from homeRelocation
Metriport Inc
San Francisco, CA3 days ago - ...visionary AI projects into reality. About the Role We're seeking a data analytics lead to establish and own the data foundation for our... ...in AI infrastructure or related technical domains Data engineering skills or familiarity with data pipeline development Experience...Senior
Hyperbolic Labs
San Francisco, CA2 days ago - ...getting started. The Role: Ambience runs on data: which clinicians are adopting the product, how... ...and in a form a customer can verify-is a hard data engineering problem, and it's the one you'll own. As a Senior Data Engineer, you'll build and run the pipelines...SeniorWork at officeImmediate startRemote workFlexible hours
Ambience Healthcare
San Francisco, CA2 days ago - ...critical minerals in circulation. About the Role Our central data and analytics team builds and operates the data pipelines that... ..., analytics, and automation across Redwood. This is a hands-on engineering role: the majority of our work is code-based data pipelining...SeniorFull time
Redwood Materials
San Francisco, CA5 days ago $164k
...About the Role The Data engineering team has been created keeping in mind the importance and criticality of data for the overall success of Chime. The mission of this group is to build scalable data artifacts and insights that enable accurate, governed, data-driven...SeniorFull timeWork at officeLocal areaRemote workNight shiftChime Financial
San Francisco, CAmore than 2 months ago$124k - $280k
...LevelSenior ManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...that meet current and future business needs. As a Senior Manager you lead large projects, innovate processes, and maintain...SeniorFull timeH1b$180k - $220k
...00/yr We're currently working on behalf of an early stage start-up who are leveraging AI to modernize the data engineering industry. They're looking for a Senior Data Engineer to join their team in San Francisco and work on PB scale data pipelines, scaling their cloud...Senior- ...mission is to supercharge every function at Zipline with the data they need to optimize every day We design and build... ...scheduling and dispatch, to customer delivery, and more As a Senior Analytics Engineer, you are the owner of analytics infrastructure and datasets...SeniorFlexible hours3 days per weekEarly shift
ZipLine
San Francisco, CA3 days ago $130.6k - $192k
...About the Team Data is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including reporting, product... ...About the Role DoorDash is looking for a Senior Data Engineer to be a technical powerhouse to...SeniorHourly payWork at officeLocal areaRemote workFlexible hoursDoordash Usa
San Francisco, CAmore than 2 months ago$133.1k - $236.4k
...intelligent, connected tools that empower creators and teams to move faster without sacrificing craft. We are looking for a Senior Data Engineer who will build a strong and scalable foundation to support it. Join us and build Adobe’s future products! What you'll Do...SeniorFull timeTemporary workLocal areaWorldwide- ...have built a platform that uses AI to transform publicly available data into real time operational insights. With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and...SeniorImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data engineer contract San Francisco, CA
- big data cloud engineer San Francisco, CA
- staff data engineer San Francisco, CA
- big data developer San Francisco, CA
- finance data engineer San Francisco, CA
- software data engineer San Francisco, CA
- data engineer intern San Francisco, CA
- data systems engineer San Francisco, CA
- hadoop big data developer San Francisco, CA
- data engineer machine learning San Francisco, CA