Senior Data Engineer
InterSources Inc
Sr. Data Engineer (SCM)
Location: Bay Area, CA (Hybrid/Remote) Duration: Long Term Contract
Description:
- Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)
- Apply proven expertise and build high-performance scalable data warehouses
- Securely source external data from numerous partners
- Intelligently design data models for optimal storage and retrieval
- Deploy inclusive data quality checks to ensure high quality of data
- Optimize existing pipelines and maintain of all domain-related data pipelines
- Ownership of the end-to-end data engineering component of the solution
- Experience in creation of data pipelines using Python.
- Python for data manipulation & transformation (python dictionaries, data frames, data stream, joins of all kinds, outside of SQL IDEs)
- Research skills – go figure it out and come back with working model. Pros/cons analysis skills
- Strong work ethic, independent problem-solving skills, self-motivated, comfortable with startup culture
- Excellent and crisp communicator
- Must have domain experience in supply chain (E-commerce /manufacturing etc)
Minimum Qualifications:
- BS/MS in Computer Science or a related technical field
- 10+ years of Python or other modern programming language development experience
- 10+ years of SQL and relational databases experience
- 10+ years experience in custom ETL design, implementation and maintenance
- 5+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Digdag, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
$170k - $220k
San Francisco or DenverEngineering /Full-Time /HybridWindfall is seeking a Sr. Data Engineer to join our data team. As a Sr. Data Engineer on our data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and...SeniorFull time$130k - $170k
...paced. We’re looking for talented, entrepreneurially minded and data-driven people who also have a passion for helping people do... ...Sutter St, San Francisco, CA). About the RoleWe're hiring a Senior Data Engineer to build the data foundation for a new discovery-stage team focused...SeniorSeasonal workH1bWork at officeImmediate startFlexible hours$128k - $252.5k
...programs that transform our clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with clients to design and... ....Working with a team of interdisciplinary data scientists, engineers, architects, and consultants, our work includes novel areas such...SeniorLocal area- ...ensure that our team members have what they need to do their best work — both in and out of the office. We are looking for a Senior Data Engineer - Hardware & Supply Chain (Manufacturing) to join our Data Engineering & Analytics team. Your primary focus will be building...SeniorWork at officeLocal areaRemote workFlexible hours
$190k - $220k
...by role and will be assessed during the interview process.The Data Engineering team builds tools and systems that make Gusto's data... ...customized experiences to our customers.We're looking for a Senior Data Engineer who can take loosely defined problems and drive...SeniorFull timeWork at officeLocal area2 days per week3 days per week- ...we ensure that our team members have what they need to do their best work — both in and out of the office. We are looking for a Data Engineer - Finance to join our Data Engineering & Analytics team. Your primary focus will be building and owning the data infrastructure...SeniorWork at officeLocal areaRemote workFlexible hours2 days per week1 day per week
- ...offices in New York, Washington D.C., London and Amsterdam.Making data-driven decisions is key to Plaid's culture. To support that, we... ...data. We provide golden datasets and tooling to teams across engineering, product, and business and help them explore our data quickly...SeniorFull timeWork experience placementLocal areaFlexible hours
$185k - $218k
About CheckrCheckr is building the data platform to power safe and fair decisions. Over 140,000 companies and millions of people... ...and people records powering every Checkr product. As a Senior Data Engineer, you'll lead the execution of core services and data pipelines...SeniorWork at officeLocal areaRemote workRelocation3 days per week$160k - $260k
...exceptional teammates and grow your career as we build the future of global banking. If that sounds like you, let’s build what’s next.Senior Data Engineer Hiring Location: San FranciscoPart 1. Data ModelingDesign and implement robust and scalable data models that support...SeniorTemporary workWork at officeLocal areaWorldwide$128k - $249k
...our search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group,...SeniorFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift- ...Drata is looking for a Senior Data Engineer in San Francisco to join its fast-growing data team. You will help build and optimize data products, contribute to data governance, and work with cutting-edge technologies to ensure data accuracy across the organization. The...Senior
Careers at Drata
San Francisco, CA4 days ago $225k - $290k
...forYou will define and drive the strategy for data reliability, quality, and operational... ...failure across the data landscape. As a senior technical leader, you will also guide cross... ...investments, define best-in-class data engineering practices, and lead complex, high-impact...SeniorFlexible hours- ...We are partnering with a large consumer marketplace platform to find a Senior Data Engineer to join their growing data engineering team in San Francisco. In this role you will own the data pipeline infrastructure for a key business domain, working directly with stakeholders...Senior3 days per week
Strategic Employment Partners
San Francisco, CA12 hours ago - Job Title This job is no longer available. Employer is willing to sponsor qualified candidates for a non-immigrant work visa. Preferred Skills All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age,...SeniorLocal areaWork visa
Circadia Health
San Francisco, CA4 days ago - ...DocuSign is seeking a Sr. Data Engineer to deliver trusted data to the business as part of the Global Data Analytics team. You will design, develop, and deliver data pipelines, transform large data sets, and load data into Snowflake using modern ETL tools and cloud platforms...Senior
Unavailable
San Francisco, CA4 days ago $155.8k - $233.6k
...is being written today — and we’re just getting started.Role OverviewWe’re looking for a versatile Senior Analytics Engineer focusing on Product to architect event data models that power decision-making at Harvey. With product-market fit already proven and demand surging...SeniorImmediate startFlexible hours$160k - $240k
...Togetherai in San Francisco is hiring a Senior Data Engineer to design and build data infrastructure handling millions of events. You will work with cross-functional teams developing real-time analytics systems and contributing to the company's mission of advancing AI...SeniorTogetherai
San Francisco, CA17 hours ago- ...have built a platform that uses AI to transform publicly available data into real time operational insights. With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and...SeniorImmediate start
Next Ventures
San Francisco, CA12 hours ago - ...Senior Data Migration Engineer Trident Consulting is seeking a Senior Data Migration Engineer for one of our clients in Austin, TX / SF Bay Area, CA (3 days office a week). A global leader in business and technology services. Role: Senior Data Migration Engineer...SeniorContract workWork at office3 days per week
Trident Consulting
San Francisco, CA3 days ago - ...Francisco, CA, with a global presence across the United States, EMEA, and APAC. Role Overview RZR Global is seeking a talented Data Engineer to join our growing engineering team. This role is ideal for an engineer with a strong background in building and operating large...Senior
Aarki
San Francisco, CA17 hours ago - ...Chime is hiring a Senior Software Engineer in Data Engineering based in San Francisco, CA. This position involves building scalable data pipelines and frameworks to support data-driven decision-making. The ideal candidate will have 5+ years of experience in data transformation...Senior
Chime
San Francisco, CA4 days ago - ...with one of the most recognised developer platforms in the world, trusted by engineering teams at OpenAI, Meta, Netflix, and Adobe, who are scaling their data platform and looking to hire a Senior Data Engineer to own the pipelines and foundations at the core of their...Senior
Harnham
San Francisco, CA4 days ago $165k - $215k
...like a16z, General Catalyst, GV, and Accel and enjoys multi-year runway.About the RoleWe’re looking for an Analytics Engineer to build the trusted data layer that analysts, data scientists, operations, finance, product, and our payer customers depend on.At Sprinter, data...SeniorTemporary workWork at officeMonday to FridayMonday to Thursday- ...Data Engineering Role at Triumph Triumph is a skill-based real-money gaming platform in a period of rapid growth. Real money flows through every game, every matchmaking decision, and every payout, which means the data infrastructure powering those systems has to be...Senior
Triumph
San Francisco, CA3 days ago - ...We are seeking an experienced, highly skilled Senior Cloud Data Engineer to support an Investment Operations and Fund Treasury Data Engineering team. The ideal candidate will bring strong experience in asset management or financial services , be comfortable evaluating...Senior
Mainz Brady Group
San Francisco, CA15 hours ago $25 per hour
...Data Engineer Point is building a modern and aspirational banking experience by bringing rewards and benefits to the everyday debit card. We are looking for a data engineer to pioneer the data team at Point and be responsible for building out the data pipelines and...SeniorWork experience placementWork at officeWork from homeFlexible hoursPoint Defunct
San Francisco, CA3 days ago- ...sDesign, develop, and maintain scalable data pipelines and ETL/ELT processes .Deploy, configure, and administer CockroachDB clusters... ...tuning, indexing, and schema design .Collaborate with software engineers, data scientists, and product teams to define data requirements...Senior
Simplify Software Experts LLC/ Simpli Software Solutions Inc
San Francisco, CA4 days ago - ...Title: Senior Data Engineer - Platform Engineering Location: San Francisco, Los Angeles, or Dallas - Hybrid (Requires three days/week in our San Francisco, Los Angeles or Dallas office) Type: Full-time Reports to : Director of Data Engineering...SeniorFull timeWork at officeFlexible hours3 days per week
Kaav Inc.
San Francisco, CA2 days ago $160k - $240k
...About the Role Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together’s mission-critical systems. As a Senior Data Engineer, you will work with our Data and...SeniorFull timeTogetherai
San Francisco, CA1 day ago$15 per hour
...200,000+ volunteer contributors. The Wikimedia Foundation’s Data Platform team enables this global knowledge ecosystem through... ...access to data for research, feature development, and . As a Senior Data Engineer for our Data Platform, you will shape the future of how...SeniorFor contractorsLocal areaRemote workCloudDevs
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data center engineer San Francisco, CA
- senior cloud data engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA
- sr information security engineer San Francisco, CA
- hadoop big data developer San Francisco, CA
- data visualization developer San Francisco, CA
- remote data engineer San Francisco, CA
- etl data engineer San Francisco, CA
- data engineer analytics San Francisco, CA
- sr data engineer San Francisco, CA