Senior Data Engineer
InterSources
Sr. Data Engineer (SCM)
Location: Bay Area, CA (Hybrid/Remote) Duration: Long Term Contract
Description:
- Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)
- Apply proven expertise and build high-performance scalable data warehouses
- Securely source external data from numerous partners
- Intelligently design data models for optimal storage and retrieval
- Deploy inclusive data quality checks to ensure high quality of data
- Optimize existing pipelines and maintain of all domain-related data pipelines
- Ownership of the end-to-end data engineering component of the solution
- Experience in creation of data pipelines using Python.
- Python for data manipulation & transformation (python dictionaries, data frames, data stream, joins of all kinds, outside of SQL IDEs)
- Research skills – go figure it out and come back with working model. Pros/cons analysis skills
- Strong work ethic, independent problem-solving skills, self-motivated, comfortable with startup culture
- Excellent and crisp communicator
- Must have domain experience in supply chain (E-commerce /manufacturing etc)
Minimum Qualifications:
- BS/MS in Computer Science or a related technical field
- 10+ years of Python or other modern programming language development experience
- 10+ years of SQL and relational databases experience
- 10+ years experience in custom ETL design, implementation and maintenance
- 5+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Digdag, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
$133.1k - $236.4k
...intelligent, connected tools that empower creators and teams to move faster without sacrificing craft. We are looking for a Senior Data Engineer who will build a strong and scalable foundation to support it. Join us and build Adobe’s future products! What you'll Do...SeniorFull timeTemporary workLocal areaWorldwide- ...A leading technology solutions provider is seeking an experienced CommVault Systems Engineer in San Francisco, California. The role involves designing, developing, and supporting data protection and recovery solutions for a federal government enterprise's environment....SeniorFull time
CGS Federal (Contact Government Services)
San Francisco, CA1 day ago - Drata is looking for a Senior Data Engineer in San Francisco to join its fast-growing data team. You will help build and optimize data products, contribute to data governance, and work with cutting-edge technologies to ensure data accuracy across the organization. The...Senior
Careers at Drata
San Francisco, CA3 hours ago - ...A pioneering AI company in San Francisco is seeking a Data Analyst to establish the data foundation for a growing GPU marketplace. This person will collaborate directly with leadership to define and deliver critical metrics that drive business decisions. Candidates should...Senior
Hyperbolic
San Francisco, CA3 hours ago $177.8k - $240.5k
Amazon is hiring a skilled data engineer in San Francisco, CA, to leverage cloud technologies and AI/ML for data insights. The role requires over 5 years of experience in data engineering, SQL, and building ETL pipelines, focusing on large datasets and autonomous frameworks...SeniorAmazon
San Francisco, CA4 hours ago- CloudZero is seeking a Senior Software Engineer to own the backend data processing, storage, and query infrastructure powering our analytics platform in San Francisco. You'll design scalable data models, pipelines, and a custom query engine, collaborating with engineers...Senior
CloudZero
San Francisco, CA3 hours ago - Federato is building an AI-native insurance platform and seeks a data engineer to join a small, high-impact team within the AI/ML org. You’ll help design robust ETL pipelines, scalable data infrastructure, and internal frameworks that enable ML engineers to deploy and iterate...Senior
Federato
San Francisco, CA3 hours ago - DocuSign is seeking a Sr. Data Engineer to deliver trusted data to the business as part of the Global Data Analytics team. You will design, develop, and deliver data pipelines, transform large data sets, and load data into Snowflake using modern ETL tools and cloud platforms...Senior
Unavailable
San Francisco, CA4 hours ago - WEX Inc. is looking for a Senior Software Engineer to join the Semantic Data Lake Team in San Francisco. This role focuses on designing, building, and maintaining scalable data models and transformation pipelines, applying modern AI coding tools to enhance productivity...Senior
WEX
San Francisco, CA4 hours ago - Chime is hiring a Senior Software Engineer in Data Engineering based in San Francisco, CA. This position involves building scalable data pipelines and frameworks to support data-driven decision-making. The ideal candidate will have 5+ years of experience in data transformation...Senior
Chime
San Francisco, CA4 hours ago - ...Well-known technology platform company is looking for a Senior Data Engineer to join a growing team. In this role you will work directly with stakeholders to understand their data needs, build and maintain production pipelines, and deliver high-quality data sets that...Senior
Strategic Employment
San Francisco, CA2 days ago - ...Senior Data Migration Engineer Trident Consulting is seeking a Senior Data Migration Engineer for one of our clients in Austin, TX / SF Bay Area, CA (3 days office a week). A global leader in business and technology services. Role: Senior Data Migration Engineer...SeniorContract workWork at office3 days per week
Trident Consulting
San Francisco, CA4 days ago $160k - $260k
...relationships. Yes, you can build an exciting business AND have real-life real-customer impact. Responsibilities We are looking for a Data Engineer or Analytics Engineer to join our Data team. You will collaborate with the data scientist and engineers to design, build, and...SeniorWork experience placementLocal areaKikoff
San Francisco, CA1 day ago$160k - $200k
...operates autonomous delivery systems that rely on accurate engineering product data. Every prototype, production build, supplier order, repair,... ...records, part numbers, ECAD models, and BOM data. As the Senior ECAD Library & Engineering Data Engineer, you will own...SeniorLocal areaZipline
San Francisco, CA10 days ago- ...to redefine computing. About the Role We\'re seeking our first data analytics hire to establish and own the data foundation for our... ...Background in AI infrastructure or related technical domains Data engineering skills or familiarity with data pipeline development Experience...SeniorFull time
Hyperbolic
San Francisco, CA1 day ago - ...game, every matchmaking decision, and every payout, which means the data infrastructure powering those systems has to be fast, reliable, and built to scale. As our first dedicated data engineering hire, you'll own the full data stack: ingestion, transformation, warehouse...Senior
Triumph Arcade, Inc
San Francisco, CA3 days ago $125.5k - $147.6k
Are you ready to make an impact? West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design, build, and optimize modern cloud data platforms that enable advanced analytics, AI, and business intelligence. Working with technologies...SeniorWork at officeLocal areaImmediate startFlexible hours$160k - $210k
...workflows into a single proven system. Federato drives better business outcomes. Role Overview You’ll be joining a small, high-impact data engineering team within Federato’s AI/ML organization. Our focus is on building the infrastructure and internal frameworks that empower...SeniorFederato
San Francisco, CA1 day ago$180k - $195k
...Senior Data Engineer Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid. We pioneered a groundbreaking new class of grid management called active grid response (AGR), focused on monitoring the electrical,...SeniorLocal areaGridware
San Francisco, CA3 days ago$151.7k - $205.3k
Job Summary Drata is looking for a Senior Data Engineer! This person will be a key member of the growing data team, supporting one of the fastest…growing B2B SaaS startups to achieve unicorn status. Data accuracy is an essential cornerstone of our mission. We are looking...SeniorFlexible hoursDrata
San Francisco, CA3 hours ago- Gong is seeking a Senior Analyst, Analytics engineering to empower our analytics community by building, maintaining, and governing a data warehouse of operational and financial data. You’ll partner with Data Ops to develop a semantic layer and AI-driven self-service analytics...Senior
3M HEALTHCARE
San Francisco, CA4 hours ago $180k - $225k
...Senior Data Engineer Headway's mission is to fix the issue of most providers not accepting insurance, making therapy too expensive for most people. We started by solving the biggest barrier to care: insurance. The admin work - credentialing, claims, payment reconciliation...SeniorWork from homeFlexible hoursHeadway - Design & Development
San Francisco, CA3 days ago- ...to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse architectures supporting a thematic research platform that...SeniorWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
San Francisco, CA1 day ago - ...Title: Senior Data Engineer - Platform Engineering Location: San Francisco, Los Angeles, or Dallas - Hybrid (Requires three days/week in our San Francisco, Los Angeles or Dallas office) Type: Full-time Reports to : Director of Data Engineering...SeniorFull timeWork at officeFlexible hours3 days per week
Kaav Inc.
San Francisco, CA3 days ago $150.4k - $277.6k
...Senior Data Engineer Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you can accomplish. We are seeking...SeniorRelocationApple
San Francisco, CA4 days ago- ...Senior Data Engineer Kiddom is transforming K–12 education by bringing high-quality curriculum, instructional tools, and student analytics together in one coherent system. We are building Learning Intelligence Technology (LIT), a new category that gives educators the...SeniorPermanent employmentFull timeWork experience placementLocal areaFlexible hours
Kiddom
San Francisco, CA2 days ago $185k - $221.4k
...ll Do Build and own production data infrastructure. Design, implement, and operate... ...shape at the right time. Uphold high engineering standards and collaborate broadly. Lead... ...innovation. Autonomy. Small, senior teams give you room to architect and own...SeniorRemote workFlexible hoursForesite Labs
San Francisco, CA2 days ago- ...Senior Data Engineer As a Senior Data Engineer at Regard, you will own the design, development, and production deployment of the data services that power the Regard platform. From ingesting and standardizing clinical data across health systems to making it reliably...SeniorWork at officeLocal areaHome officeVisa sponsorshipRelocation package
REGARD
San Francisco, CA3 days ago - Consultant, Software Development About the Opportunity We’re looking for a Senior Data Engineer – Snowflake & Azure with 10+ years of experience in database development and data engineering, including 4–5 years hands‑on with Snowflake and building production data pipelines...SeniorLocal area
Granite Solutions Groupe
San Francisco, CA3 hours ago - Checkr, Inc. is seeking a Senior Data Engineer to lead the People Data platform initiatives in San Francisco. You will design and ship data pipelines, scale core services, and ensure data accuracy across identity records powering Checkr products. You will collaborate with...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer San Francisco, CA
- big data engineer San Francisco, CA
- big data developer San Francisco, CA
- remote data engineer San Francisco, CA
- big data devops engineer San Francisco, CA
- finance data engineer San Francisco, CA
- sr information security engineer San Francisco, CA
- junior big data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- senior data engineer San Francisco, CA