Data Engineer
AllSTEM Connections
Job Title: Lead Data Engineer (GCP, Supply Chain & AI Data Platforms)
Role OverviewWe are seeking an experienced and hands-on Lead Data Engineer to join our Enterprise Data & AI Organization. In this role, you will lead the design, development, and delivery of enterprise data products and advanced analytics solutions supporting complex supply chain, sourcing, transportation, and warehouse management (WMS) domains. This is a technical leadership role requiring deep expertise in building modern, cloud-native data platforms on Google Cloud Platform (GCP). You will collaborate closely with Product Managers, Solution Architects, Data Architects, and cross-functional engineering teams to build scalable, high-quality data pipelines that power advanced analytics and AI-driven decision-making. If you excel at designing high-performance data models and driving engineering excellence, we want to hear from you. Key Responsibilities
Data Architecture & Pipeline Development
• Cloud-Native Solutions: Design, develop, and implement scalable data pipelines, architectures, and data products on Google Cloud Platform (GCP).
• Modern Tooling: Build and optimize enterprise data solutions utilizing BigQuery, Dataproc, SQL, and dbt.
• ETL/ELT Engineering: Develop efficient, robust data ingestion and transformation pipelines to integrate data across multiple enterprise operational systems. Data Modeling & Performance Optimization
• Dimensional Modeling: Design scalable data models supporting complex analytical, operational reporting, and AI requirements.
• Performance Tuning: Optimize data processing performance, reliability, scalability, and cost efficiency across cloud data platforms.
• Operational Reliability: Implement rigorous monitoring, automated testing, and operational best practices to support critical production workloads. Technical Leadership & Collaboration
• Cross-Functional Partnership: Work alongside Product Managers, Business Analysts, and Enterprise Architects to translate business requirements into robust technical specifications.
• Code Quality: Lead technical design discussions, drive code reviews, and establish reusable engineering standards and documentation.
• Team Enablement: Participate actively in Agile delivery ceremonies, contribute to backlog refinement, and mentor junior data engineering team members. Qualifications & Requirements
Minimum Qualifications
• Experience Baseline: 8+ years of professional experience in Data Engineering, featuring demonstrated technical leadership on complex enterprise data projects.
• Cloud Mastery: Strong, hands-on production experience designing and deploying data solutions on Google Cloud Platform (GCP).
• Technical Proficiency (Expert Level):
oDataproc & BigQuery
oSQL & dbt (Data Build Tool)
oModern ETL/ELT architecture principles and large-scale data processing techniques.
• Engineering Best Practices: Proven experience with relational/dimensional data modeling, Git version control, and CI/CD automated deployment pipelines.
• Core Competencies: Excellent verbal and written communication skills; strong analytical troubleshooting and problem-solving abilities. Preferred Attributes
• Experience with workflow orchestration frameworks (e.g., Apache Airflow) and streaming data platforms (e.g., Apache Kafka).
• Working knowledge of PySpark for distributed data processing and Python for automation.
• Domain experience within retail, apparel, supply chain data platforms, logistics, transportation, or Warehouse Management Systems (WMS).
• Familiarity with data governance, data quality frameworks, and enterprise metadata management. Equal Opportunity Employer / Disabled / Protected Veterans The Know Your Rights poster is available here:
The pay transparency policy is available here:
For temporary assignments lasting 13 weeks or longer, AllSTEM Connections is pleased to offer major medical, dental, vision, 401k and any statutory sick pay where required. We are committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation for any part of the employment process, please contact your staffing representative who will reach out to our HR team. AllSTEM Connections participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program.
We also consider for employment qualified applicants regardless of criminal histories, consistent with legal requirements, including, if applicable, the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance. Pursuant to applicable state and municipal Fair Chance Laws and Ordinances, we will consider for employment-qualified applicants with arrest and conviction records, including, if applicable, the San Francisco Fair Chance Ordinance. For Los Angeles, CA applicants: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. Additional Skills (none specified)
AllSTEM Representative Contact Info Account Executive:
Nichols
Branch Phone:
View phone number on click.appcast.io
Location:
Ontario, CA
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in San Francisco, CA vacancy
- We are seeking a hands-on Lead Data Engineer to join the Data & AI Supply Chain organization and drive the design, development, and delivery of enterprise-scale data products on Google Cloud Platform (GCP). This role will support Supply Chain initiatives across Sourcing...SuggestedHourly payFreelance
- ...we invest in our employees and our community. Join us in using data, bold thinking, and a commitment to innovation to help clear the... ...accounting, investor reporting, and collections. As a Lead Data Engineer, you'll lead the Financial Data Operations team, owning the pipelines...SuggestedFull timeWork at officeLocal areaRemote workRelocationFlexible hours
- THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...SuggestedWork at office
$140k - $180k
Data Engineer, Data Platform About the RoleWe are building out our Data Platform team at Sigma, with a relentless focus on developing data models that fuel trusted insights across the company. As a Data Platform Engineer, you will be responsible for the underlying data...SuggestedFull timeWork at office$140k - $348k
...anywhere in the world. If you're excited to shape the future of design and collaboration, join us!We are looking for an experienced Data Engineer to partner with our Data Science and Data Infrastructure teams to own and scale our data pipelines. You’ll also work closely...SuggestedMinimum wageFull timeLocal areaRemote workFlexible hours$120.8k - $151k
...dream. We make this a reality by empowering you with the tools, resources, and support you need to grow your career.Data at BrexOur Scientists and Engineers work together to make data — and insights derived from data — a core asset across Brex. But it's more than just...Work at officeRemote workWork from home$100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation package$132.7k - $206.8k
...intelligent agreement management, Docusign unleashes business-critical data that is trapped inside of documents. Until now, these were... ...'ll doDocusign is seeking a talented and results oriented Data Engineer to focus on delivering trusted data to the business. As a member...Contract workWork at officeLocal areaRemote work2 days per week$90.2k - $112.7k
...environmental, and humanitarian sectors. We are both a space company and data company all rolled into one.Customers and users across the... ...hardware design, manufacturing, data processing, and software engineering, our office is a truly inspiring mix of experts from a variety...Full timeTemporary workWork at officeLocal areaRemote workHome office3 days per week$170k - $200k
About the RoleWe're looking for a Data Engineer who wants to operate like a founder. Not someone who wants to spend their time maintaining dashboards, moving tickets across a board, or optimizing pipelines in a mature environment. Someone who sees infrastructure as a product...Work at officeRemote workFlexible hoursShift work$170k - $220k
San Francisco or DenverEngineering /Full-Time /HybridWindfall is seeking a Sr. Data Engineer to join our data team. As a Sr. Data Engineer on our data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and...Full time$128k - $249k
...search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group, designing scalable...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift$150k - $160k
...your opportunity to grow professionally in a dynamic, global environment, surrounded by forward-thinking peers.The role of Senior Data Engineer is essential for the successful modernization of our data platforms and practices. The Senior Data Engineer will collaborate...Full time$185k - $218k
About CheckrCheckr is building the data platform to power safe and fair decisions. Over 140,000 companies and millions of people rely... ...people records powering every Checkr product. As a Senior Data Engineer, you'll lead the execution of core services and data pipelines,...Work at officeLocal areaRemote workRelocation3 days per week$120k - $160k
...expertise, scale, and technology.Job DescriptionData EngineerLocation: San Francisco, CA | HybridWe’re looking for a talented Sr. Data Engineer to join our new Data Platform product team. In this role, you will work closely with our Product, Engineering, Cloud, and...Ongoing contractFull timeCasual workFlexible hours$141.9k - $190.3k
Job Posting Title:Sr Data EngineerReq ID:10153288Job Description:Technology is at the heart of Disney’s past, present, and future.... ...Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists,...Full timeWork experience placement$160k - $260k
...teammates and grow your career as we build the future of global banking. If that sounds like you, let’s build what’s next.Senior Data Engineer Hiring Location: San FranciscoPart 1. Data ModelingDesign and implement robust and scalable data models that support business...Temporary workWork at officeLocal areaWorldwide$160k - $220k
...Lead Data Engineer Location: San Francisco, CA, United States Location Type: On-site Salary Range: 160000 - 220000 USD Annually We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support...- ...Lead Data Engineer The Office of Information Technology (IT) is responsible for enabling State Bar's internal and external stakeholders by the management, implementation, and maintenance of an organization's technology to support of State Bar's mission and goals. The...Work at office
- ...problem you want to work on, we'd like to talk. Your Team The data team at Nuna is an interdisciplinary group spanning data... ...data analytics, actuarial science, and research. Within it, data engineering is the technical backbone which creates the architecture, platform...
- ...Lead Data Engineer The Office of Information Technology (IT) is responsible for enabling State Bar's internal and external stakeholders by the management, implementation, and maintenance of an organization's technology to support of State Bar's mission and goals. The...Work at office
- ...Lead Data Engineer With MarTech Location: SFO, CA (Hybrid 2 days a week) Key Responsibilities Lead end-to-end MarTech engineering initiatives across orchestration, data processing, and activation pipelines. Architect scalable, event-driven systems that power...Remote work2 days per week
- ...Job Title Mandatory Skills: (Oracle or PostgreSQL) and ETL Pipelines and Big Data and AWS Responsibilities • Uses structured tools for analysis and presentation of concepts and models to enhance the BRD • Develop, maintain and deliver training materials to the...Work experience placement
$148k - $185k
...Data Engineer III Los Angeles, California, United States; San Francisco, CA, United States About Crunchyroll Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate community. We super-serve over 100 million anime and manga fans across...Flexible hours$180k - $260k
...by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion... ...business and bring people together through commerce. Role Data is crucial to Whatnot's mission to bring people together through...Full timeWork at officeLocal areaRemote workWork from homeHome office- ...Data Engineer Responsibilities: Develop and automate large scale, high-performance data processing systems (batch and/or streaming) to drive Airbnb business growth and improve the product experience. Build scalable Spark data pipelines leveraging Airflow scheduler...
- ...veterans and innovative thinkers. We don't believe culture can be engineered - but when it falls into place, it's a once-in-a-lifetime... ...felt so present. Position Overview We're looking for a data engineer to help us turn raw driving data into the well-structured...Local areaFlexible hours
- ...Data Engineer This is a foundational infrastructure role at a company where the data layer isn't a back-office function — it's the nervous system of a payments platform processing every agent transaction, policy decision, and risk signal in real time. The right person...
- ...to close the gap between America's surging demand for housing, data centers, manufacturing hubs, and the construction industry's growing... ...You'll collaborate with construction veterans and world-class engineers to solve physical-world problems that simulations can't touch....Work at officeFlexible hours
- ...Our Client, an American Multinational Clothing and Accessories Retailer company, is looking for a Data Engineer for their San Francisco, CA location. Responsibilities: Design, develop, and maintain scalable ETL/ELT data pipelines on Google Cloud Platform...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data platform engineer San Francisco, CA
- aws data engineer San Francisco, CA
- data engineer graduate San Francisco, CA
- big data devops engineer San Francisco, CA
- big data developer San Francisco, CA
- software data engineer San Francisco, CA
- data center engineer San Francisco, CA
- big data cloud engineer San Francisco, CA
- director data engineering San Francisco, CA
- hadoop big data developer San Francisco, CA

