Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer II - QuantumBlack, AI by McKinsey (Critical Industries)

McKinsey & Company

QUALIFICATIONSU.S. Citizenship is required for this role (you must be able to be staffed on Critical Industries work which includes Government, Defense, Aerospace, Utilities, etc.)Degree in Computer Science, Business Analytics, Engineering, Mathematics, or related field2+ years of professional experience in data engineering, software engineering, or adjacent technical rolesProficiency in Python, Scala, or Java for production-grade pipelines, with strong skills in SQL and PySparkHands-on experience with cloud platforms such as (AWS, GCP, Azure, Oracle) and modern data storage/warehouse solutions such as Snowflake, BigQuery, Redshift, and Delta LakePractical experience with Databricks, AWS Glue, and transformation frameworks like dbt, Dataform, or Databricks Asset BundlesKnowledge of distributed systems such as (Spark, Dask, Flink) and streaming platforms (Kafka, Kinesis, Pulsar) for real-time and batch processingFamiliarity with workflow orchestration tools such as (Airflow, Dagster, Prefect), CI/CD for data workflows, and infrastructure-as-code (Terraform, CloudFormation)Understanding of DataOps principles including pipeline monitoring, testing, and automation, with exposure to observability tools such as Datadog, Prometheus, and Great ExpectationsExposure to ML platforms such as (Databricks, SageMaker, Vertex AI), MLOps best practices, and GenAI toolkits (LangChain, LlamaIndex, Hugging Face)Willingness to travel as requiredStrong communication, time management, and resilience, with the ability to align technical solutions to business valueWHO YOU'LL WORK WITHDriving lasting impact and building long-term capabilities with our clients is not easy work. You are the kind of person who thrives in a high performance/high reward culture - doing hard things, picking yourself up when you stumble, and having the resilience to try another way forward.In return for your drive, determination, and curiosity, we'll provide the resources, mentorship, and opportunities you need to become a stronger leader faster than you ever thought possible. Your colleagues—at all levels—will invest deeply in your development, just as much as they invest in delivering exceptional results for clients. Every day, you'll receive apprenticeship, coaching, and exposure that will accelerate your growth in ways you won’t find anywhere else.When you join us, you will have:Continuous learning: Our learning and apprenticeship culture, backed by structured programs, is all about helping you grow while creating an environment where feedback is clear, actionable, and focused on your development. The real magic happens when you take the input from others to heart and embrace the fast-paced learning experience, owning your journey.A voice that matters: From day one, we value your ideas and contributions. You’ll make a tangible impact by offering innovative ideas and practical solutions, all while upholding our unwavering commitment to ethics and integrity. We not only encourage diverse perspectives, but they are critical in driving us toward the best possible outcomes.Global community: With colleagues across 65+ countries and over 100 different nationalities, our firm’s diversity fuels creativity and helps us come up with the best solutions for our clients. Plus, you’ll have the opportunity to learn from exceptional colleagues with diverse backgrounds and experiences.World-class benefits: On top of a competitive salary (based on your location, experience, and skills), we provide a comprehensive benefits package to enable holistic well-being for you and your family.WHAT YOU'LL DOAs a Data Engineer II, you will design, build, and optimize modern data platforms that power advanced analytics and AI solutions. You’ll collaborate with clients and interdisciplinary teams to architect scalable pipelines, manage secure and compliant data environments, and unlock the value of complex datasets across industries. You’ll sharpen your expertise by working on innovative projects, contributing to R&D, and learning from top-tier talent in a dynamic, global environment.Your work will drive lasting impact. By ensuring data is accurate, accessible, and production-ready, you’ll enable clients to accelerate digital transformations, adopt AI responsibly, and achieve measurable business outcomes. Here’s how you might contribute in a given year:Develop a streaming data platform to integrate telemetry for predictive maintenance in aerospace systemsImplement secure data pipelines that reduce time-to-insight for a Fortune 500 utility companyOptimize large-scale batch and streaming workflows for a global financial services client, cutting infrastructure costs while improving performance.Develop pipelines for embeddings and vector databases to enable retrieval-augmented generation (RAG) for a global defense client.You’ll work in cross-functional Agile teams with Data Scientists, Machine Learning Engineers, Designers, and domain experts to deliver high-quality analytics solutions. Partnering closely with clients—from data owners to C-level executives—you’ll shape data ecosystems that drive innovation and long-term resilience.You should expect this role to include at least some work in critical industries (Government, Defense, Aerospace, Utilities, Oil and Gas), but you will have the ability to serve other industries as well.This role offers an exceptional environment to grow as a technologist and collaborator. You’ll develop expertise at the intersection of technology and business by tackling diverse challenges while collaborating with some of the best technical and business talent in the world.There is flexibility to hire at the Engineer I/II or Senior Engineer level, depending on your experience

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer II - QuantumBlack, AI by McKinsey (Critical Industries) in San Francisco, CA vacancy
  •  ...able to be staffed on Critical Industries work which includes Defense...  ...machine learning and data mining techniques to...  ...DOAs a Data Scientist II, you will collaborate...  ...analytics and AI solutions, optimize code...  ...senior data scientists, engineers, designers, and domain... 
    Suggested
    Apprenticeship
    Work at office
    Local area
    Easy work

    McKinsey & Company

    San Francisco, CA
    2 days ago
  • $130.05k - $175.95k

    The Onyx Research Data Platform organization represents...  ...leadership, data engineering, infrastructure ,and DevOps...  ...platforms, and AI/ML and analysis platforms...  ...support, and maintenance of industrialized automated end-to-end...  ...requirements. A Data Engineer II is a technical... 
    Suggested
    Local area

    GlaxoSmithKline

    San Francisco, CA
    2 days ago
  • $110k - $135k

     ...way healthcare is delivered. We combine expertise in AI with deep clinical knowledge to develop safe, trustworthy...  ...partnered with multiple US-based health systems and data providers. What you’ll do As a Data Engineer II, you’ll be a foundational member of a small, high‑... 
    Suggested
    Full time
    Internship

    Knit Health

    San Francisco, CA
    4 days ago
  • $76.73k - $127.88k

     ...environment? As an experienced Data Engineer - Project Delivery Senior...  ...outcomes The TeamAI & Data - AI & Engineering leverages cutting...  ...advantage, transforming mission-critical operations. We enable clients...  ...you do and the clients and industries/sectors you serve. Preferred•... 
    Suggested
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    3 days ago
  •  ...foundation of DoorDash success. The Data Engineering team builds database...  ...looking for a Softare Engineer II to be a technical powerhouse...  ...roleYou have proficiency in using AI coding tools (e.g., Claude...  ...within our company, industry, and cities. That’s why we hire... 
    Suggested
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    2 days ago
  • $150.4k - $277.6k

     ...Senior Data Engineer Imagine what you could do here. At Apple, new ideas...  ...of what is possible in our industry. Apple is seeking an...  ...services which underpin mission critical information security capabilities...  ...~ Familiarity with ML/AI workflows and feature engineering... 
    Relocation

    Apple

    San Francisco, CA
    1 day ago
  •  ...a mission to supply the critical minerals powering modern energy, AI, and defense technologies...  ...chain by combining deep industry expertise with advanced software, automation, and data-driven decision-making....  ...looking for a Senior Data Engineer to help make it autonomous... 
    Contract work
    Immediate start
    Shift work

    Mariana Minerals

    San Francisco, CA
    5 days ago
  •  ...Data Engineer Location: San Francisco, CA Required Clearance: Secret...  ...with a strong focus on AI and machine learning to join...  ...ideal candidate will play a critical role in designing, implementing...  ...lifecycle. Stay current with industry trends and advancements in data... 

    Fullscope

    San Francisco, CA
    1 day ago
  •  ...Bedrock, we’re moving AI out of the lab and into...  ...Our team is composed of industry veterans who helped launch...  ...demand for housing, data centers, manufacturing...  ...veterans and world‑class engineers to solve physical‑world...  ...and reliability of critical data assets; Continuously... 
    Work at office
    Flexible hours

    Bedrock Robotics Inc

    San Francisco, CA
    3 days ago
  •  ...Job Posting Lead Data Engineer - Data & AI, Supply Chain Company Description/Details...  ...focusing on a variety of skill sets and industries. Having a depth and breadth of industry...  ...supplemental coverage (accident insurance, critical illness insurance and hospital... 
    Contract work
    Local area

    Pride Global

    San Francisco, CA
    2 days ago
  • $120k - $160k

     ...Data Engineer Los Angeles; New York; Remote; San Francisco EDO is...  ...EDO empowers the advertising industry to maximize media impact, optimize...  ...science and vertical AI, EDO equips industry leaders...  ...rely on these insights to make critical decisions about their advertising... 
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours

    EDO

    San Francisco, CA
    1 day ago
  • $175k - $200k

     ...Fieldguide. About The Role The Data Science team at...  ...that delivers new‑to‑the‑industry visibility into audit...  ...hiring a Senior Analytics Engineer to own the foundation...  ...of business‑critical pipelines through proactive...  ...Experience feeding LLM or AI‑native data interfaces... 
    Work from home
    Flexible hours

    Fieldguide.ai

    San Francisco, CA
    3 days ago
  • As a Data Engineer at Regard, you will help build and maintain the data...  ...quality and availability of critical datasets. You'll have the opportunity...  ...to everyone. Regard is an AI‑powered Proactive...  ...largest and most inefficient industries in the world - needs. We want... 
    Work at office
    Local area
    Home office
    Visa sponsorship
    Relocation package

    REGARD

    San Francisco, CA
    3 days ago
  • Overview Join to apply for the Data Engineer role at Kiwibot About Kiwibot...  ...our dynamic Data Team. This critical role will be instrumental in...  ...essential data support for our AI and Robotics initiatives. The...  ...Information Technology Industries IT Services and IT Consulting... 
    Full time

    Kiwibot

    San Francisco, CA
    2 days ago
  • About Us Beast Industries is a multifaceted media and entertainment company...  .... BEAST INDUSTRIES Senior Data Engineer Primary: Bay Area (San...  ...The Opportunity We're doing an AI-first engineering rebuild for...  ...cut data delivery latency on critical datasets. Build a privacy-safe... 
    Work at office
    Relocation package
    Flexible hours
    2 days per week

    MrBeast

    San Francisco, CA
    1 day ago
  • Data/ETL Engineer (Founding Team) Location: San Francisco Bay Area Type: Full-Time Compensation...  ...world-class team to tackle one of the industry’s most critical infrastructure problems. About the Role We’re building a multi-tenant, AI-native platform where enterprise data... 
    Full time

    Fabrion

    San Francisco, CA
    1 day ago
  • $133.1k - $236.4k

     ...connect creativity, collaboration, and AI. Our teams are reimagining what professional...  ...craft. We are looking for a Senior Data Engineer who will build a strong and scalable foundation...  ...customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe

    San Francisco, CA
    3 days ago
  • $148k - $185k

     ...anime! About the Team The Data Services team is focused on building...  ...around the world. The Data Engineering team provides seamless help...  ...Your expertise will also be critical in driving 100% automation,...  ...API and code while adhering to industry best practices, including... 
    Full time
    Flexible hours

    Crunchyroll, LLC

    San Francisco, CA
    1 day ago
  • $147k - $184k

    Ironclad is the leading AI contracting platform...  ...recognized as a leader in the industry: a Leader in the...  ...As a Senior Analytics Engineer, you will be responsible...  ...implementing scalable data models, and ensuring consistent...  ...platforms like Hex. Critical Thinking: A naturally... 
    Full time
    Contract work

    Ironclad Inc

    San Francisco, CA
    4 days ago
  • $112.5k - $150k

    Analytics Engineer As the Analytics Engineer II, you will: Build and improve data models that enable faster, more reliable decision‑making across Product, Risk, and Analytics. Reduce bottlenecks by delivering clean, scalable datasets analysts can trust and use independently... 
    Work from home
    Home office

    Earnest

    San Francisco, CA
    9 hours ago
  • $164k

    About The Role The Data engineering team has been created keeping in mind the importance and criticality of data for the overall success of Chime...  ...standards for the fintech industry. The base salary offered...  ...self‑serve data insights using AI Own the ETL workflows and... 
    Full time
    Work at office
    Local area
    Remote work
    Night shift

    Chime

    San Francisco, CA
    2 days ago
  • $123.7k - $254.67k

     ...Possible.At Pinterest, AI isn't just a feature, it...  .... We leverage massive data and cutting-edge science...  ...platform is built by industry leaders with a long history...  ...business.As a Data Engineer at tvScientific, you will...  ...track record of critical evaluation and verification... 
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    4 days ago
  • $172k - $215k

     ...real world value. As a Senior Software Engineer on the Data Engineering team, you are a core...  ...keeps oncall burden low. * Integrate AI tooling into data workflows: agentic systems...  ...start-up environment with experienced industry leaders * A learning environment where... 
    Full time
    Work at office
    Local area

    Ripple

    San Francisco, CA
    9 hours ago
  • $130k - $200k

     ...autonomous logistics system, delivering critical supplies quickly and reliably. Today,...  ...systems that rely on accurate engineering product data. Every prototype, production build, supplier...  ...51 land-pattern principles, relevant industry standards, and DFM requirements.... 
    Local area

    Zipline

    San Francisco, CA
    17 days ago
  •  ...Data Engineer San Francisco Engineering In office Full-time Company Overview ReadyOn.AI is an AI-native Labor Operating System that is redefining how the world’s largest enterprises...  ...engineering experience, including owning critical pipelines, datasets, and services in live... 
    Full time
    Work at office
    Shift work

    ReadyOn, Inc.

    San Francisco, CA
    4 days ago
  •  ...with groundbreaking vision-based AI, designed for today's global...  ...moving, close-knit team of AV industry veterans and innovative...  ...don't believe culture can be engineered - but when it falls into place...  ...Overview We're looking for a data engineer to help us turn raw driving... 
    Local area
    Flexible hours

    Humble Robotics

    San Francisco, CA
    2 days ago
  • $130k - $400k

     ...Data Engineer Location: San Francisco or New York City Company Stage: Series C / Late-Stage (AI / Enterprise) Office Type: Onsite (5 Days a Week) Salary: $130,000...  ...perks High-impact role supporting critical data infrastructure for AI systems at... 
    Work at office
    Relocation package

    Recruiting from Scratch

    San Francisco, CA
    2 days ago
  • $98k

     ...The IT Data, Analytics, & Insights organization is...  ...on delivering data and AI/ML centric products to...  ...Foundational Platform. A critical part of how we operate...  ...experienced and talented Data Engineer to join our growing...  ...of the utility industry and gain a comprehensive... 
    Apprenticeship
    Work experience placement
    Work at office
    Remote work

    Climate

    Oakland, CA
    4 days ago
  •  ...you "get stuff done" end-to-end. You use AI to work smarter and solve problems...  ...you, let's build what's next. Senior Data Engineer Hiring Location: San Francisco Part...  ...qualifications: Experience with financial industries, payment systems, or fintech platforms.... 
    Work at office
    Worldwide

    Airwallex

    San Francisco, CA
    3 days ago
  • $230k - $280k

     ...Build the data foundation that powers Gallup's products, analytics and AI innovation. As a senior data engineer at Gallup, you'll design and build the production data systems that...  ...data quality and reproducibility are critical preferred A commitment to working on... 
    Work at office
    3 days per week

    Gallup

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer II - QuantumBlack, AI by McKinsey (Critical Industries). Be the first to apply!