Big Data Engineer
$137.5k - $141.7kMcKinsey & Company
Locations Atlanta Boston Chicago New York City Do you want to do work that matters, alongside supportive leaders who will help you grow faster than you ever thought possible? Are you a creative problem‑solver who is energized by challenges? You've come to the right place. YOUR IMPACT You will build graph-centric data pipelines and a semantic data layer that powers GenAI applications. You'll build a platform that will be deployed across regions, sectors and functions. Focusing on a distinctive combination of AI capabilities, domain expertise, and human judgement. Your work will be at the forefront of developing exciting technology for our firm. You'll design and evolve entity/relationship models, taxonomies, and identifiers; implement ingestion, normalization, and enrichment that maps heterogeneous sources to graph schemas; perform entity resolution and semantic tagging; validate structures; and publish data to graph stores. You'll write production‑grade Python code with comprehensive tests, create and modify GitHub Actions CI/CD pipelines, and operate AWS‑and Docker‑based infrastructure to deliver reliable, scalable knowledge graph data services. YOUR GROWTH Driving lasting impact and building long‑term capabilities with our clients is not easy work. You are the kind of person who thrives in a high performance/high reward culture – doing hard things, picking yourself up when you stumble, and having the resilience to try another way forward. In return for your drive, determination, and curiosity, we'll provide the resources, mentorship, and opportunities you need to become a stronger leader faster than you ever thought possible. Your colleagues‑at all levels‑will invest deeply in your development, just as much as they invest in delivering exceptional results for clients. Every day, you'll receive apprenticeship, coaching, and exposure that will accelerate your growth in ways you won't find anywhere else. When you join us, you will have: Continuous learning: Our learning and apprenticeship culture, backed by structured programs, is all about helping you grow while creating an environment where feedback is clear, actionable, and focused on your development. The real magic happens when you take the input from others to heart and embrace the fast‑paced learning experience, owning your journey. A voice that matters: From day one, we value your ideas and contributions. You'll make a tangible impact by offering innovative ideas and practical solutions, all while upholding our unwavering commitment to ethics and integrity. We not only encourage diverse perspectives, but they are critical in driving us toward the best possible outcomes. Global community: With colleagues across 65+ countries and over 100 different nationalities, our firm's diversity fuels creativity and helps us come up with the best solutions for our clients. Plus, you'll have the opportunity to learn from exceptional colleagues with diverse backgrounds and experiences. World‑class benefits: On top of a competitive salary (based on your location, experience, and skills), we provide a comprehensive benefits package to enable holistic well‑being for you and your family. YOUR QUALIFICATIONS AND SKILLS Degree in CS/Engineering or equivalent experience 3+ years of relevant experience which may include a combination of professional work experience and relevant education Data engineering experience, with a strong focus on cloud‑based data engineering using AWS services; Previous enterprise platform experience preferred Expertise with Python development with strong experience with relational databases Experience with knowledge graphs Practicing high coding standards with clean code, modularity, error handling, testing automation and more Very driven, super strong on execution and output orientation, likes to get job done attitude and ability to figure things out independently. Able to work in a complex and very fast paced environment Hands‑on experience with Docker Solid and demonstrable background in data pipeline performance and diagnostics Interest in Generative AI and other ML topics. Kedro framework experience as a plus Excellent problem‑solving skills and the ability to analyze and resolve complex data engineering challenges Strong communication and collaboration skills, with the ability to work effectively in a cross‑functional team environment Please review the additional requirements regarding essential job functions of McKinsey colleagues. Our unwavering commitment to integrity drives everything we do, guiding us to always act in the best interests of our clients, our people, and the communities we serve. FOR U.S. APPLICANTS: McKinsey & Company is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by applicable law. Certain US jurisdictions require McKinsey & Company to include a reasonable estimate of the salary for this role. To help you understand what you can expect, the salary range for new joiners in this role in United States, including all office locations where the job may be performed, is $137,500 - $141,700 USD gross per year. This reflects our best estimate of the lowest to highest [salary/hourly wages] for this role at the time of this posting, ensuring you have a clear picture right from the start, though it's important to remember that actual salaries may vary. Factors like your office location, your unique blend of experience and skills, start date and our current organizational needs all play a part in determining the final figure. Certain roles are also eligible for bonuses, subject to McKinsey's discretion and based on factors such as individual and/or organizational performance. Additionally, we provide a comprehensive benefits package that reflects our commitment to the wellness of our colleagues and their families. This includes medical, mental health, dental and vision coverage, telemedicine services, life, accident and disability insurance, parental leave and family planning benefits, caregiving resources, a generous retirement contributions program, financial guidance, and paid time off. FOR NON-U.S. APPLICANTS: McKinsey & Company is an Equal Opportunity employer. For additional details regarding our global EEO policy and diversity initiatives, please visit our McKinsey Careers and Diversity & Inclusion sites. #J-18808-Ljbffr
- ...motivated candidate to join our talented Team. Job Title: Sr. Data Engineer Location(s): Chicago, IL (Hybrid) Key Skills: AWS (EMR,... ...extensive experience in data engineering, cloud services, and big data technologies, with a strong focus on AWS services, Python...Big dataLocal areaRemote work
- ...Cloud Big Data Engineer Comtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully serviced enterprises across the public and private sectors, and the Department of Defense. Our services span...Big dataFull timeRemote workFlexible hours
$150k - $200k
...and software systems are continually re-engineered, optimized, and maintained to stay on top... ...Belvedere Trading is looking for a proven Senior Data Engineer to work directly with our... ...NeedExperience designing and developing big data warehouses and ETL pipelines.Proven...Big dataFull time$98k - $182k
...A leading global marketing firm in Chicago seeks an experienced Data Engineer to build and maintain robust data pipelines. The ideal candidate will have over 5 years of experience in big data environments, utilizing technologies such as Apache Spark and AWS. Your contributions...Big data- ...investing heavily in the next generation of its data platform. As data volumes continue to... ...and trading, they're expanding the engineering team responsible for building the infrastructure... ...distributed data pipelines using modern Big Data technologies Improve performance,...Big data
$175k - $225k
...We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting... ...markets. Core Responsibilities Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.) Build, deploy,...Big dataPermanent employmentFull time$215.2k - $244.7k
...This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of... ...-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation...Big dataLocal areaImmediate startFlexible hours$120k - $150k
...Manufacturing and Retail & CPG, modernize their data and put AI to work, not in a deck, but in... ...: Data Strategy & Advisory, Data Engineering, Analytics & Visualization, Generative AI... ...years' experiencein data engineering and big data. At least 2 yearsworking directly with...Big dataLocal areaRemote work- ...Description Hybrid at least 2 days per week in office in Chicago, IL. Our client seeks a Staff Data Engineer to set technical direction for large-scale data processing in a privacy-preserving attribution platform. The role will architect and operate secure pipelines across...Big dataWork at office2 days per week
- ...Collaborate with product managers, data scientists, engineering, and program management teams to define product features, business deliverables, and... ...-of-the-art technologies to acquire, ingest and transform big datasets Requirements 8+ years of experience within the field...Big data
- ...meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse... ..., PySpark or DuckDB ; - 2+ years of experience with Big Data technologies ( Spark , Snowflake ); - Expert-level knowledge...Big dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours
$99k - $232k
...LevelManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...languages such as Python, Java, or Scala- Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus-...Big dataFull timeH1b$98k - $169.05k
84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer... ...to ingest, store and distribute our big data. Our developers use Python,... ...testing Collaborate with architecture and lead engineers to ensure consistent development practices...Big dataWork at office$145k
...on collaboration, cutting-edge technology, data driven solutions, and automation. We... ...and Singapore.What you’ll do as a Software Engineer on the Data Engineering team at Akuna:We are... ...collect and transform our rapidly growing Big Data set within our hybrid cloud architecture...Big dataInternshipWork at office- ...Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer... ...to manipulate data (Python, R, SQL, SAS). Strong knowledge of big data analysis and storage tools and technologies. Strong understanding...Big dataFull timeFlexible hours
- ...Mathematics, Applied Statistics, Electrical Engineering, Mechanical Engineering or related... ...modeling. Should have very good experience of data tuning on Green Plum or other MPP... ...data movement technologies. Expertise on big data technologies such as HDFS, PIG, HIVE...Big dataFull time
$135k - $165k
...Senior Data Engineer Location Boston, Chicago, Los Angeles, New York, San Francisco Job Description About L.E.K.... ...libraries (e.g., PySpark, Apache Airflow) and familiarity with Big Data tools such as Spark or Scala ~ Hands-on experience designing...Big dataPermanent employmentH1bLocal areaWorldwideHome office- ...to stay at the forefront of the industry. Role Overview Senior Data Engineer working directly with trading desks to improve trading performance... ...use cases. Qualifications Experience designing and developing big data warehouses and ETL pipelines. Proven knowledge of SQL and...Big data
- We are looking for an experienced Data Engineer to join a high-performing technology team in Chicago. This individual will play a key role in... ...and batch data processing systems using modern streaming and big data technologies. Build robust data pipelines and workflows to...Big data
- ...development of an eCommerce platform for a big US‑based retail company, serving millions... ...domains - Customer, Loyalty, Search and Browse, Data Integration, Cart. Current overriding... ...We are looking for a Data Engineer who will be responsible for designing a solution...Big data
$179.4k - $204.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced... ...delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...Big dataFull timePart timeInternshipH1bLocal area$180k - $250k
...our Jobot logo and follow our LinkedIn page! Job details: Lead Data Engineer | 5+ Years Experience | Scalable Batch & Streaming Pipelines |... ...streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing...Big data- Tredence is a global analytics services and solutions company. Our capabilities range from Data Engineering, Visualization, Data Management to Advanced analytics, Big Data, Cloud and Machine Learning. Our uniqueness is in bringing the right mix of technology and business...Big data
$88.9k - $165.1k
...1 Vision, 1 Voice. Responsibilities As a Senior Software Engineer on Publicis’s Data Warehouse projects, you will design, build, and optimize large... ...ETL/ELT design and optimization skills. Expertise in big data processing using Apache Spark (preferably Databricks),...Big dataLocal areaFlexible hours$160k - $220k
...problem solvers to help us create it. Who you are As a Senior Data Engineer at Metropolis, you will play a key role in shaping data products... ...of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems Proficiency in SQL, ETL/ELT,...Big dataTemporary workWork at officeLocal areaAfternoon shift$98k - $182k
...business. We are a small, high‑impact team of engineers operating at massive scale—trillions of... ...), your work directly connects our data ecosystem to the biggest platforms in the... ...Data Tech: Get hands‑on with an innovative big data stack using Spark, Scala, Python, AWS...Big data$90k - $200k
..., a list that spans across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and maintain advanced data... ...tools (git, Jenkins, CI/CD, Jira) Fundamental understanding of big data, open source, and data streaming concepts Ability to...Big dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours$125k - $207k
84.51° Overview 84.51° is a retail data science, insights and media company. We help The... ...connection. Join us at 84.51°! Lead Data Engineer We are a full‑stack data science company and... .... We practice Agile development with Big Room Planning to align cross‑functional squads...Big dataWork at office- Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced... ...delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...Big dataInternshipH1bLocal area
$73.5k - $136.5k
...with business users to ingest new complex data quality uses cases. In both cases the... ...critical business features with a passion for big data technologies. Responsibilities... ...cloud environments Working closely with Engineering and Business resources across the globe to...Big dataLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- software data engineer Chicago, IL
- entry level big data engineer Chicago, IL
- big data developer Chicago, IL
- senior data quality engineer Chicago, IL
- sr data engineer Chicago, IL
- junior big data engineer Chicago, IL
- big data cloud engineer Chicago, IL
- data platform engineer Chicago, IL
- senior cloud data engineer Chicago, IL
- data developer Chicago, IL

