Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms T
$197.3k - $225.1kCapital One
Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Enterprise Platforms Technology (EPTech) comprises many of Capital One’s most important enterprise platforms. We play an essential role in establishing practices for building technology solutions across the company, while also delivering capabilities that exemplify those practices. What You’ll Do Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications Bachelor’s Degree At least 4 years of experience in application development (Internship experience does not apply) At least 2 years of experience in big data technologies At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud) Preferred Qualifications 7+ years of experience in application development including Python, SQL, Scala, or Java 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ years experience working on real-time data and streaming applications 4+ years of experience with NoSQL implementation (Mongo, Cassandra) 4+ years of data warehousing experience (Redshift or Snowflake) 4+ years of experience with UNIX/Linux including basic commands and shell scripting 2+ years of experience with Agile engineering practices Location, Salary, and Incentives The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part‑time roles will be prorated based upon the agreed upon number of hours to be regularly worked. McLean, VA: $197,300 - $225,100 for Lead Data Engineer New York, NY: $215,200 - $245,600 for Lead Data Engineer At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E) This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan. Benefits Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part‑time status, exempt or non‑exempt status, and management level. Equal Opportunity Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non‑discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug‑free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23‑A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901‑4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. Support and Contact If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at View phone number on click.appcast.io or via email at View email address on click.appcast.io. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One’s recruiting process, please send an email to View email address on click.appcast.io. Company Overview Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC). At Capital One, we’re building a leading information‑based technology company. Still founder‑led by Chairman and Chief Executive Officer Richard Fairbank, Capital One is on a mission to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. We measure our efforts by the success our customers enjoy and the advocacy they exhibit. This role is expected to accept applications for a minimum of 5 business days. No agencies please. #J-18808-Ljbffr Capital One
$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy... ...business value. The team builds scalable platforms that deliver omnichannel messages in owned and...PlatformDatabricksAmazon Web ServiceSQLFull timePart timeInternshipH1bLocal area$229.9k - $262.4k
...Sr. Lead Data Engineer (Enterprise Platforms Technology) Do you love building... ...programming languages like Python, SQL and Open Source... ...services such as Snowflake, Databricks Optimize... ...cloud computing (AWS, Microsoft Azure,... ...Hive, EMR, Kafka, Spark, or MySQL) 4+ year...PlatformDatabricksAmazon Web ServiceSQLFull timePart timeInternshipLocal area$110k - $130k
...Functional Skills Snowflake, Cortex AI, Python and Insurance Domain on AWS Cloud, Talend... ...Snowflake Lead will serve as... ...’s enterprise data platform, responsible... ...strong data engineering fundamentals,... ...oversight for SQL, Python, and... ...ML platforms (Databricks / SageMaker /...PlatformDatabricksAmazon Web ServiceSQL- Capital One invites a Lead Data Engineer to shape data pipelines and AI-enabled platforms in New York. You will collaborate with agile teams to design, build,... ...and optimize end-to-end data solutions, using Python, SQL, Spark, and cloud services. You will mentor...PlatformAmazon Web ServiceSQL
- ...Data Engineering-Big Data EngineeringAs... ...technical lead, you will... ...the enterprise.ResponsibilitiesData... ...& Platform DevelopmentDesign... ...Snowflake, AWS, Apache Airflow... ....Optimize SQL workloads,... ...expertise in SQL, Python, and... ..., Databricks, or similar... ...including Spark, Hadoop, Hive...PlatformDatabricksAmazon Web ServiceSQL
$197.3k - $225.1k
...Overview Lead Machine Learning Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) As a Capital One Machine Learning... ...disciplines, such as Ops, Modeling, and Data Engineering. In this role, you... ...scikit-learn, PyTorch, Dask, Spark, or TensorFlow ~2+ years of...PlatformAmazon Web ServiceSQLFull timePart timeInternshipH1bLocal area$124k - $135k
...experience with data and... ...and Data Platforms, you will... ...Product, Engineering, and... ...supporting our enterprise partners... ...lead work streams... ...rolesProficiency in SQL, DBT, and... ...in Python for ETL and... ..., Databricks/Spark, AWS, Snowflake, or other... ...USDCandidate Use of GenAI Tools:We’...PlatformDatabricksAmazon Web ServiceSQLLocal areaFlexible hours- ...Big Data EngineerWe are... ...Big Data Engineer to design... ...distributed data platforms to... ....Strong SQL and data... ...Hadoop, Spark, Hive, HBase... ...: Snowflake, Redshift... ...Talend, AWS Glue, Azure... ...Languages: Python, Java, Scala... ...architectures using Databricks, Delta... ...to enterprise data...PlatformDatabricksAmazon Web ServiceSQLRemote work
$141.2k - $278.3k
...Manager - AI & Data Risk... ...architecture, data platforms, data... ...Generative AI (GenAI) in... ...Ability to lead projects or... ...Programming (e.g., Python, SQL, R, Java,... ...(e.g., Databricks, Snowflake, Apache Spark & Kafka, etc... ...SPSS, SAS Enterprise Miner, RPL,... ...Certification (e.g. AWS, Azure),...PlatformDatabricksAmazon Web ServiceSQL- ...the world’s leading... ...Overview The Snowflake AI Data Engineer / Lead serves... ...native AI, GenAI, and... ...engineering on AWS Cloud.... ...Snowpark (Python), and Talend... ...analytics on enterprise data.... ...Snowflake platform architecture... ...Guide SQL, Python, and... ...such as: Databricks SageMaker...PlatformDatabricksAmazon Web ServiceSQLPermanent employmentFull timeLocal area
$216k - $270k
...Generative AI Platform) is an enterprise-grade AI platform... ...for a strong engineer to join our... ...(GCP, Azure, AWS) for customers... ...and customer data environments (... ...Proficient in Python or Javascript/... ...Typescript, and SQL ~ Experience... ...power the world's leading models, and...PlatformAmazon Web ServiceSQLFull time$125k - $145k
...a range of data and AI projects... ...ready data platform and... ...spans data engineering, AI product... ...architecture using Python, Spark, SQL, and modern... ...AI and GenAI solutions into... ...and Enterprise IT partnerships... ...technologies (e.g., Snowflake, Databricks, Delta Lake... ...industry-leading benefits,...PlatformDatabricksSQLFull timeWork at officeFlexible hoursDay shift$140k
...Snowflake Lead Data Engineering with AILocation: New York, NYDuration... ..., Cortex AI, Python and Insurance Domain on AWS Cloud, Talend... ...technical lead client's enterprise data platform, responsible for... ...oversight for SQL, Python, and ELT... ...ML platforms (Databricks / SageMaker /...PlatformDatabricksAmazon Web ServiceSQL- ...Data EngineerDesign, build, and... ...Kyriba into Snowflake and Databricks. Develop and... ...across cloud platforms and structured... ...and feature engineering built on top... ...Databricks, Apache Spark (PySpark/SQL).Proven... ...experience with AWS services — including... ...a fast-paced enterprise...PlatformDatabricksAmazon Web ServiceSQL
- ...Analytics, Engineering,... ...experience in data engineering... ...rolesProficiency in Python, Scala, or... ...skills in SQL and... ...with cloud platforms such as (AWS, GCP, Azure... ...such as Snowflake, BigQuery,... ...experience with Databricks, AWS Glue,... ...such as (Spark, Dask,... ...practices, and GenAI toolkits (...PlatformDatabricksAmazon Web ServiceSQLApprenticeshipEasy work
- ...looking for an experienced Lead Platform Engineer, Snowflake to help shape and support enterprise data platforms in New York,... ..., including Microsoft SQL Server and PostgreSQL,... ...environments such as AWS.• Drive data migration... ..., or tooling in Python to streamline operational...PlatformAmazon Web ServiceSQLContract work
$147.3k - $243.8k
...of cloud data platform... ...Database, and GenAI. ~10+... ...such as Spark and Kafka... ...ability in Python, SQL, or... ...Architect, AWS Architect... ...Architect, Snowflake... ...and/or Databricks Certified... ...Architect/Engineer with a strong... ...leading data platform... ...support enterprise customers...PlatformDatabricksAmazon Web ServiceSQLFull timeWork from homeFlexible hours- ...& Design, Engineering and Managed... ...a Senior Data Engineer,... ...will prepare enterprise domain... ...enterprise data platform. You will... ...across Databricks and Snowflake, converting... ....Advanced SQL together with Spark / PySpark,... ...with AWS and S3, in... ...Foundations: Python; YAML data...PlatformDatabricksAmazon Web ServiceSQLContract work
- ...Data-Mesh / Enterprise Architect to join our team in New... ...plane, the self-serve platform and the catalogue... ...medallion architecture: Databricks with Unity Catalog, Delta, Snowflake, Kafka, Airflow,... ...equivalents on AWS (Lake Formation,... ...consuming domains. ~ SQL Server and T-SQL...PlatformDatabricksAmazon Web ServiceSQLContract workWork at office
$112.29k - $161.28k
...descriptionPHM is the leading health media... ..., where data becomes... ...Azure and AWS technology stacks... ...cloud platforms (e.g., Snowflake, Databricks)Define enterprise data models,... ...processes using SQL, Python, and... ...mentorship to data engineers and... ...SQL, Python, Spark (PySpark), JavaETL...PlatformDatabricksAmazon Web ServiceSQLTemporary workFreelanceFlexible hours$110k - $130k
...York Times, data powers... ...for a Data Engineer to help us... ...architecture (AWS and GCP) and... ...contribute to the platform that... ...Administer and tune Spark... ...proficiency in Python for scripting... ...in SQL and demonstrable... ...(BigQuery, Snowflake, DataBricks)Familiarity... ...Candidate Use of GenAI ToolsWe’re...PlatformDatabricksAmazon Web ServiceSQLFull timeLocal areaFlexible hours- ...Lead Data EngineerLocations: Richmond... ...data engineering solutions that... ...technologies like AWS.Develop and... ...using Snowflake.Oversee the... ...as AWS Glue, Spark, and Databricks.Optimize database... ...across both SQL and NoSQL... ...programming skills in Python, Scala, Java... ...as a global platform and they are...PlatformDatabricksAmazon Web ServiceSQLWork at office
- A data solutions company in Georgia is seeking a qualified... ...strong expertise in Databricks Lakehouse architecture... ...with PySpark and Spark SQL. Ideal applicants will... ...possess a deep knowledge of AWS services and data... ...significantly impact data platform development and operations...PlatformDatabricksAmazon Web ServiceSQL
$137.4k - $161.7k
...seeking a Senior Data Engineer to join our... ...modern cloud data platforms that enable... ...technologies such as Databricks, Snowflake, and Microsoft... ...using AWS, Azure, and GCP... ...Fabric to support enterprise analytics, AI,... ...pipelines using Spark, SQL, Python, and modern orchestration...PlatformDatabricksAmazon Web ServiceSQLLocal areaImmediate startFlexible hours$132k - $165k
...Enterprise Customer Success Manager -... ...leverage their data to make informed... .... Our platform bridges the gap... ...Experience with SQL, data visualization... ...preferred (Snowflake, Databricks, Redshift, BigQuery... ..., SQL, Python, and native AI... ...NewView Capital, Spark Capital, Sutter...PlatformDatabricksSQL- ...Orchestration Engine helping enterprise retailers, brands... ...are hiring a Lead Data Engineer to... ...analytics and data platform initiatives.... ...multiple Databricks instances as part... ...Implement complex Spark and Databricks... ..., and Spark SQL Proven... ...sources in Azure, AWS, GCP, and others...PlatformDatabricksAmazon Web ServiceSQLFor contractorsWork at officeRemote work
- ...seeking a Senior Data Scientist... ...supporting enterprise retail... ...client data platforms (Snowflake, Databricks, Fabric, BigQuery... ...with data engineering to define... ....Advanced SQL and production-grade Python (pandas,... ...Databricks, Azure/AWS/GCP) and... ....LLM/GenAI application...PlatformDatabricksAmazon Web ServiceSQLPermanent employmentWorldwide
- ...Phoenix Group is seeking a Senior Data Engineer to join our growing data and... ...the business. You will work with Python, SQL, Snowflake, dbt, Airflow, Databricks, and AWS to enable reliable data-driven... ...quality, and scalable data platforms across functions and partners....PlatformDatabricksAmazon Web ServiceSQL
- ...Senior Director to lead our Enterprise BI Practice ,... ...—combining deep data/analytics expertise... ...BI / Power BI / GenAI practice Define... ...enterprise BI platforms (Tableau, Cognos... ...Experience with Snowflake, Databricks Exposure to Generative... ..., design, engineering and business operations...PlatformDatabricks
- ...a highly motivated Engineering Consultant with experience... ...domain to work on data and analytics-... ...integration, and platform enablement to support... ...cloud platforms (AWS, Azure, or GCP) and... ...with tools such as Python, SQL, Spark, Databricks, Snowflake, or similar technologies...PlatformDatabricksAmazon Web ServiceSQL
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms T. Be the first to apply!
- python developer data analytics New York, NY
- python developer internship New York, NY
- python programmer New York, NY
- full stack / python developer (remote) New York, NY
- python developer remote New York, NY
- python developer New York, NY
- backend python developer New York, NY
- senior python developer New York, NY
- python engineer New York, NY
- python developer part time New York, NY



