Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms Technology)

$215.2k - $245.6k
Full-time

Capital One

Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms Technology)

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.

Enterprise Platforms Technology (EPTech) comprises many of Capital One’s most important enterprise platforms. We play an essential role in establishing practices for building technology solutions across the company, while also delivering capabilities that exemplify those practices.

What You’ll Do:

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies

  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems

  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake

  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community

  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment

  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Basic Qualifications:

  • Bachelor’s Degree

  • At least 4 years of experience in application development (Internship experience does not apply)

  • At least 2 years of experience in big data technologies

  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Preferred Qualifications:

  • 7+ years of experience in application development including Python, SQL, Scala, or Java

  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)

  • 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)

  • 4+ year experience working on real-time data and streaming applications

  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)

  • 4+ years of data warehousing experience (Redshift or Snowflake)

  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting

  • 2+ years of experience with Agile engineering practices

At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-

The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.

McLean, VA: $197,300 - $225,100 for Lead Data EngineerNew York, NY: $215,200 - $245,600 for Lead Data Engineer

Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate’s offer letter.

This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.

Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.

This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.

If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at View phone number on aiapply.co or via email at View email address on aiapply.co. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.

For technical support or questions about Capital One's recruiting process, please send an email to View email address on aiapply.co

Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.

Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms Technology) in New York, NY vacancy
  • $179.4k - $245.6k

    Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast...  .... The team builds scalable platforms that deliver omnichannel messages... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    New York, NY
    4 days ago
  • $229.9k - $262.4k

    Sr. Lead Data Engineer (Enterprise Platforms Technology) Do you love building and pioneering...  ...languages like Python, SQL and Open Source...  ...services such as Snowflake, Databricks Optimize...  ...cloud computing (AWS, Microsoft Azure,...  ...Hive, EMR, Kafka, Spark, or MySQL) 4+ year... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Part time
    Internship
    Local area

    Capital One

    New York, NY
    1 day ago
  •  ...world’s leading organizations...  ...of technology and build...  ...The Snowflake AI Data Engineer / Lead serves...  ...AI, GenAI, and advanced...  ...on AWS Cloud....  ...Snowpark (Python), and Talend...  ...on enterprise data....  ...Snowflake platform architecture...  ...Guide SQL, Python,...  ...as: Databricks SageMaker... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Permanent employment
    Full time
    Local area

    Capgemini

    New York, NY
    18 days ago
  • $216k - $270k

     ...Generative AI Platform) is an enterprise-grade AI...  ...for a strong engineer to join our...  ...GCP, Azure, AWS) for customers...  ...and customer data environments...  ...learn new technologies quickly What...  ...in Python or Javascript...  ...Typescript, and SQL ~ Experience...  ...the world's leading models, and... 
    Platform
    Amazon Web Service
    SQL
    Full time

    Scale Ai, Inc.

    New York, NY
    16 hours ago
  • $110k - $130k

     ...Functional Skills Snowflake, Cortex AI, Python and Insurance Domain on AWS Cloud, Talend...  ...Snowflake Lead will serve as...  ...’s enterprise data platform, responsible...  ...strong data engineering fundamentals,...  ...oversight for SQL, Python, and...  ...ML platforms (Databricks / SageMaker /... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    Tata Consultancy Services

    New York, NY
    3 days ago
  •  ...Lead Data EngineerLocations:...  ...scalable data engineering solutions...  ...cloud technologies like AWS.Develop and...  ...solutions using Snowflake.Oversee...  ...AWS Glue, Spark, and Databricks.Optimize...  ...across both SQL and NoSQL...  ...skills in Python, Scala, Java...  ...a global platform and they... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Work at office

    InterSources

    New York, NY
    5 days ago
  • $137.4k - $161.7k

     ...seeking a Senior Data Engineer to join our...  ...modern cloud data platforms that enable...  ...Working with technologies such as Databricks, Snowflake, and Microsoft...  ...solutions using AWS, Azure, and...  ...Fabric to support enterprise analytics, AI,...  ...using Spark, SQL, Python, and modern orchestration... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    4 days ago
  •  ...Director to lead our Enterprise BI Practice ,...  ...combining deep data/analytics...  .../ Power BI / GenAI practice Define...  ...enterprise BI platforms (Tableau, Cognos...  ...with Snowflake, Databricks Exposure to Generative...  ...business and technology...  ...technology, design, engineering and business... 
    Platform
    Databricks

    Capgemini

    New York, NY
    4 days ago
  •  ...Sr Data EngineerTechnology...  ...& Technology is a global...  ...organization of engineers, product...  ...and platforms that will...  ...Company enterprise, such as...  ...work across AWS, Databricks, Unity Catalog, Snowflake and Airflow...  ...PySpark, SQL, and...  ...Catalog.Lead the modernization...  ...and/or Spark SQL in... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    Walt Disney Company

    New York, NY
    3 days ago
  • $130k - $145k

     ...innovative technology to...  ...industry-leading digital solutions...  ...DevOps, Data, and Software Engineering,...  ...experienced Enterprise Data Architect...  ...platforms and financial...  ...architecture: Databricks with...  ..., Delta, Snowflake, Kafka, Airflow...  ...on AWS (Lake Formation...  .... ~ SQL Server and... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Contract work
    Temporary work
    Flexible hours

    Synechron

    New York, NY
    5 days ago
  • $100k - $143k

     ...OverviewThe Analytics Engineer is a key...  ...within the Enterprise Intelligence Data Services team...  ..., cloud data platforms, and AI-...  ...datasets using SQL, dbt, and modern...  ...(GCP), AWS, Databricks, BigQuery, or...  ...into a more technology-, data-, and...  ...and agents are leading the industry... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    2 days ago
  • $168k - $252k

     ...IT and engineering, we combine...  ...market-leading...  ...strategy, technology & engineering, platforming, experience...  ...technology, data sciences...  ...for enterprise clients....  ...engineering using SQL, DBT, Python, Spark, PySpark...  ..., Snowflake, and Databricks....  ...services, AWS AI services... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Flexible hours

    Publicis Media

    New York, NY
    16 hours ago
  • $188.5k - $235.62k

     ...access to data as simple...  ...with no engineering or maintenance...  ...our technology every day...  ...Role Every enterprise adoption...  ...do with SQL. Can we prove...  ...the dbt platform — how...  ...remark on. Lead the...  ...hyperscaler — AWS, Azure,...  ...ecosystem (Snowflake, BigQuery, Databricks, Redshift... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    Socket.dev

    New York, NY
    1 day ago
  • Capital One invites a Lead Data Engineer to shape data pipelines and AI-enabled platforms in New York. You will collaborate with agile teams to design, build,...  ...and optimize end-to-end data solutions, using Python, SQL, Spark, and cloud services. You will mentor... 
    Platform
    Amazon Web Service
    SQL

    Capital One

    New York, NY
    1 day ago
  •  ...'s possible. As a Lead Software Engineer at JPMorgan Chase...  ...Community Banking's Technology team, you are an...  ...team adoption of enterprise-authorized AI-assisted...  ...language(s) Python, Spark, AWS Experience with Real...  ...Java development, SQL/NoSQL data platforms (Cassandra, PostgreSQL... 
    Platform
    Amazon Web Service
    SQL
    Work experience placement

    JP Morgan Chase

    New York, NY
    2 days ago
  • $286.2k - $326.7k

    Sr. Staff Data Engineer Sr. Staff...  ...generation technology solutions....  ...team within Enterprise Data,...  ...acceleration, platform...  ...expertise in AWS infrastructure...  ...Kafka, Flink, Spark, Snowflake, and Databricks mature...  ...on writing Python, SQL, Java, and...  ...unified manner Lead the way in... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Part time
    Local area
    Remote work

    JobCubby

    New York, NY
    3 days ago
  •  ...world’s leading organizations...  ...value of technology and build...  ...Data Engineer to design...  ...modern data platforms while ensuring...  ...the enterprise. Key Responsibilities...  ...in SQL and at...  ...such as Python, Java, or...  ...such as AWS, Azure,...  ...Familiarity with Spark, Databricks, Snowflake, or... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Local area

    Capgemini

    New York, NY
    10 days ago
  • $130.6k - $192k

     ...Team The Spark Platform team owns and...  ...company's data, analytics, and...  ...As a Software Engineer on Spark...  ...Amazon EMR, Databricks, or an in-house...  ...environment (AWS preferred) —...  ...experience with Python, Go, Scala, or Java; SQL fluency. ~...  ...consumers. We are a technology and logistics... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash Usa

    New York, NY
    16 hours ago
  • $124k - $280k

     ...people in data and analytics engineering focus on leveraging...  ...advanced technologies and...  ...need to lead and deliver...  ...in Cloud Platforms [e.g., AWS Certified...  ...Associate, Snowflake Core, Snowflake Databricks Data Engineer...  ...in Python and structured...  ...Proficient in SQL and... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    H1b

    PwC

    New York, NY
    5 days ago
  •  ...innovative technology and...  ...science, engineering, and consulting...  .... Data...  ...languages like Python to build...  ...cloud platforms, ETL tools...  ...tools (SQL, Spark)and cloud...  ...Azure, AWS). Experience...  ...NLP/LLM/GenAI is a...  ...Azure, Snowflake, Databricks, etc) and...  ...market leading capabilities... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Contract work
    Part time
    Fixed term contract
    Work experience placement
    Internship
    Work from home
    Shift work

    IBM

    New York, NY
    4 days ago
  • $125.5k - $230.2k

     ...Function: Technology ConsultingEmployer...  ...- Data and Analytics...  ...and Engineering EY is the...  ...develop and lead innovative...  ...large data platforms, data warehouses...  ...(AWS, Azure, Google...  ...Platform, Databricks, Snowflake)Big Data applications...  ...RDBMS (MS SQL Server,...  ...(Spark streaming,... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Work experience placement
    Summer holiday
    Flexible hours

    EY (Ernst & Young)

    New York, NY
    4 days ago
  •  ...world’s leading...  ...value of technology and build...  ...Deployed Engineer (FDE) who...  ...enterprise systems...  ...cloud platforms. Work...  ...Engineering, Data Science...  ...experience in Python, Java,...  ...Strong SQL and...  ...as AWS, Azure,...  ...Experience with Databricks, Snowflake, Spark, or...  ...to GenAI... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Permanent employment
    Full time
    Local area

    Capgemini

    New York, NY
    6 days ago
  • $156.75k - $215k

     ...possible. As a Lead Software Engineer at JPMorgan...  ...Community Banking's Technology team, you are...  ...adoption of enterprise-authorized AI-assisted...  ...language(s) Python, Spark, AWS Experience...  ...Application Platform Experience with...  ...development, SQL/NoSQL data platforms (Cassandra... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Work experience placement

    JPMorgan Chase & Co.

    New York, NY
    4 days ago
  • $155k - $215k

     ...Securities Technology (IST)...  ...businesses and enterprise-wide...  ...development and engineering of the...  ...platform in support...  ...goals Lead or influence...  ...applications, data, and...  ...Google Cloud, AWS) ~ Good...  ...C#, JS, Python, C/C++,...  ...PostgreSQL, SQL Server,...  ..., Redis, Snowflake, Databrick... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Temporary work

    Morgan Stanley

    New York, NY
    3 days ago
  •  ...Data Engineering-Big Data EngineeringAs...  ...lead, you will...  ...across the enterprise.ResponsibilitiesData...  ...& Platform...  ...leveraging Snowflake, AWS, Apache Airflow...  ...Optimize SQL workloads...  ...in SQL, Python, and PySpark...  ..., Databricks, or similar...  ...Big Data technologies including Spark, Hadoop,... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    EXL

    New York, NY
    5 days ago
  • $150k

     ...through data, technology and digital...  ..., Enterprise Solutions...  ...Agentic Platforms.Data and...  ...experience with GenAI and its potential...  ..., Lead/Opportunity...  ...system engineering, business...  ...experience with SQL, Python, or...  ...(e.g., AWS Agentcore...  ...platforms (e.g., Databricks, Snowflake, etc.).... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Work at office
    Local area

    The Boston Consulting Group

    New York, NY
    16 hours ago
  • $215k - $275k

     ...modern technology and software...  ...product engineering,...  ...products and platforms that can...  ...safely at enterprise scale....  ...modern data platforms...  ...across AWS, Azure,...  ...cases.* Lead enterprise...  ...production GenAI and...  ...skills in Python and modern...  ...such as Databricks, Snowflake, Spark, Kafka,... 
    Platform
    Databricks
    Amazon Web Service
    Temporary work
    Local area

    Slalom

    New York, NY
    4 days ago
  • The Enterprise Architect will define and maintain...  ...the long-term technology architecture across ERP, IIoT platforms, data platforms, edge-...  ...architecture governance, lead modernization...  ...experience with SQL, Snowflake, and Informatica...  ...such as AWS, Azure, or GCP.... 
    Platform
    Amazon Web Service
    SQL

    Compunnel, Inc.

    New York, NY
    4 days ago
  • $215.2k - $244.7k

     ...our thriving Technology and...  ...developing Big Data strategy and...  ...guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft...  ...such as Spark on Scala, Storm...  ...LLMs), prompt engineering, embeddings,...  ...(Microsoft SQL Server) and...  ...platforms such as AWS, Azure, GCP... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    1 day ago
  • $100k - $143k

     ...Intelligence & Data (AI&D)...  ..., learning enterprise AI practices...  ...Scientists, Engineers, and product and technology partners...  ...models using AWS (e.g., SageMaker...  ...data platforms (Snowflake, Databricks), ensuring...  ...Proficiency in Python and SQL; working...  ...agents are leading the industry... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms Technology). Be the first to apply!