Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms T

$197.3k - $225.1k

Capital One

Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Enterprise Platforms Technology (EPTech) comprises many of Capital One’s most important enterprise platforms. We play an essential role in establishing practices for building technology solutions across the company, while also delivering capabilities that exemplify those practices. What You’ll Do Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications Bachelor’s Degree At least 4 years of experience in application development (Internship experience does not apply) At least 2 years of experience in big data technologies At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud) Preferred Qualifications 7+ years of experience in application development including Python, SQL, Scala, or Java 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ years experience working on real-time data and streaming applications 4+ years of experience with NoSQL implementation (Mongo, Cassandra) 4+ years of data warehousing experience (Redshift or Snowflake) 4+ years of experience with UNIX/Linux including basic commands and shell scripting 2+ years of experience with Agile engineering practices Location, Salary, and Incentives The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part‑time roles will be prorated based upon the agreed upon number of hours to be regularly worked. McLean, VA: $197,300 - $225,100 for Lead Data Engineer New York, NY: $215,200 - $245,600 for Lead Data Engineer At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E) This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan. Benefits Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part‑time status, exempt or non‑exempt status, and management level. Equal Opportunity Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non‑discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug‑free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23‑A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901‑4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. Support and Contact If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at View phone number on click.appcast.io or via email at View email address on click.appcast.io. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One’s recruiting process, please send an email to View email address on click.appcast.io. Company Overview Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC). At Capital One, we’re building a leading information‑based technology company. Still founder‑led by Chairman and Chief Executive Officer Richard Fairbank, Capital One is on a mission to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. We measure our efforts by the success our customers enjoy and the advocacy they exhibit. This role is expected to accept applications for a minimum of 5 business days. No agencies please. #J-18808-Ljbffr Capital One

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms T in New York, NY vacancy
  • $197.3k - $225.1k

     ...Overview Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy...  ...business value. The team builds scalable platforms that deliver omnichannel messages in owned and... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    New York, NY
    a month ago
  • $229.9k - $262.4k

     ...Sr. Lead Data Engineer (Enterprise Platforms Technology) Do you love building...  ...programming languages like Python, SQL and Open Source...  ...services such as Snowflake, Databricks Optimize...  ...cloud computing (AWS, Microsoft Azure,...  ...Hive, EMR, Kafka, Spark, or MySQL) 4+ year... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Part time
    Internship
    Local area

    Capital One

    New York, NY
    22 hours ago
  • $110k - $130k

     ...Functional Skills Snowflake, Cortex AI, Python and Insurance Domain on AWS Cloud, Talend...  ...Snowflake Lead will serve as...  ...’s enterprise data platform, responsible...  ...strong data engineering fundamentals,...  ...oversight for SQL, Python, and...  ...ML platforms (Databricks / SageMaker /... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    Tata Consultancy Services

    New York, NY
    4 days ago
  • Capital One invites a Lead Data Engineer to shape data pipelines and AI-enabled platforms in New York. You will collaborate with agile teams to design, build,...  ...and optimize end-to-end data solutions, using Python, SQL, Spark, and cloud services. You will mentor... 
    Platform
    Amazon Web Service
    SQL

    Capital One

    New York, NY
    2 days ago
  •  ...Data Engineering-Big Data EngineeringAs...  ...technical lead, you will...  ...the enterprise.ResponsibilitiesData...  ...& Platform DevelopmentDesign...  ...Snowflake, AWS, Apache Airflow...  ....Optimize SQL workloads,...  ...expertise in SQL, Python, and...  ..., Databricks, or similar...  ...including Spark, Hadoop, Hive... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    EXL

    New York, NY
    1 day ago
  • $197.3k - $225.1k

     ...Overview Lead Machine Learning Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) As a Capital One Machine Learning...  ...disciplines, such as Ops, Modeling, and Data Engineering. In this role, you...  ...scikit-learn, PyTorch, Dask, Spark, or TensorFlow ~2+ years of... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    New York, NY
    a month ago
  • $124k - $135k

     ...experience with data and...  ...and Data Platforms, you will...  ...Product, Engineering, and...  ...supporting our enterprise partners...  ...lead work streams...  ...rolesProficiency in SQL, DBT, and...  ...in Python for ETL and...  ..., Databricks/Spark, AWS, Snowflake, or other...  ...USDCandidate Use of GenAI Tools:We’... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Local area
    Flexible hours

    The New York Times

    New York, NY
    16 hours ago
  •  ...Big Data EngineerWe are...  ...Big Data Engineer to design...  ...distributed data platforms to...  ....Strong SQL and data...  ...Hadoop, Spark, Hive, HBase...  ...: Snowflake, Redshift...  ...Talend, AWS Glue, Azure...  ...Languages: Python, Java, Scala...  ...architectures using Databricks, Delta...  ...to enterprise data... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Remote work

    Ova Technologies

    New York, NY
    1 day ago
  • $141.2k - $278.3k

     ...Manager - AI & Data Risk...  ...architecture, data platforms, data...  ...Generative AI (GenAI) in...  ...Ability to lead projects or...  ...Programming (e.g., Python, SQL, R, Java,...  ...(e.g., Databricks, Snowflake, Apache Spark & Kafka, etc...  ...SPSS, SAS Enterprise Miner, RPL,...  ...Certification (e.g. AWS, Azure),... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    Deloitte

    New York, NY
    1 day ago
  •  ...the world’s leading...  ...Overview The Snowflake AI Data Engineer / Lead serves...  ...native AI, GenAI, and...  ...engineering on AWS Cloud....  ...Snowpark (Python), and Talend...  ...analytics on enterprise data....  ...Snowflake platform architecture...  ...Guide SQL, Python, and...  ...such as: Databricks SageMaker... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Permanent employment
    Full time
    Local area

    Capgemini

    New York, NY
    19 days ago
  • $216k - $270k

     ...Generative AI Platform) is an enterprise-grade AI platform...  ...for a strong engineer to join our...  ...(GCP, Azure, AWS) for customers...  ...and customer data environments (...  ...Proficient in Python or Javascript/...  ...Typescript, and SQL ~ Experience...  ...power the world's leading models, and... 
    Platform
    Amazon Web Service
    SQL
    Full time

    Scale Ai, Inc.

    New York, NY
    16 hours ago
  • $125k - $145k

     ...a range of data and AI projects...  ...ready data platform and...  ...spans data engineering, AI product...  ...architecture using Python, Spark, SQL, and modern...  ...AI and GenAI solutions into...  ...and Enterprise IT partnerships...  ...technologies (e.g., Snowflake, Databricks, Delta Lake...  ...industry-leading benefits,... 
    Platform
    Databricks
    SQL
    Full time
    Work at office
    Flexible hours
    Day shift

    Bank of America

    New York, NY
    16 hours ago
  • $140k

     ...Snowflake Lead Data Engineering with AILocation: New York, NYDuration...  ..., Cortex AI, Python and Insurance Domain on AWS Cloud, Talend...  ...technical lead client's enterprise data platform, responsible for...  ...oversight for SQL, Python, and ELT...  ...ML platforms (Databricks / SageMaker /... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    Diverse Lynx

    New York, NY
    16 hours ago
  •  ...Data EngineerDesign, build, and...  ...Kyriba into Snowflake and Databricks. Develop and...  ...across cloud platforms and structured...  ...and feature engineering built on top...  ...Databricks, Apache Spark (PySpark/SQL).Proven...  ...experience with AWS services — including...  ...a fast-paced enterprise... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    TPI Global

    New York, NY
    4 days ago
  •  ...Analytics, Engineering,...  ...experience in data engineering...  ...rolesProficiency in Python, Scala, or...  ...skills in SQL and...  ...with cloud platforms such as (AWS, GCP, Azure...  ...such as Snowflake, BigQuery,...  ...experience with Databricks, AWS Glue,...  ...such as (Spark, Dask,...  ...practices, and GenAI toolkits (... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Apprenticeship
    Easy work

    McKinsey & Company

    New York, NY
    16 hours ago
  •  ...looking for an experienced Lead Platform Engineer, Snowflake to help shape and support enterprise data platforms in New York,...  ..., including Microsoft SQL Server and PostgreSQL,...  ...environments such as AWS.• Drive data migration...  ..., or tooling in Python to streamline operational... 
    Platform
    Amazon Web Service
    SQL
    Contract work

    Robert Half

    New York, NY
    16 hours ago
  • $147.3k - $243.8k

     ...of cloud data platform...  ...Database, and GenAI. ~10+...  ...such as Spark and Kafka...  ...ability in Python, SQL, or...  ...Architect, AWS Architect...  ...Architect, Snowflake...  ...and/or Databricks Certified...  ...Architect/Engineer with a strong...  ...leading data platform...  ...support enterprise customers... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Work from home
    Flexible hours

    Oracle

    New York, NY
    4 days ago
  •  ...& Design, Engineering and Managed...  ...a Senior Data Engineer,...  ...will prepare enterprise domain...  ...enterprise data platform. You will...  ...across Databricks and Snowflake, converting...  ....Advanced SQL together with Spark / PySpark,...  ...with AWS and S3, in...  ...Foundations: Python; YAML data... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Contract work

    Appnovation

    New York, NY
    2 days ago
  •  ...Data-Mesh / Enterprise Architect to join our team in New...  ...plane, the self-serve platform and the catalogue...  ...medallion architecture: Databricks with Unity Catalog, Delta, Snowflake, Kafka, Airflow,...  ...equivalents on AWS (Lake Formation,...  ...consuming domains. ~ SQL Server and T-SQL... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Contract work
    Work at office

    Realtech Services

    New York, NY
    3 days ago
  • $112.29k - $161.28k

     ...descriptionPHM is the leading health media...  ..., where data becomes...  ...Azure and AWS technology stacks...  ...cloud platforms (e.g., Snowflake, Databricks)Define enterprise data models,...  ...processes using SQL, Python, and...  ...mentorship to data engineers and...  ...SQL, Python, Spark (PySpark), JavaETL... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Temporary work
    Freelance
    Flexible hours

    Publicis Media

    New York, NY
    1 day ago
  • $110k - $130k

     ...York Times, data powers...  ...for a Data Engineer to help us...  ...architecture (AWS and GCP) and...  ...contribute to the platform that...  ...Administer and tune Spark...  ...proficiency in Python for scripting...  ...in SQL and demonstrable...  ...(BigQuery, Snowflake, DataBricks)Familiarity...  ...Candidate Use of GenAI ToolsWe’re... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Full time
    Local area
    Flexible hours

    The New York Times

    New York, NY
    3 days ago
  •  ...Lead Data EngineerLocations: Richmond...  ...data engineering solutions that...  ...technologies like AWS.Develop and...  ...using Snowflake.Oversee the...  ...as AWS Glue, Spark, and Databricks.Optimize database...  ...across both SQL and NoSQL...  ...programming skills in Python, Scala, Java...  ...as a global platform and they are... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Work at office

    InterSources

    New York, NY
    2 days ago
  • A data solutions company in Georgia is seeking a qualified...  ...strong expertise in Databricks Lakehouse architecture...  ...with PySpark and Spark SQL. Ideal applicants will...  ...possess a deep knowledge of AWS services and data...  ...significantly impact data platform development and operations... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    VySystems

    New York, NY
    3 days ago
  • $137.4k - $161.7k

     ...seeking a Senior Data Engineer to join our...  ...modern cloud data platforms that enable...  ...technologies such as Databricks, Snowflake, and Microsoft...  ...using AWS, Azure, and GCP...  ...Fabric to support enterprise analytics, AI,...  ...pipelines using Spark, SQL, Python, and modern orchestration... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    16 hours ago
  • $132k - $165k

     ...Enterprise Customer Success Manager -...  ...leverage their data to make informed...  .... Our platform bridges the gap...  ...Experience with SQL, data visualization...  ...preferred (Snowflake, Databricks, Redshift, BigQuery...  ..., SQL, Python, and native AI...  ...NewView Capital, Spark Capital, Sutter... 
    Platform
    Databricks
    SQL

    Sigma Computing

    New York, NY
    2 days ago
  •  ...Orchestration Engine helping enterprise retailers, brands...  ...are hiring a Lead Data Engineer to...  ...analytics and data platform initiatives....  ...multiple Databricks instances as part...  ...Implement complex Spark and Databricks...  ..., and Spark SQL Proven...  ...sources in Azure, AWS, GCP, and others... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    For contractors
    Work at office
    Remote work

    Logicbroker

    New York, NY
    16 hours ago
  •  ...seeking a Senior Data Scientist...  ...supporting enterprise retail...  ...client data platforms (Snowflake, Databricks, Fabric, BigQuery...  ...with data engineering to define...  ....Advanced SQL and production-grade Python (pandas,...  ...Databricks, Azure/AWS/GCP) and...  ....LLM/GenAI application... 
    Platform
    Databricks
    Amazon Web Service
    SQL
    Permanent employment
    Worldwide

    iSoftStone

    New York, NY
    16 hours ago
  •  ...Phoenix Group is seeking a Senior Data Engineer to join our growing data and...  ...the business. You will work with Python, SQL, Snowflake, dbt, Airflow, Databricks, and AWS to enable reliable data-driven...  ...quality, and scalable data platforms across functions and partners.... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    The Phoenix Group

    New York, NY
    2 days ago
  •  ...Senior Director to lead our Enterprise BI Practice ,...  ...—combining deep data/analytics expertise...  ...BI / Power BI / GenAI practice Define...  ...enterprise BI platforms (Tableau, Cognos...  ...Experience with Snowflake, Databricks Exposure to Generative...  ..., design, engineering and business operations... 
    Platform
    Databricks

    Capgemini

    New York, NY
    16 hours ago
  •  ...a highly motivated Engineering Consultant with experience...  ...domain to work on data and analytics-...  ...integration, and platform enablement to support...  ...cloud platforms (AWS, Azure, or GCP) and...  ...with tools such as Python, SQL, Spark, Databricks, Snowflake, or similar technologies... 
    Platform
    Databricks
    Amazon Web Service
    SQL

    MathCo

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms T. Be the first to apply!