Senior Data Engineer: Python, AWS, Spark, Kafka, GenAI

Jobleads-US

Capital One is seeking a Data Engineer 4 to design and deploy cloud-first data solutions, emphasizing data modeling, governance, and scalable pipelines. You’ll lead cross-functional teams using Python, SQL, Spark, Kafka, and modern platforms like Databricks and Snowflake to deliver hyper-personalized experiences.

You will mentor engineers, collaborate with product managers, and ensure secure, high-quality data flows across Adtech platforms, enabling impactful customer insights and rapid delivery

#J-18808-Ljbffr Jobleads-US

Apply

Vacancy posted 15 hours ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer: Python, AWS, Spark, Kafka, GenAI in New York, NY vacancy

Data Engineer 4 (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
$197.3k - $225.1k
...Data Engineer 4 (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment?...
Amazon Web Service
Full time
Part time
Internship
H1b
Local area
Capital One National Association
New York, NY
17 hours ago
Senior Data Engineer
...difference in the world? The Senior Data Engineer will design and build... ..., and applying GenAI to both engineering... ...distributed data platforms on AWS or GCP. Hands-on... ...platforms such as Kafka and Spark. Experience scaling... .... Proficiency in python. Preferred Qualifications...
Amazon Web Service
Senior
Casual work
Local area
Remote work
First Up
New York, NY
4 days ago
Senior Data Engineer
...deserves better software. As a Senior Data Engineer, you'll be hands-on with the... ...expertise: Deep knowledge of AWS and open-source data tools (e.g. Spark, Iceberg, Kafka, dbt, etc.) Comfortable balancing... ...have: Proficiency in Python, SQL, and infrastructure-as-...
Amazon Web Service
Senior
Work at office
Remote work
Flexible hours
Camber
New York, NY
5 days ago
Senior data engineer
Senior Data Engineer Location: 100 percent remote Position: senior data engineer Contract: 6 months extendable or perm I Must have... ...: programming language in either java, GO, or scala, spark, apache flink, kafka, and AWS Core Responsibilities: Setting up streaming pipelines...
Amazon Web Service
Senior
Permanent employment
Contract work
Remote work
RIT Solutions
New York, NY
2 days ago
Senior ML/Data Engineer
$157.95k - $259.48k
...together the depth of data Catapult has... ...are looking for a Senior ML / Data Engineer to build the data infrastructure... ...such as Kafka, Kinesis, Flink, Spark Streaming, Pulsar,... ...isolation. ~ Strong Python and SQL skills. Professional... ...~ Experience with AWS, including ECS, EC2...
Amazon Web Service
Senior
Full time
Temporary work
Internship
Catapult Sports
New York, NY
a month ago
Senior Data Engineer
About the Role BDIPlus is looking for Senior Data Engineers who thrive on solving complex data... ...Design event-driven architectures using Kafka Build canonical data models Develop Iceberg... ...experience Strong SQL Kafka Spark CDC AWS Iceberg or Lakehouse technologies Data...
Amazon Web Service
Senior
Visa sponsorship
BDIPlus
New York, NY
2 days ago
Senior Azure Databricks Data Engineer
...skilled Databricks Engineer with minimum of 5+... ...optimize scalable data platforms and analytics... ...Years Experience) Senior Azure Databricks... ...Databricks, Apache Spark, and cloud-native services... ...& DevOpsAzure / AWS /... ...streaming solutions using Kafka/Event Hubs.Exposure...
Amazon Web Service
Senior
EXL Service
New York, NY
4 days ago
Senior Data Engineer
$133.22k - $199.84k
Our Senior Data Engineer will play an essential role by building the underlying infrastructures, collecting, storing, processing... ...per week in our NYC office. Our Technologies stack: Python, Spark, Airflow, DBT, Kafka, AWS, Docker, Kubernetes, MongoDB, Redis, Postgres,...
Amazon Web Service
Senior
Full time
Work experience placement
Work at office
2 days per week
Hello Heart
New York, NY
1 day ago
Senior Data Engineer
$175k - $195k
As a data engineer on our core Data Platform team, you will help level up... ...based infrastructure. We use AWS and Databricks here Strong programming skills in Python or a similar language Strong... ...source frameworks such as Airflow, Kafka, Spark, Kubernetes, etc. Comfortable...
Amazon Web Service
Senior
Work at office
Work from home
2 days per week
Tatari
New York, NY
2 days ago
Senior Data Engineer
$185k
...Senior Data Engineer New York, NY (This role is based in Trepp's NYC office... ...pipelines using native AWS cloud infrastructure. Basic... ...application development including Python, SQL, Scala, or Java ~5+... ..., Hadoop, Hive, EMR, Kafka, Spark) ~2+ years of experience working...
Amazon Web Service
Senior
Temporary work
Work at office
Work from home
Monday to Friday
Flexible hours
Trepp, LLC
New York, NY
2 days ago
Senior Data Engineer
$130k - $150k
The Senior Data Engineer is responsible for designing, building, and maintaining... ...data pipelines using Apache Spark, Kafka, and Flink • Build and... ...delivery • Expert proficiency in Python and SQL; PySpark experience... ...of cloud data services: AWS Glue, Azure Data Factory, GCP...
Amazon Web Service
Senior
Full time
Dynata
New York, NY
2 days ago
Senior Data Engineer
$75 - $85 per hour
...company, is looking for a Senior Data Engineer to support their Product Performance... ...pipelines using Scala and Python, primarily through... ...production experience with Spark and Kafka, hands-on Airflow orchestration... ...Basic understanding of AWS or another cloud provider (...
Amazon Web Service
Senior
Contract work
Local area
KellyMitchell Group
New York, NY
2 days ago
Senior Data Engineer
Senior Data Engineer Design and develop data and integration solutions that... ...sources using SQL, Azure, and AWS technologies Build... ...strong programming skills in Python, R or Java Experience working... ...MapReduce, Hadoop, Hive, EMR, Kafka, or Spark) Experience working on real...
Amazon Web Service
Senior
Remote work
Flexible hours
VS Tech Solutions
New York, NY
2 days ago
Senior Data Engineer
$10k
...all. About The Role As a Senior Data Engineer at Hinge, you will create... ...Proficient in Python, SQL, DevOps, and databases... ...Kubernetes, Docker, Terraform, Kafka, Airflow, dbt, Looker, AWS technologies (S3, Redshift... ...technologies (CircleCI), Spark, Databricks As a Member...
Amazon Web Service
Senior
Work experience placement
Hinge
New York, NY
4 days ago
Senior Data Engineer
Azure - Data Factory, Databricks, Synapse, ADLS Senior Data Engineer - 8+ Years Experience Job Type... ...expertise in Python, SQL, ETL/ELT, cloud... ...technologies such as Apache Spark/PySpark. Develop... ...platforms such as AWS, Azure, or GCP.... ...of Apache Kafka or other streaming...
Amazon Web Service
Senior
Full time
Work at office
Remote work
7Th Sky Tech
New York, NY
1 day ago
Senior Data Engineer
Senior Data Engineer At Imagine Believe Realize, LLC (IBR) we are driven by innovation... ...using technologies such as Spark, Python, Databricks, Palantir Foundry, Kafka, and related data engineering tools... ...data processing applications and AWS Lambda functions. Support data integration...
Amazon Web Service
Senior
Full time
For contractors
Remote work
Home office
Flexible hours
IBR (Imagine Believe Realize)
New York, NY
1 day ago
Senior Data Engineer
$155k - $175k
...delivering cloud, AI, data, and enterprise... ...potential. Job Title: Senior Data Engineer Location: 100% Remote... ...working knowledge of Python, SQL, Spark, Scala, Java, and enterprise... ..., Apache Spark, Kafka, Airflow, or equivalent... ...solutions on AWS, Azure, or Google Cloud...
Amazon Web Service
Senior
Full time
H1b
Local area
Immediate start
Remote work
Visa sponsorship
Bright Vision Technologies
New York, NY
4 days ago
Senior Data Engineer
$185k
Senior Data Engineer role at Trepp, Inc. Trepp's Data Platform Team is looking... ...with cloud computing (AWS, Microsoft Azure, Google Cloud... ...application development including Python, SQL, Scala, or Java 3+... ...MapReduce, Hadoop, Hive, EMR, Kafka, Spark) 2+ years of experience...
Amazon Web Service
Senior
Full time
Temporary work
Work at office
Work from home
Monday to Friday
Flexible hours
Trepp, Inc.
New York, NY
5 days ago
Senior Data Engineer II
$168k - $180k
...seller and buyer clients. Data is the foundation of... ...the company. As a data engineer, you will be responsible... ...development (e.g., Databricks, Spark, Kafka, Airflow). Proficient in Python, Java, or C# with 8+... ...using IaC technologies like AWS CloudFormation or Terraform...
Amazon Web Service
Senior
Minimum wage
Flexible hours
Compass
New York, NY
5 days ago
Senior Data Engineer
$150k - $200k
...own the investment data that powers a... ...trading platform? As a Senior Data Engineer on the Data team,... ...tooling like SQL, Kafka, Airflow, and Cloud... .... Expert-level Python (including Pandas,... ...data platforms on AWS or GCP with modern... ...computing frameworks like Spark or streaming...
Amazon Web Service
Senior
Work at office
Local area
Catch Talent
New York, NY
1 day ago
Senior Data Engineer
$126k - $180k
...The Department: Data At Gemini, our Data Team is the engine that powers insight... ...impact. The Role: Senior Data Engineer The... ...frameworks such as Python, SQL, Spark, Flink, Beam, or... ...streaming data (e.g. Kafka, Kinesis, Flink,... ...optimizing Databricks on AWS It Pays to Work...
Amazon Web Service
Senior
Contract work
Work at office
Remote work
Flexible hours
Gemini
New York, NY
3 days ago
Senior Data Engineer
Senior Data Engineer Worldly is the world's most comprehensive impact... ...graph-native models. GenAI/NLP Enablement Support... .../CDC pipelines (e.g., Kafka or Pulsar, Debezium,... ...or similar). Strong Python skills for pipelines,... ...., Dagster, Airflow). AWS infrastructure experience...
Amazon Web Service
Senior
Work at office
Remote work
Work from home
Flexible hours
Shift work
Worldly
New York, NY
5 days ago
Senior Data Engineer (Databricks)
$150k - $180k
...looking for an outstanding Senior Databricks Data Engineer to join our growing... ...— primarily AWS and Azure — anchoring... ...proficiency in SQL and Python, with the ability to... ...streaming technologies (Kafka, Kinesis, etc.). Have... ...Professional, or Apache Spark Developer) — we treat...
Amazon Web Service
Senior
Work experience placement
Livefront
New York, NY
2 days ago
Senior Technology Consultant - Data / AI Native Engineer
...Description: Job Title: Senior Technology Consultant Data / AI Native Engineer Location: Arlington,... ...in Databricks, AWS, PySpark, and modern Lakehouse... ...using PySpark, Spark, and Databricks. Build... ...using Structured Streaming, Kafka, Kinesis, or Databricks...
Amazon Web Service
Senior
Local area
Stellent IT LLC
New York, NY
4 days ago
Senior Data Engineer
...scalable architecture, robust data engineering pipelines, easy data... ...outstanding business outcomes. As a Senior Data Engineer , you will... ...technologies (e.g., Spark, Hadoop, Kafka) Databricks platform - data... ...of public cloud platforms AWS, Azure or GCP would be a plus...
Amazon Web Service
Senior
Immediate start
SunnyData
New York, NY
2 days ago
Senior Data and Analytics Engineer
$160k - $175k
...acquired Brooklyn Data Company, a premier... ...benefits. Overview The Senior Data & Analytics Engineer will play a crucial... ...skills in Python and SQL Hands‑on,... ...platforms such as AWS, Azure, or Google Cloud... ...solutions such as Spark Streaming or Kafka is desirable but not...
Amazon Web Service
Senior
Remote work
Velir
New York, NY
4 days ago
Senior Data Engineer
Data Engineer Choosing Capgemini means choosing a... ...inclusive world. GCP/AWS/Databricks/... ...programming language (Python, Scala, or Java) Experience... ...frameworks (Spark, Hadoop)... ...with Apache Spark, Kafka, or Databricks Knowledge... ...experience and skills, Seniority and performance,...
Amazon Web Service
Senior
Full time
Local area
Capgemini
New York, NY
2 days ago
Senior Data Engineer
$110k - $135k
...Program. Role Overview: The Senior Data Engineer will play a key role in... ...role requires expertise in AWS data services (Glue, Redshift... ...Lambda, S3, Kinesis), SQL, Python, Apache Spark, and PostgreSQL, with a focus... ...data pipelines using Kafka, Kinesis, or Spark Streaming...
Amazon Web Service
Senior
Full time
Temporary work
LifeStance Health
New York, NY
2 days ago
GenAI Python Systems Engineer - Senior Associate
$77k - $202k
The Opportunity As a GenAI Python Systems Engineer - Senior Associate, you will play a pivotal role in transforming raw data into actionable insights, enabling informed decision-making... ..., and cloud platforms, including AWS, Google Cloud, Microsoft Azure, Databricks...
Amazon Web Service
Senior
H1b
PwC
New York, NY
3 days ago
Senior Data Platform Engineer
$136k - $253k
...corporate transaction data into structured,... ...confidence. As a Senior Data Platform Engineer, you will design,... ...such as Hadoop, Spark, or Snowflake.... ...language, such as Python, Java, C++, or Go... ...Experience with AWS, Google Cloud Platform... ...such as Kafka or Flink. Familiarity...
Amazon Web Service
Senior
Full time
Work at office
Local area
Flexible hours
Thomson Reuters
New York, NY
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer: Python, AWS, Spark, Kafka, GenAI. Be the first to apply!