Lead Data Engineer - GenAI & Cloud (Python/AWS/Spark)
Capital One
Capital One invites a Lead Data Engineer to shape data pipelines and AI-enabled platforms in New York. You will collaborate with agile teams to design, build, and optimize end-to-end data solutions, using Python, SQL, Spark, and cloud services. You will mentor engineers, implement scalable data architectures, and contribute to a culture of continuous learning while delivering robust, market-ready capabilities for widespread use. #J-18808-Ljbffr Capital One
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - GenAI & Cloud (Python/AWS/Spark) in New York, NY vacancy
$215.2k - $245.6k
Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space... ...and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift...Amazon Web ServicePythonFull timePart timeInternshipH1bLocal area$179.4k - $245.6k
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex... ...and Open Source RDBMS and NoSQL databases and cloud-based data warehousing services such as...Amazon Web ServicePythonFull timePart timeInternshipH1bLocal area- Lead GenAI Engineer AWS Location: Remote Job Type: Full-time Experience: 5 to 9 years Cloud Requirement: AWS Mandatory (Amazon Bedrock & SageMaker... ..., covering everything from data ingestion to deployment and... ...High‑level proficiency in Python, the AWS SDK (boto3), and building...Amazon Web ServicePythonFull timeRemote work
$229.9k - $262.4k
...Sr. Lead Data Engineer (Enterprise Platforms Technology) Do you... ...programming languages like Python, SQL and Open Source... ...NoSQL databases and Cloud based data warehousing... ...with cloud computing (AWS, Microsoft Azure,... ...Hadoop, Hive, EMR, Kafka, Spark, or MySQL) 4+ year experience...Amazon Web ServicePythonFull timePart timeInternshipLocal areaCapital One
New York, NY6 hours ago$130.6k - $192k
...About the Team The Spark Platform team owns and... ...powers the company's data, analytics, and ML... ...Role As a Software Engineer on Spark Platform, you... ...Comfort working in a cloud environment (AWS preferred) — VPC networking... ...experience with Python, Go, Scala, or Java; SQL...Amazon Web ServicePythonHourly payWork at officeLocal areaRemote workRelocationFlexible hoursDoordash Usa
New York, NY1 day ago- ...Number: 25-00664Title: Lead Data EngineerLocation:... ...in data engineering programming languages (preferably Python, alternatively Scala... ...frameworks (preferably Spark, alternatively Flink... ...Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services...Amazon Web ServicePython
$250.8k - $286.2k
...Senior Lead AI Engineer (GenAI Platform Services) Overview: At Capital One... ...SaaS AI technologies such as AWS Ultraclusters, Huggingface,... ...experience programming with Python, Go, Scala, or Java Preferred... ...responsible AI solutions on cloud platforms (e.g. AWS, Google...Amazon Web ServicePythonFull timePart timeLocal areaCapital One Financial Corp
New York, NY5 days ago$229.9k - $286.2k
Senior Lead AI Engineer (GenAI Platform Services, Agentic) Overview: At Capital... ...SaaS AI technologies such as AWS Ultraclusters, Huggingface,... ...experience programming with Python, Go, Scala, or Java Preferred... ...responsible AI solutions on cloud platforms (e.g. AWS, Google...Amazon Web ServicePythonFull timePart timeLocal area- ...BDIPlus is seeking a Senior Data Engineer to support a Fortune 100 financial services client... ...Lakehouse storage using Apache Iceberg on AWS S3 Define and implement machine-... ...frameworks Strong SQL and programming skills (Python, Spark; dbt preferred) Experience with CDC...Amazon Web ServicePython
VALID8 Financial
New York, NY1 day ago - ...Data Engineering-Big Data EngineeringAs a technical lead, you will guide engineering teams, establish... ...Develop and manage cloud-native data... ...leveraging Snowflake, AWS, Apache Airflow and... ...expertise in SQL, Python, and PySpark.Extensive... ...including Spark, Hadoop, Hive, HBase...Amazon Web ServicePython
EXL
New York, NY1 day ago - ...Lead Data EngineerLocations: Richmond - VA / McLean... ...of scalable data engineering solutions that deliver... ...processing of data using cloud technologies like AWS.Develop and maintain... ...such as AWS Glue, Spark, and Databricks.... ...programming skills in Python, Scala, Java, and...Amazon Web ServicePythonWork at office
InterSources
New York, NY1 day ago $70 - $85 per hour
...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $7... ...data pipelines using Apache Spark on Databricks. Build and manage... ...notebooks, SQL, and Python. Collaborate with AI/ML teams... ...reliability, and cost-efficiency in cloud platforms (AWS, Azure, or GCP). Ensure...Amazon Web ServicePythonContract workLocal areaRemote workFlexible hoursINSPYR Solutions
New York, NY1 day ago$197.3k - $225.1k
## Lead Data EngineerApplylocations: New York,... ...are seeking **Data Engineers** who are... ...like Java, Scala, Python and Open Source RDBMS... ...NoSQL databases and Cloud based data warehousing... ...cloud computing (AWS, Microsoft Azure,... ...Hive, EMR, Kafka, Spark, Gurobi, or MySQL)...Amazon Web ServicePythonFull timePart timeInternshipLocal areaCapital One Group
New York, NY4 days ago- ...seeking a highly motivated Engineering Consultant with experience... ...domain to work on data and analytics-driven initiatives... ...integration. Experience with cloud platforms (AWS, Azure, or GCP) and modern... ...with tools such as Python, SQL, Spark, Databricks, Snowflake, or...Amazon Web ServicePython
- A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing...Amazon Web ServicePythonFull time
- Elevate and drive innovation, data engineering solutions, and serve as a... ...products.As a Senior Lead Software Engineering at... ...Databricks, DBX, PySpark, Spark, Terraform, Kafka, Python/Scala, Glue/EMRExperience... ...pipelines and platforms in cloud (AWS S3, Databricks, GCP,...Amazon Web ServicePythonWork at office
$209k - $238.5k
...needs. We are seeking Data Engineers who are passionate... ...One Senior Lead Data Engineer, you... ...like Java, Scala, Python and Open Source RDBMS... ...NoSQL databases and Cloud based data... ...cloud computing (AWS, Microsoft Azure,... ...Hive, EMR, Kafka, Spark, Gurobi, or MySQL)...Amazon Web ServicePythonInternshipLocal area$124k - $135k
...experience with data and support of world... ...with Product, Engineering, and Design... ...will independently lead work streams in... ...workflowsProficiency in Python for ETL and... ..., Databricks/Spark, AWS, Snowflake, or other cloud data environmentsPreferred... ...Use of GenAI Tools:We’re excited...Amazon Web ServicePythonLocal areaFlexible hours$180k - $300k
...infrastructure and engineering capabilities,... ..., modern cloud architectures,... ...inference, and data preprocessing pipelines... ...runbooks for GenAI infrastructure... ...platforms such as AWS, Google Cloud... ...in Python and systems-level... ...72Point72 is a leading global alternative...Amazon Web ServicePythonWork experience placement- McKinsey & Company is seeking a data engineering professional to build graph-centric... ...and a semantic data layer powering GenAI applications. You will design entity... .... You will write production-grade Python and manage CI/CD pipelines on AWS/Docker infrastructure. You will...Amazon Web ServicePython
- ...OverviewWe are seeking a hands-on Senior / Lead Data Engineer to provide technical leadership for... ...firm. You will architect scalable, cloud-first data solutions; set... ...models, and platform services using Python, SQL, Snowflake, and AWS.• Architect reliable solutions for...Amazon Web ServicePython
- Job DescriptionMust Have: DBT Core, Snowflake and Python, AWS Airflow, Container services(Docker), TerraformGood to Have: BI tooling experience(Power BI or Tableau), understanding of Agile processes(Kanban or Jira)We need strong person as this position.Amazon Web ServicePython
Echo IT Solutions
New York, NY1 day ago - ...the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Consumer... ...one or more programming language(s) Python, Spark, AWS Experience with Real time messaging -... ...Enterprise Java development, SQL/NoSQL data platforms (Cassandra, PostgreSQL) is...Amazon Web ServicePythonWork experience placement
$175k - $250k
...250000 per year Responsibilities Lead the development of cloud-based data platforms, pipelines, and data products leveraging Python, SQL, Snowflake, and AWS. Build scalable solutions for a variety... ..., code reviews, mentorship, and engineering best practices. Drive projects...Amazon Web ServicePythonSelby Jennings
New York, NY5 days ago$140k
...Snowflake Lead Data Engineering with AILocation: New York, NYDuration: Full timeSalary: $140k / AnnumMust Have Technical/Functional SkillsSnowflake, Cortex AI, Python and Insurance Domain on AWS Cloud, Talend ETLRoles & ResponsibilitiesThe Snowflake Lead will serve as...Amazon Web ServicePythonDiverse Lynx
New York, NY4 days ago- ...Capital Markets - GenAI / Agentic Systems... ..., and data-driven AI pipelines... ...participate in / lead solution design.... ...applicationsImplement prompt engineering, evaluation... ...caseExperience in Python-based AI/ML developmentUnderstanding... ...with cloud platforms (Azure / AWS / GCP) Data...Amazon Web ServicePythonFull timeTemporary workWork experience placement
$110k - $130k
...Skills Snowflake, Cortex AI, Python and Insurance Domain on AWS Cloud, Talend ETL Roles &... ...Responsibilities The Snowflake Lead will serve as the onsite... ...CLEARBROOK ’s enterprise data platform, responsible for... ...Snowflake, strong data engineering fundamentals, and the...Amazon Web ServicePythonTata Consultancy Services
New York, NY4 days ago$170k - $225k
...seeking a Senior Central Cloud Infrastructure Engineer to serve as a... ...K8s, AI, etc) and lead the complex integration... ...experience using AWS, Terraform, Atmos, and Python (or equivalent... ...managed streaming data infrastructure via... ...interactions that spark creativity and connection...Amazon Web ServicePythonTemporary workWork at officeLocal areaMetropolis
New York, NYa month ago- ...skilled and hands-on GenAI / Agentic AI Developer... ...candidate will have strong Python development expertise... ...technologies, and cloud-native AI solutions. This... ...in Computer Science, Engineering, Data Science, or a related... ...Azure OpenAI AWS Bedrock Anthropic Claude...Amazon Web ServicePythonFull timeH1b
Capgemini
New York, NYmore than 2 months ago - ...Snowflake Lead – Data Engineering San Antonio, TX / New York, NY (Onsite) Local to San Antonio... ...Talend ETL / Talend Open Studio * Strong Python programming (including Snowpark... ...AI / AI-enabled analytics * Strong AWS Cloud data platform experience * Expertise...Amazon Web ServicePythonTemporary workLocal area
Delan Associates, Inc
New York, NYa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - GenAI & Cloud (Python/AWS/Spark). Be the first to apply!
Related searches
- cloud engineer intern New York, NY
- senior cloud data engineer New York, NY
- principal cloud engineer New York, NY
- senior principal cloud computing engineer New York, NY
- senior devops cloud engineer New York, NY
- senior cloud network engineer New York, NY
- lead cloud architect New York, NY
- aws cloud infrastructure engineer New York, NY
- remote cloud architect New York, NY
- cloud developer New York, NY