Lead Data Engineer: Build Large-Scale Data Pipelines & AI
Capital One
Capital One is seeking a Lead Data Engineer in Chicago, IL. You will help design large-scale data pipelines, collaborate with Agile teams, and mentor peers while leveraging Python, Spark, AWS, Snowflake, and Airflow to enable data-driven marketing decisions for millions of customers. The role emphasizes full-stack, cloud-based solutions, real-time data, and high-performance engineering in a fast-paced environment with a focus on innovation and impact. #J-18808-Ljbffr Capital One
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer: Build Large-Scale Data Pipelines & AI in Brooklyn, NY vacancy
- ...meaningful difference.As a Lead Data Engineer at JPMorganChase... ...that works to enhance, build, and deliver data collection... ...critical data pipelines and architectures across... ...enterprise-authorized AI capabilities within the... ...Azure)Experience with large-scale distributed data...Pipeline
$142.32k - $213.48k
...CitiCiti is looking for a Lead Data Engineer - AI & Distributed Analytics to architect and scale the enterprise data... ...high-performance data pipelines that bridge raw data... ...agile delivery.Design and build robust batch and real-... ...and delivering large-scale, distributed data...PipelineFull timeWork at officeRemote work$148.3k - $198.8k
...Lead Data Engineer Job ID 10155437 Location Orlando, Florida... ...on every day to build, ship, and govern... .... Helix is scaling fast, and the tools... ...including the reusable pipeline frameworks and... ...Design automation and AI capabilities that... ...estimate, and plan large, complex projects,...PipelineWork experience placementLocal areaShift workThe Walt Disney Company
Brooklyn, NY4 days ago$179.4k - $204.7k
## Lead Data EngineerApplylocations: Chicago, ILtime... ...EngineerDo you love building and pioneering in the... ...We are seeking Data Engineers who are passionate about... ...team builds robust, large-scale data pipelines using massive datasets... ...utilizing advanced AI tools to accelerate your...PipelineFull timePart timeInternshipH1bLocal areaCapital One
Brooklyn, NY2 days ago- ...envelope to enhance, build, and deliver top-... ...products.As a Lead Software Engineer at JPMorganChase... ...with a focus on data engineering and Spark... ...-authorized AI-assisted engineering... ..., including data pipeline reliability and... ...operational stability for large-scale data...Pipeline
$128.47k - $208.77k
...Technology, Digital and Data Job Description... ..., we are building a better world,... ...build industry leading digital... ...telematics, and AI capabilities to... ...Senior Lead Data Engineer on the Data Engineering... ...Python data pipelines that build... ...control on medium to large teams Deploying...PipelineWorldwideRelocation packageCaterpillar Brazil
Brooklyn, NY2 days ago- ...Lead Database EngineerAre you ready to make... ...of essential, building infrastructure capabilities... ...and implementing data standards and... ...a Lead Database Engineer, you will drive the... ...build scalable data pipelines, optimize data... ...performance tuning, and large-scale data processing....PipelineRemote workFlexible hours
Dtcc
Jersey City, NJ4 days ago - Serval is building an AI-native automation platform and is hiring its first dedicated data engineer to own the entire data stack from day one. You... ...warehouse and build the pipelines, models, and self-serve layer... ...that informs decisions at scale. #J-18808-Ljbffr UncoverPipeline
$210k - $250k
Astronomer empowers data teams to... ..., and AI to life and is... ...the industry-leading unified DataOps... ...accelerates building reliable data... ...nearly every large company and fast... ...use, run, and scale. We’re in a... ...As a Software Engineer on this team,... ...visibility into data pipelines across...PipelineWork at officeFlexible hours3 days per week- ...Massachusetts is seeking a Senior Data Engineer to join its IT organization’s... ...& Analytics team. You will help build, maintain, and optimize cloud-native data pipelines and datasets that enable analytics, reporting, and AI at scale. You will collaborate with Data Products...Pipeline
$150k - $165k
...programs. We are seeking a senior Lead Data Engineer as a Key Personnel for a bid opportunity to lead data pipeline engineering, operations,... ...and streaming data pipelines. Build and maintain metadata-driven... ...supporting data platforms used for AI/ML and Retrieval-Augmented...PipelineContract workSHR Consulting Group
Brooklyn, NY5 days ago- ...supporting enterprise data, regulatory... ...ownership, guide engineering decisions, and collaborate... ...team. Lead the design and delivery... ...reporting technology and large-scale financial data... ...and Django. Build secure, high-performing... ...and maintain ETL pipelines that collect,...PipelineWork at office
Axiom Path
Jersey City, NJ13 days ago - ...are seeking an experienced Lead Data Engineer to support complex data engineering... ...implement end-to-end data pipelines using PySpark, Snowflake,... ...Strong experience building distributed data processing... ...across our national hiring scale. Final offers are based on several...Pipeline
EXL
Jersey City, NJ2 days ago $126k - $210k
...and success. As a leading global financial services... ...cutting-edge AI and breakthrough technologies... ...this role you will Build robust batch/streaming data pipelines and transformations... ...using modern data engineering tools.Partner with... ...building large-scale batch and streaming...PipelineTemporary workWorldwideFlexible hours- ...insurance company and a leading commercial lines... ...and risk engineering services; affluent... ...experienced lead data engineer to join our... ...of scalable data pipelines, and ensuring the... ...systems including the build of repositories, such... .... Work with large amounts of data, interpret...PipelineWork experience placementLocal area
Chubb
Jersey City, NJ3 days ago - ...Machine Learning/Search Engineer to design and optimize massive... ...search systems at scale in Cupertino. You will blend... ...-based retrieval and build evaluation frameworks... ...collaborate with ML scientists, data engineers, and UX teams... ...and leverage latest AI breakthroughs for...
$205k - $235k
...EY and help to build a better... ...with innovative AI-powered technology... ...applied AI engineering to deliver scalable... ...enterprise data assets to produce... ...Lead the build and scaling of neuro‑symbolic... ...patterns, and data pipelines. Direct cross... ...with large-scale cloud architectures...PipelineWork experience placementSummer holidayWork at officeFlexible hoursEY
Hoboken, NJ5 days ago- ...limits of what's possible.As a Lead Software Engineer at JPMorganChase within the... ...that works to enhance, build, and deliver trusted market... ...adoption of enterprise-authorized AI-assisted engineering... ...stability.Experience in building data pipelines using AWS/...Pipeline
$165k - $180k
...community. We’re committed to building an environment where team... ...skilled and motivated Sr. AI Data Engineer with a proven track record... ...and maintain scalable data pipelines and workflows using Databricks... ...proven experience building large-scale data platforms, with at...PipelineWork experience placementH1bWork at officeLocal areaKarsun Solutions
Brooklyn, NY1 day ago- ...Learning Ark team, working on large language model service platforms... ...capabilities. You will help build end-to-end MaaS solutions, data pipelines, and evaluation systems across... ...The internship blends system engineering with cutting-edge AI research, offering hands-on experience...PipelineInternship
- ...Warriors are seeking an experienced Data Engineer to join the Business Strategy and Analytics... ...team in San Francisco. You will build scalable data pipelines (ELT/ETL), collaborate with data scientists... ..., monitoring, and stay current with AI technologies, including generative AI...Pipeline
$103.33k - $128.66k
...and help the world’s leading organizationsunlock the... ...value of technology and build a more sustainable,... ...We are seeking a Lead Data Engineer to provide technical leadership... ...and implement AI-powered accelerators,... ...architectures. Experience leading large-scale ETL migration and...Full timeLocal areaFlexible hours$255k - $320k
...strategic, hands on engineering leader who... ...activation, enterprise data platforms, and large scale integration... ...into complex data pipelines, operational... ...across channels, building modern data platforms ready for AI/ML, enforcing data... ...may include.Lead engineering strategy...PipelineFull timeCasual workShift work- ...skilled and motivated engineer Data engineer to join... ...to client to scale its operations while... ...version-controlled pipelines. Integration Develop... ...& Metadata Build and operate metadata... ...capable of handling large data volumes, high... ...big data, ETL, and AI-assisted tooling,...Pipeline
$205k - $235k
...EY and help to build a better... ...with innovative AI-powered technology... ...applied AI engineering to deliver scalable... ...enterprise data assets to produce... ...Lead the build and scaling of neuro-symbolic... ...patterns, and data pipelines. Direct cross... ...Experience with large-scale cloud architectures...PipelineWork experience placementSummer holidayWork at officeFlexible hours- ...what's possible.As a Lead Software Engineer at JPMorgan Chase, within... ...Investment Banking - Data Analytics - Payments... ...that works to enhance, build, and deliver trusted market... ...scalable data pipelines and ETL/ELT workflows... ...SecurityExperience developing Agentic AI, LLMs, RAG...Pipeline
- Reflection is seeking an engineer to build and operate ingestion systems that turn open web and large-scale data sources into reliable corpora for training frontier models. You... ..., versioning, and delivery to pre-training pipelines, collaborating with researchers and data...Pipeline
- Zeal, an AI-enabled software consultancy now part of Livefront, seeks a Data Engineer to join its data platform across U.S. hubs. You will build scalable pipelines and ensure data quality for Fortune 1000 clients. The role emphasizes collaboration with stakeholders, adoption...Pipeline
- ...The Senior Data Engineer will play a critical... ...ever evolving lead intelligence space... ...learning, and AI. About the Role AWS-Based ETL Pipeline - Deep Data... ...pure pipeline-building position. Much... ...small-to-moderate scale. Query and job... ...(joins across large "silver/gold" lake...PipelineShift work
Seamless
Brooklyn, NY3 days ago - ...Strategies is seeking an AI/ML Data Engineer to support the U.S. Coast... ...Transformation Strategy by designing, building, deploying, and scaling secure data platforms and production-grade data pipelines that enable Artificial... ...Experience working with large datasets, complex source...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer: Build Large-Scale Data Pipelines & AI. Be the first to apply!
Related searches
- data engineer analytics Brooklyn, NY
- principal data engineer Brooklyn, NY
- senior cloud data engineer Brooklyn, NY
- data center engineer Brooklyn, NY
- director data engineering Brooklyn, NY
- big data devops engineer Brooklyn, NY
- data engineer manager Brooklyn, NY
- sr data engineer Brooklyn, NY
- data engineer Brooklyn, NY
- sr information security engineer Brooklyn, NY